One of the first horses was called a Hyracotherium. It lived about 50 million years ago and was as tall as a fox. It had toes! This horse changed over millions of years to become a modern horse.