Smith grew up in Missouri City, Texas and attended John Foster Dulles High School in Sugar Land, Texas. As a senior, he rushed for 481 yards and 10 touchdowns and caught 55 passes for 717 yards and 10 touchdowns. He committed to play at Texas A&M over Duke.
In his freshman season with A&M, Smith played in 6 games, making 22 receptions for 248 yards.
In his sophomore year, Smith was asked to play running back for the Aggies, and performed pretty well, rushing 49 times for 293 yards and 4 touchdowns, while also making 43 receptions for 564 yards.
Smith's best season came this year as a fifth year senior. He made 53 receptions for 795 yards and 2 touchdowns.