It appears that at the time of the 1880 census, he was living with the Poppell family, along with his youngest brother.
Household:
Name Relation Marital Status Gender Race Age Birthplace Occupation Father's Birthplace Mother's Birthplace Harry POPPELL Self M Male W 27 FL Farmer GA GA Mattie POPPELL Wife M Female W 16 FL Keeping House GA NC Clarisa BELLAMY MotherL W Female W 45 NC Keeping House NC NC Oren MORGAN Other S Male W 18 FL Laborer NC NC
MORGAN Other S Male W 9 FL At Home NC NC Source Information:
Census Place Precinct 6 And 7, Taylor, Florida
Family History Library Film 1254132
NA Film Number T9-0132
Page Number 352D