Losoya was born in San Antonio on April 11, 1808, to Ventura Losoya and Concepción de Los Angeles Charlé. Their old stone house was a former Alamo Indian dwelling. His parents, brother Juan, sister Maria and Toribio all lived in the two room building near the southwest corner of the mission compound.