Originally working as a conductor on the Detroit-Port Huron railroad, Baxter learned to play the Dulcimer from his father. In 1924, Henry Ford hired him as one of the first members of his newly-founded group, Henry Ford's Old Time Dance Orchestra. On records, Baxter is credited as E. P. Baxter even though his real middle initial was F.