Elmer Woerner was born circa 1905 in New Jersey as the second child of Emma (Rehmann) and Frederick Woerner.

In the 1910 and 1920 census reports, he was living with his parents and siblings on a farm on Twelfth Street, Hammonton, Atlantic County, New Jersey.