Poage was born in Missouri in 1880 but moved to La Crosse, Wisconsin, as a child. He was a standout student and athlete in high school. Then he went to the University of Wisconsin-Madison for college. He was the first African American on the team and the first to win a Big Ten championship. He graduated in 1904. Shortly after, he competed in the St. Louis Olympics, where he won two medals. He was also sponsored by the Milwaukee Athletic Club.