Asher attended Germantown Academy from kindergarten through 12th grade; he played on the football team. Asher went on to graduate from the Wharton School of Business at the University of Pennsylvania in 1960. He was the co-chairman of the Board of Directors of Asher's Chocolate Co., which his family has owned for four generations.