An abolitionist and activist for African-American civil rights while building a successful career as a restaurateur in New York City; Newport, Rhode Island; and Washington, DC. His father had been an oyster seller and caterer in Philadelphia and New York City, building a business that attracted wealthy white clients. From the 1830s until the end of slavery, Downing was active in the Underground Railroad, using his restaurant as a rest station for refugees on the move.