He trained with James Toney and Riddick Bowe