Asides the fact that Haye is not a volume puncher, there's another thing that must be taken in to consideration. That is that Toney was a masterful in-fighter as well as outboxer. It stands within reason that he'd walk Haye down to a corner with pressure rather than punches and while in tight space rough an opponent that is clueless on the inside.

I don't think Haye will lose because he's a 'bum' it merely is a stylistic matchup that favours Toney greatly.