I would go for Holmes - both of their problems was that they were the only 'big' name around when they were in their prime (for Holmes, he succeeded Ali and basically cleaned up the heavyweights as best he could when Don King was screwing the division as much as he could. For Lewis, both Tyson and Holyfield were well past their peaks and he never fought Bowe)

Both great fighters, though.