From a 2012 interview

Who was the best fighter you ever fought?
By far, Michael Watson in our second fight

Is it true that you wanted nothing to do with the Michael Nunn & James Toney?
Thats interesting, because I signed to fight both Nunn and James Toney. As part of the contract with Don King for Nunn, where I was the first fighter to get one over on him when me and Nigel drew. And as part of the contract with SKY for James Toney, where I was the first fighter to sign for a TV company direct, but he lost to Roy Jones.

Did Roy Jones Jr duck you?
It was never mandated. But I asked Roy Jones about 10 or 12 years ago if he'd said back in 93 that the one fighter he thought would give him problems and had reservations of taking on was me. He told me yes that was true

Did you take on all the toughest challenges in your career in your opinion?
“As world champion, what you want to avoid is a southpaw who is 6ft or more and unbeaten or been world champion. Rocchigiani and Calzaghe were fights that no other fighter would take. I took them, even though they weren’t even mandated.

“Not even Roy Jones, rated as the best pound-for-pound fighter in history by some writers, would take that fight even when it was mandated to.”
------------------------------------------------------------

Personally I have always thought that Chris would have been Roys toughest fight.
I also believe that Chris would have kicked the living shit out of James legend it his own mind wind bag Toney. Quite possibly the most overrated fighter in history.