Putting my own personal spin on this, out of the HOF fighters named so far:

Floyd
Ali
Duran
Tyson
Foreman
Holmes
SRL

I myself hated Larry Holmes. I found him to be a whining, hyprocritical racist, who also made some enemies when he infamously stated that "Marciano couldn't carry his (Larry's) jock". I celebrated when Tyson KTFO'ed him, even though he was clearly over the hill.

Liston was before my time, as obviously was Jack Johnson. But from what I've read, I probably wouldn't have disliked either one.

There are more recent fighters who will someday probably warrant consideration for the HOF, who I would add to the hated list.