Joe and anyone else would have trouble with these guys (in their primes)

Roy Jones Jr.
James Toney
Tommy Hearns
Ray Leonard
Marvin Hagler
Chris Eubank
Nigel Benn
Jake LaMatta
Bernard Hopkins
Archie Moore
Gene Tunney
Harry Greb
Billy Conn
Bob Foster
Joey Maxim
Floyd Patterson

Now would Joe lose to all of them?.... probably not but he wouldn't win them all either.