I dont think people complained about Hopkins fighting De La Hoya or Ruiz fighting Jones.

Truth is the only difference will be strength, Manny would carry his speed and work rate