He'll go where the money is, he is the best Middleweight right now but if the others refuse to meet him theres nothing to do but move on! This is prize fighting ($$$$$$) you fight the guys who will add to your bank account theres no reason to fight lesser talents but if the best availble are afraid to risk whatever theres nothing you can do!
The reason Sugar Ray fought Jake 5 times was because no one at that time was interested in fighting them! He's not that small for 168 he's just under 5'11" and has decent reach and walks around at 172lbs! He's probably in great shape at 162 so fight night he could be comfortable at 171-2
if Ward is at 180 fight night 10 pounds means little because Ward isn't hanging around inside all night!
You have to go where the money is, its a job to the fighter! Its a sport to the fans! Ray