Baldomir said it plenty of times in interviews he wanted NO part in Margarito he said he repected him and for now he had other PLAN$ for his new found fame.
Now that doesn't mean Margarito beats him on that, but it does mean that Margarito posses a BIGGER threat then most Welters.

Same thing with Mosely saying he wasn't ready for Margarito.