You're right, it's not fear. It's calculation. On the very real possibility that Mosley could beat Margarito, Tony's people have decided against a lucrative fight he couldn't have put together on his own reputation for a HUGELY lucrative fight against a guy he already beaten and in all likelihood will beat again. So in other words, the 'most feared' guy is playing it 'safe'.
Bookmarks