The only thing that would justify his backing out right now, would be because he is in negotiations with Mayweather. Who just happens to be training full time again.

Other than that, he is wasting a 2 million dollar payday while waiting for Cotto's return. During that time he could have earned 2 Million Dollars. That would have been his biggest payday and one he was very capable of winning.