Look i dont like pbf at all. His antics and comments oout of the ring really piss me off. But to say his record is any weaker than some of the other p4p fighters is horse shat. In fact only the top fighters at 130 have really fought tougher opposition.
Lets look at his other main competitors for p4p number1 and compare.
Winky wright is widely regarded as a top 2 p4p yet his record has weaknesses.
His greatest wins are against fighters who are blown up welters such as mosley and trinidad, he drew with Jermaine Taylor who is not rated at all on this site and has lost to vargas(altho controversial). He also had a relatively close fight against sam soliman who got destroyed by anthony mundine.
I say this record is no greater than pbf's.

Jermaine Taylor: Two controersial wins against 40+ bernard hopkins, and a draw against smaller winky wright are his only bouts of real note.

Ricky Hatton: GGood win over Kostya, but then backs it up with Maussa? Collazo? Urango?

My point is unless its 130 aand fighters like pac mab jmm or morales no top guys fight each other consistently. No more than pbf anyway.