Wharton was hyped when he was punching guys out of the ring on BBC and was a massive ticket seller