I'm not sure if he's the #1 unluckiest, but Ike Quartey comes to mind.

1. Got a draw against Jose Luis Lopez in a fight most thought he won.
2. Signed for a big money fight against Whitaker, which got cancelled when Whitaker got arrested for drug possession.
3. Lost a controversial decision to Oscar, a fight many people thought he won
4. Got robbed against Vernon Forrest