The reason why Dirrell isn't getting the benefit of doubt is because he's done this before as Skel has shown us an example. And this time its just too much of a coincidence that he has neurological problems when he's about to fight his best buddy Andre Ward.

Hence the skepticism.