For me, its a bigger sacrifice to have to loose the extra 3 pounds than to gain them.

As it has been pointed out, the physical drain is the real sticking point for me.