pushing the punch away does not leave you wide open if you do it correct
and that is what a parry is about.
it leaves your oppost open and even bring him off balance somethimes.

i as another guy mentioned it is verry important to move while punching the bag,
though there are certain drills you do on the bag without moving.