Shadowboxing will help your speed.

Stretching when you're not working out will help.

Remember that when you punch, you want snap it out there, and pull it back in very quickly.