Fast is normally about hand speed and maybe feet/movement as well eg Joe Calzaghe and Meldrick Taylor

Athletic is normally describing a boxer who has a good physique which is better than his technical boxing skills eg Roy Jones who hardly used a jab.