Whats your routine like? Yes weights can slow you down and make you "stiff" but if done the right way they can help in every aspect.
When you start boxing dude, move onto olympic lifts, the big ones like bench press, deadlifts, military presses (standing) and squats. Clean and jerks and stuff are good too but i suggest you get somebody to teach you those as they can be hardcore on your back.