I don't think it was the weight lifting ever as much as just losing the experience of staying in the ring... With his mind he couldn't ever focus again purely on boxing, and thats why he never regained his earlier glory.