Eating 5 or 6 small meals would be even better. Some fruit in there too. Meals don't all need to be big but more often especially earlier in the day would be better.

If you don't eat well and burn calories really fast maybe your glycogen levels are too low for longish workouts. Try sipping on a sports drink in between rounds in training and eating 2 hours before you workout.