Ur diet is not big enough to grow IMO

1.5-1.8 grams of protein per lean bod LB
2g of carbs per lean lb

and hv enough GOOD fats and you should grow

If you're training body parts TWICE a week. I would most definately LOWER the amount of sets to to 1-2.... I workout each muscle group 2x a week but only do ONE working set. Id o anymore and i am over trained.