It might be a foul but it doesn't LOOK like a foul which is why you're able to land it....I don't aim for the kidneys or anything because that would be wrong but right above or slightly behind the hip bone. If you're afraid of fouling just hit them on the arm or right under the arm

They also have a tough time seeing the left hook coming if you distract them with the right cross.