I think where the expression comes from in the states is from a town in Pennsylvania called Egypt which is in the middle of freaking nowhere
Thus the expression