It was a bit before my time (and we were overseas when I was a kid), but I have some older friends who were British skinheads and they have told me that all the music actually was derived from Ska and Reggae. I know some black guys who were skinheads too.

Maybe it was different in America?