Heres an example of olympians being banned for 2 years for just refusing a test.

British Olympic shot-putting hopefuls banned for refusing drug test | Sport | guardian.co.uk