Khan would not risk going up to light middleweight.