Ray Leonard never left the Parish to avoid the punch