I doubt Leonard ducked him. He was too busy fighting Hearns, Duran et cetera before his retirement in 1982 and Pryor was head long into drugs when Leonard came back in 1984 and 1987.