‘It is clear that my confirmation was unfairly becoming a distraction’, says Florida Republican