‘I couldn’t be the partner that I wanted to be anymore,’ boxer admitted