He would not allow one partner to go to the gym because there were other men there