‘We spend more time with each other than we did before,’ the TV personality admitted