The couple left the Channel 4 show in 2022