Andy Whyment has reacted to his co-star's impending exit after he revealed the news himself