Viewers are expecting Joe Tate to rush back to the village after his sudden departure