Love Island All Stars winners Casey O'Gorman and Gabby Allen were seen dining with Mitch Taylor and his girlfriend Hayley Griffin - something which is thought to have sparked tension