Guests say they were asked to leave the venue with 'no explanation or reason'