Plans for Bicester Heritage to be used for events as late as 9pm have been permitted, despite receiving more than 100 objections.