Three new councillors have resigned from an Oxfordshire town council accused of infighting, mismanagement and having a ‘sinister culture’.