The organisers are stepping down and said some members felt 'intimidated' by some of the 'swan people'.