'You can't just be agitating all the time. You can't stay in power if you're constantly in chaos,' said Cynthia Moore