'If you stay out of power for long, you become irrelevant, your party members become restless and start looking to jump ship.'