Conservative councillors fear a takeover by Stoke-on-Trent