Labour opponents and Plymouth environmental campaigners say Tory supremo had no option but to resign after city centre debacle