Church of England (CoE) leaders named in an abuse scandal report should be removed from their jobs, according to a former cabinet minister.