The Tories are particularly vulnerable on priorities like housing and health care