Councillors called for action after hearing about the effects of high numbers of holiday homes on St Andrews and the East Neuk.