Many people in north east Fife complain a high number of holiday homes restricts access to affordable housing.