An affordable homes plan has been approved amid concerns 'there are less and less homes for local people'