Plans to build five houses have been recommended for refusal by a town council who raised several concerns.