Plans to build a new house in Port Glasgow have been rejected by Inverclyde Council.