Councillors have approved plans for the conversion of former farm buildings into a family home, despite concerns about impacts on the Green Belt.