Tensions were high as a controversial plan to convert a residential house in an Oxford suburb.