An appeal has been lodged over controversial plans to change two outbuildings into annexes at an Oxford property.