Residents living near an Oxford University building are urging council planners to refuse a scheme for a Magdalen College building.