Nearly 2,000 homes in an Oxfordshire town were left without power for around four hours this morning.