The Cholsey Post Office near Wallingford will be closed for three weeks from this month for extensive building works on the store.