A new vicar said it was like 'coming home' after she was officially installed in an Oxfordshire town.