A post office in Newport is set to close at the end of January after the resignation of the postmaster.