Although Ben Franklin started a postal delivery service in the American colonies in 1775, the U.S. Postal Service did not become an official part of the federal government until 1792. A few things have changed since then. In 1885, a first class stamp cost Americans 2 cents, and the cost didn’t exceed 4 cents until 1963.