A popular pub known for hosting clairvoyant evenings which was once rumoured to become a swingers club, has closed permanently due to "unforeseen circumstances”.