Security has been beefed up in Jaunpur following rumours that a Shivling was found near a graveyard in the Jaunpur Nagar Kotwali police station area, a police officer said on Saturday.