The priest was initially suspended following an incident on November 3 at the Hindu Sabha Temple