Five people were injured after a brawl broke out between two groups at the Swami Ramakrishna Ashram in Shimla late Saturday night, said an official.