The dispute escalated on Sunday, when the members of one group arrived at the site with the construction material and excavator machines