The two parties were at loggerheads throughout the day, with leaders taking shots against each other