'It's been a very frustrating few years. The Liberals are backtracking but the damage has been done'