‘It’s like we are back at the stage where the far right are strong enough and scary enough that it’s not possible to sit in a bookshop and give a talk about music and history,’ Joe Mulhall says