Blackburn with Darwen council has been accused of letting a prominent roadside pub 'go to rack and ruin'.