Councillors have voiced their concern after a high street bank announced its closure.