"Eyesore" on-street communal bins will be installed in the historic fishing village.