Plans have been refused for a proposed community centre extension in Nelson to turn it into a mosque.