Plans to build a barn in Caerleon have been refused due to various environmental concerns.