A man who says his neighbour's hedge is "spoiling his summer barbecues" has lost a bid to have it cut down.