The owner said 'I just think people are daft if they don't understand the rule'