Inspectors also found mould on the ceiling and a lack of cleaning solutions at the premises