A garden playroom that neighbours claim is being used as a party venue for adults can stay put, councillors have decided.