A warning has gone out after reports of youths “setting fires and throwing stones and eggs".