A number of patrol cars were spotted in the Milby area of town