The flag was quickly removed after police were called early on Friday morning