'If you ever put up a DeRozan banner, I'll go up there and pull it down myself'