The Swans legend has enjoyed something of a frosty relationship with Bluebirds fans over the years