Southampton boss Russell Martin insisted "the fans have been amazing," as he explained a controversial dig he made after the 1-0 defeat at Aston Villa.