'Not all of are like Saif Ali Khan who fought back when his family was threatened.'