‘I think a lot of people don’t say what they mean,’ Jolie says