‘There’s so few spaces that you can go now, where you are private,’ says the Oscar winner