Linda claimed she wouldn't be talking to her co-stars before walking off