"We need to consider what's best for Japan's national interest. We're putting all options on the table in considering the most effective response," PM Ishiba said