The PM has already totted up three working weeks of time spent abroad