Trump had gone to the traditional presidential service to commemorate his inauguration and was clearly not expecting the criticism.