Secret Service said it fired the agent following an investigation