Taoiseach Simon Harris has said he was focusing on outlining his election pitch to help people with disabilities instead of dwelling on his encounter with a care worker in Cork.