A 69-year-old man has briefly faced court after being charged with rape, assault and burglary offences over his alleged 1980s sex attack on a grandmother.