A man has been charged after allegedly performing a Nazi salute days after a synagogue was graffitied with swastikas.