Singer spent early years of career dogged by rumours she was ‘hermaphrodite’