The concerns were cited in the rationale for purchasing a $9-million condo on Billionaires' Row