The concerns were cited in the rationale for purchasing a $9 million condo on Billionaires' Row