A mortgage advisor has said that there is one issue many people don't think about