The Government is still dealing with “challenges” around housing affordability, a minister has said.