The owner of the land said he wanted to create a home for his son