Initially slated for destruction, some of the bricks will be returned on Friday and Saturday to those who requested them