"It will need to be based in a city which already attracts the best people," a peer told the House of Lords