More than 250,000 fewer homes will be built across Victoria by 2051 in a revised housing plan as the government threatens to strip councils of certain powers.