As Brisbane’s population booms, something strange is happening in one pocket of the city – the number of residents is shrinking.