Brian, the fifth of eight Nolan siblings, says he "just wants cancer to leave us alone"