A number of factors can hit your pension pot by up to £1 million over your lifetime