The ASX200 was down 0.4 per cent at midday after setting an all-time high on Monday, with losses for all four big retail banks.