Boxing Day walkers and swimmers will see a grey and mild day with some drizzle in places, the Met Office has said.