The memorial commemorating men who died during WW1 and WW2 would be moved from a church to a playing field