‘Yellowstone’ star Luke Grimes recently said Costner’s departure from the series made it ‘the easiest season we’ve filmed’