The Irish model said there had been speculation 'almost daily' about the state of their marriage