The family of Lord Hanningfield has confirmed with “immense sadness” that he passed away on Sunday.