Rylan Clark insisted knowing of his mum Linda's whereabouts was crucial, following the awkward moment during a date at his home