Danny didn't invited his dad to his wedding with wife Georgia Horsley and hasn't met his son Cooper