Fines of up to £100 can be dished out by HMRC - with only some cancelled on appeal.