Politicians are being “distracted” from fundamental issues facing farmers because of the focus on changes to inheritance tax, a Labour MP has suggested.