The Labour Government could be set to make a huge Brexit betrayal by making the UK join an EU trading agreement, according to the Business Secretary.