On the latest episode of The View, Alyssa Farah Griffin queried if Biden's own party members, including the former House speaker, drove him to quit the race