Trump could win because he gave supporters plausible deniability (to themselves, if not to outsiders). He's putting on a show, messing with the media, trolling the left, that's just the way he talks, seriously but not literally, etc.
Vance's unabashed, creepy white nationalism doesn't have that.