But would it even matter? Far right states that wouldn't have gone for Biden anyway take him off the ballot. So? Lincoln wasn't on the ballot in 1/3 of states in 1860.
On top of that, for all the birtherism that we had to hear in '08 and '12, Obama was never actually removed from any ballots. Because everyone knew that birtherism was BS, and the same would apply to calling Biden an "insurrectionist". But no, the GOP bluffed, and the liberal SCOTUS justices folded.