I've tried much of the solutions above, only fix I've found is either dropping mouse polling rate to ~125hz or installing an older driver (I'm using 457.51)
I do want to update this to say that the newest driver (461.72, released today) still causes this issue. Just finished testing it out in a private match, without any additional people. In fact, I think it's actually gotten worse with the latest update. Gonna be reinstalling the old drivers again.