paint-brush
Polling Error or No Polling Error? The Truth Will Probably Lie Somewhere in the Middleby@maxspeicher
146 reads

Polling Error or No Polling Error? The Truth Will Probably Lie Somewhere in the Middle

by Maximilian SpeicherOctober 12th, 2024
Read on Terminal Reader
Read this story w/o Javascript
tldt arrow

Too Long; Didn't Read

I've produced two predictions for the 2024 U.S. presidential election so far. One is based on a weighted average of high-quality 2024 polling. The other is corrected by the average of the 2016/20 polling error. But the truth will probably lie somewhere in the middle. So, I'm going to include a third one from now on, assuming this year's polling error will only be half of the 2016/20 average error.
featured image - Polling Error or No Polling Error? The Truth Will Probably Lie Somewhere in the Middle
Maximilian Speicher HackerNoon profile picture

… Which Still Doesn’t Look Very Good for Harris.


So far, in my own little forecast for the 2024 U.S. presidential election, I've produced two predictions:


One purely based on a weighted average of high-quality 2024 polling.

The above, but corrected by the average of the 2016/20 polling error.


(Please see this article for details on methodology.)


From now on, I'm going to include a third one, assuming this year's polling error will only be half of the 2016/20 average error. Let me elaborate.


It's most probably just as unrealistic to assume there'll be negligible systematic polling error in the swing states this year (①) as to assume it'll be as big as in 2016/20 (②). The truth will most probably lie somewhere in the middle.


Pollsters have been busy identifying reasons for their previous misses and finding potential fixes. For instance, to tackle nonresponse bias and challenges in identifying likely voters, they increasingly rely on mixed modes to contact participants and have improved weighting based on the 2020 vote preferences of respondents. Hence, it's unlikely the polling error in 2024 will be as extensive as before.


However, it's equally unlikely it'll all but disappear. While pollsters do have a good understanding of what probably caused polling errors in 2016/20, it's unclear if their adjustments will be effective. On top of that, there are efforts to make it harder for certain groups to vote, virtually all of which are carried out by Republicans (cf. https://www.democracydocket.com/).


For instance, the RNC sued to remove thousands of registered voters in Arizona, Michigan, North Carolina, and Nevada. Also, there has been a deliberate reduction in polling places, often in predominantly black areas. Here, as well, the question is how effective these measures will be. But it's safe to assume there'll be people who participated in opinion polling with the intent to vote and then won't (be able to).


Therefore, as already said, the truth will most probably lie somewhere in the middle. Ergo: a third prediction with half the polling error from the two previous election cycles. I've also adjusted one more thing in all predictions: as Pew Research explains, opinion polls' "real margin of error is often about double the one reported." Hence, I'm multiplying all standard deviations by 2 now.


Alright, now—finally!—for my latest forecast.


Here's the state of the race based on weighted high-quality polls only:



When adjusted by the full average polling error from 2016/20:



And with just half the average polling error from 2016/20:



Please feel free to head over to my Github—where I'll collect and archive everything—and have a look at the complete data and calculations in the latest Excel file: https://github.com/maxspeicher/2024-us-presidential-election


I also post regular updates on Twitter (now 𝕏): https://twitter.com/maxspeicher