Papers, Talk Slides, Software, and Other Documents on Voting and Election Audits

Papers

• Rivest, R.L. and P.B. Stark, 2024. The National Popular Vote (NPV) proposal for U.S. Presidential Elections undermines election integrity, https://papers.ssrn.com/sol3/papers.cfm?abstract_id=5032049
• Appel, A., and P.B. Stark, 2024. An Internet Voting System Fatally Flawed in Creative New Ways, https://arxiv.org/abs/2411.11796
• Stark, P.B., 2024. When Audits and Recounts are a Distraction: The 2020 U.S. Presidential Election in Georgia, https://arxiv.org/abs/2408.00055.
• Ek, A., M. Blom, P.B. Stark, P.J. Stuckey, and D. Vukcevic, 2024. Improving the Computational Efficiency of Adaptive Audits of IRV Elections, Proceedings of E-VOTE-ID 2024, Lecture Notes in Computer Science, in press. Preprint: https://arxiv.org/abs/2407.16465.
• Ek, A., P.B. Stark, P.J. Stuckey and D. Vukcevic, 2023. Adaptively Weighted Audits of Instant-Runoff Voting Elections: AWAIRE, Proceedings of E-VOTE-ID 2023, https://link.springer.com/chapter/10.1007/978-3-031-43756-4_3. (Best paper award: security, usability, and technical issues).
• Stark, P.B., 2024. Overstatement-Net-Equivalent Risk-Limiting Audit: ONEAudit, In: Essex, A., et al. Financial Cryptography and Data Security. FC 2023 International Workshops. FC 2023. Lecture Notes in Computer Science, vol 13953. Springer, Cham. https://doi.org/10.1007/978-3-031-48806-1_5 Extended preprint: http://arxiv.org/abs/2303.03335.
• Ek, A., P.B. Stark, P.J. Stuckey, and D. Vukcevic, 2024. Efficient Weighting Schemes for Auditing Instant-Runoff Voting Elections, Proceedings of the 24th International Conference on Financial Cryptography and Data Security, Lecture Notes in Computer Science, vol 14230. Springer, Cham., pp35--51. https://doi.org/10.1007/978-3-031-43756-4_3
• Glazer, A., J. Spertus, and P.B. Stark, 2023. Stylish Risk-Limiting Audits in Practice, Proceedings of E-VOTE-ID 2023, Lecture Notes in Informatics, to appear.
• Everest, F., M. Blom, P.B. Stark, P.J. Stuckey, V. Teague, and D. Vukcevic, 2023. Ballot-Polling Audits of Instant-Runoff Voting Elections with a Dirichlet-Tree Model, In: Katsikas et al. Computer Security. ESORICS 2022 International Workshops. ESORICS 2022. Lecture Notes in Computer Science, 13785. Springer, Cham. https://doi.org/10.1007/978-3-031-25460-4_30
• Stark, P.B., 2023. Non(c)esuch ballot-level comparison audits for precinct-count voting systems, Non(c)esuch Ballot-Level Comparison Risk-Limiting Audits. In: Katsikas et al. Computer Security. ESORICS 2022 International Workshops. ESORICS 2022. Lecture Notes in Computer Science, vol 13785. Springer, Cham. https://doi.org/10.1007/978-3-031-25460-4_31
• Stark, P.B., 2023. ALPHA: Audit that Learns from Previously Hand-Audited Ballots, Annals of Applied Statistics, 17(1): 641-679 DOI: 10.1214/22-AOAS1646 https://projecteuclid.org/journals/annals-of-applied-statistics/volume-17/issue-1/ALPHA-Audit-that-learns-from-previously-hand-audited-ballots/10.1214/22-AOAS1646.short. Preprint: https://arxiv.org/abs/2201.02707
• Everest, F., M. Blom, P.B. Stark, P.J. Stuckey, V. Teague, and D. Vukcevic, 2023. Ballot-Polling Audits of Instant-Runoff Voting Elections with a Dirichlet-Tree Model, In: Katsikas et al. Computer Security. ESORICS 2022 International Workshops. ESORICS 2022. Lecture Notes in Computer Science, 13785. Springer, Cham. https://doi.org/10.1007/978-3-031-25460-4_30
• Spertus, J., and P.B. Stark, 2022. Sweeter than SUITE: Supermartingale Stratified Union-Intersection Tests of Elections, Electronic Voting 2022, Springer-Nature, Cham https://link.springer.com/chapter/10.1007/978-3-031-15911-4_7 Preprint: https://arxiv.org/abs/2207.03379
• Stark, P.B., and R. Xie, 2022. They may look and look, yet not see: BMDs cannot be tested adequately, Proceedings of E-Vote-ID 2022, Lecture Notes in Computer Science, Springer-Nature, Cham https://link.springer.com/chapter/10.1007/978-3-031-15911-4_8
• Benaloh J., P.B. Stark, V. Teague, M. Volkamer, and D. Wallach, 2022. Research Opportunities in Evidence-Based Elections, Computing Community Consortium, Washington, DC. https://cra.org/ccc/wp-content/uploads/sites/2/2022/01/Research-Opportunities-in-Evidence-Based-Elections_Jan-5-Draft-1.pdf/
• Ryan, P.Y.A., S. Schneider, C. Schürmann, P.B. Stark, and W. Jamroga, 2022. A Declaration of Software Independence, in Festschrift for Joshua Guttman, Lecture Notes in Computer Science, v.13066, Springer-Nature, doi: 10.1007/978-3-030-91631-2_11 https://link.springer.com/chapter/10.1007/978-3-030-91631-2_11.
• Benaloh, J., K. Foote, P. B. Stark, V. Teague, and D. S. Wallach, 2021. VAULT-Style Risk-Limiting Audits and the Inyo County Pilot, IEEE Security & Privacy, 19, 8–18. doi: 10.1109/MSEC.2021.3075107.
• Waudby-Smith, I., P.B. Stark, and A. Ramdas, 2021. RiLACS: Risk limiting audits via confidence sequences, Proceedings of E-Vote ID 2021. Lecture Notes in Computer Science, Springer-Nature, Cham., doi: 10.1007/978-3-030-86942-7_9 (Best paper award, Track on Elections and Practical Experiences) Preprint: https://arxiv.org/pdf/2107.11323.pdf
• Blom, M., J. Budurushi, R. Rivest, P.B. Stark, P.J. Stuckey, V. Teague, and D. Vukcevic, 2021. Assertion-based approaches to auditing complex elections, with application to party-list proportional elections, Proceedings of E-Vote ID 2021. Lecture Notes in Computer Science, Springer-Nature, Cham. doi: 10.1007/978-3-030-86942-7_4. Preprint: https://arxiv.org/abs/2107.11903
• Ryan, P.Y.A., P.B. Roenne, P.B. Stark, D. Ostrev, N. Soroush, and F-E El Orche, 2021. Who was that masked voter? The tally won't tell! Proceedings of E-Vote ID 2021. Lecture Notes in Computer Science, Springer-Nature, Cham. doi: 10.1007/978-3-030-86942-7_8.
• Blom, M., P.B. Stark, P.J. Stuckey, V. Teague and D. Vukcevic, 2021. Auditing Hamiltonian Elections, Voting 21, to appear. Preprint: https://arxiv.org/abs/2102.08510
• Blom, M., A. Conway, D. King, L. Sandrolini, P.B. Stark, P.J. Stuckey, and V. Teague, 2020. You can do RLAs for IRV, Proceedings of E-VOTE ID 2020, R. Krimmer, M. Volkamer, B. Beckert, A.D. Maurer, D. Duenas-Cid, S. Glondu, I. Krivonosova, O. Kulyk, R. Küsters, B. Martin-Rozumilowicz, P. Rønne, M. Solvak, O. Spycher (Eds.), TalTech Press, ISBN 978-9949-83-601-7. (Best paper award, Track on Elections and Practical Experiences) Preprint: https://arxiv.org/abs/2004.00235
• Glazer, A., J. Spertus, and P.B. Stark, 2021. More style, less work: card-style data decrease risk-limiting audit sample sizes, Digital Threats: Research and Practice https://doi.org/10.1145/3457907
• Huang, A., R.L. Rivest, P.B. Stark, V. Teague, and D. Vukcevic, 2020. A Unified Evaluation of Two-Candidate Ballot-Polling Election Auditing Methods, Proceedings of E-Vote ID 2020. Lecture Notes in Computer Science, R. Krimmer, M. Volkamer, B. Beckert, R. Küsters, O. Kulyk, D. Duenas-Cid, and M. Solvak, eds., Springer Nature, Switzerland.
• Appel, A.W., R. DeMillo, and P.B. Stark, 2020. Ballot-marking devices cannot assure the will of the voters. Election Law Journal, https://doi.org/10.1089/elj.2019.0619
• Appel, A.W. and P.B. Stark, 2020. Evidence-Based Elections: Create a Meaningful Paper Trail, Then Audit, Georgetown Law Technology Review, 4, 523--541. https://georgetownlawtechreview.org/wp-content/uploads/2020/07/4.2-p523-541-Appel-Stark.pdf
• Glazer, A., J. Spertus, and P.B. Stark, 2020. Bayesian audits are average but risk-limiting audits are above average, Proceedings of E-Vote ID 2020. Lecture Notes in Computer Science, R. Krimmer, M. Volkamer, B. Beckert, R. Kusters, O. Kulyk, D. Duenas-Cid, and M. Solvak, eds., Springer Nature, Switzerland. Preprint: https://www.stat.berkeley.edu/~stark/Preprints/bayesRLA20.pdf
• Huang, A., R.L. Rivest, P.B. Stark, V. Teague, and D. Vukcevic, 2020. A Unified Evaluation of Two-Candidate Ballot-Polling Election Auditing Methods, Proceedings of E-Vote ID 2020. Lecture Notes in Computer Science, R. Krimmer, M. Volkamer, B. Beckert, R. Kusters, O. Kulyk, D. Duenas-Cid, and M. Solvak, eds., Springer Nature, Switzerland.
• Stark, P.B., 2020. Sets of Half-Average Nulls Generate Risk-Limiting Audits: SHANGRLA, Financial Cryptography and Data Security—FC 2020 International Workshops, AsiaUSEC, CoDeFi, VOTING, and WTSC, Kota Kinabalu, Malaysia, Bernhard, M., A. Bracciali, L. Jean Camp, S. Matsuo, A. Maurushat, P.B. Rønne and M. Sala, eds., Lecture Notes in Computer Science, 12063, Springer, 319–336. doi: 10.1007/978-3-030-54455-3_23 Preprint: http://arxiv.org/abs/1911.10035
• Stark, P.B., 2019. Risk-limiting audits and evidence-based elections, in Election Auditing: Key Issues and Perspectives, Caltech/MIT Voting Technology Project, http://electionlab.mit.edu/sites/default/files/2019-06/Election-Auditing-Key-Issues-Perspectives.pdf
• Wojciech, J., P. Roenne, P. Y. A. Ryan, and P.B Stark, 2019. Risk-Limiting Tallies, E-Vote ID 2019. Proceedings of E-Vote ID 2019. Lecture Notes in Computer Science, 11759, R. Krimmer, M. Volkamer, V. Cortier, B. Beckert, R. Kusters, U. Serdult and D. Duenas-Cid (Eds.) Springer Nature, Switzerland.
• Ottoboni, K. and P.B. Stark, 2019. Election Integrity and Electronic Voting Machines in 2018 Georgia, Proceedings of E-Vote ID 2019. Lecture Notes in Computer Science, 11759, R. Krimmer, M. Volkamer, V. Cortier, B. Beckert, R. Kusters, U. Serdult and D. Duenas-Cid (Eds.) Springer Nature, Switzerland. Preprint: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3426250
• Benaloh, J., P.B. Stark, and V.J. Teague, 2019. VAULT: Verifiable Audits Using Limited Transparency, Proceedings of E-Vote ID 2019. Lecture Notes in Computer Science, 11759, R. Krimmer, M. Volkamer, V. Cortier, B. Beckert, R. Kusters, U. Serdult and D. Duenas-Cid (Eds.) Springer Nature, Switzerland.
• Mohanty, V., N. Akinyokun, A. Conway, C. Culnane, P.B. Stark, and V. Teague, 2019. Auditing Indian Elections, Proceedings of E-Vote ID 2019. Lecture Notes in Computer Science, 11759, R. Krimmer, M. Volkamer, V. Cortier, B. Beckert, R. Kusters, U. Serdult and D. Duenas-Cid (Eds.) Springer Nature, Switzerland. https://arxiv.org/abs/https://arxiv.org/abs/1901.03108
• Ottoboni, K., M. Bernhard, A. Halderman, R.L. Rivest, and P.B. Stark, 2019. Bernoulli Ballot Polling: A Manifest Improvement for Risk-Limiting Audits, Voting '19. http://arxiv.org/abs/1812.06361
• Stark, P.B., 2019. Delayed Stratification for Timely Risk-Limiting Audits, https://www.stat.berkeley.edu/~stark/Preprints/delayed19.pdf
• Ottoboni, K., P.B. Stark, M. Lindeman, and N. McBurnett, 2018. Risk-Limiting Audits by Stratified Union-Intersection Tests of Elections (SUITE), Electronic Voting. E-Vote-ID 2018. Lecture Notes in Computer Science, Springer. https://link.springer.com/chapter/10.1007/978-3-030-00419-4_12. Preprint: https://arxiv.org/abs/1809.04235
• Behnezhad, S., A. Blum, M. Derakhshan, M. Hajiaghayi, M. Mahdian, C.H. Papadimitriou, R.L. Rivest, S. Seddighin and P.B. Stark, 2018. From Battlefields to Presidential Elections: Winning Strategies of Blotto and Auditing Games, ACM-SIAM Conference on Discrete Algorithms (SODA 2018), to appear. Preprint: https://www.stat.berkeley.edu/~stark/Preprints/behnezhadEtal18.pdf
• Lindeman, M., McBurnett, N., Ottoboni, K., and P.B. Stark, 2018. Next Steps for the Colorado Risk-Limiting Audit (CORLA) Program, https://arxiv.org/abs/1803.00698.
• Bochsler, D., J. Medzihorsky, C. Schuermann, and P.B. Stark, 2018. Report on the Identification of Electoral Irregularities by Statistical Methods, Opinion 874/2017, Report CDL-AD(2018)009, Venice Commission of the Council of Europe, http://www.venice.coe.int/webforms/documents/?pdf=CDL-AD(2018)009-e
• Stark, P.B., 2018. An Introduction to Risk-Limiting Audits and Evidence-Based Elections, written testimony prepared for the Little Hoover Commission, https://www.stat.berkeley.edu/~stark/Preprints/lhc18.pdf
• Bernhard, M., J.A. Halderman, R.L. Rivest, P. Vora, P.Y.A. Ryan, V. Teague, J. Benaloh, P.B. Stark and D. Wallach, 2017. Public Evidence from Secret Ballots, in: Krimmer R., Volkamer M., Braun Binder N., Kersting N., Pereira O., Schuermann C. (eds), Electronic Voting. E-Vote-ID 2017. Lecture Notes in Computer Science, 10615. Springer. https://doi.org/10.1007/978-3-319-68687-5_6 Preprint: https://arxiv.org/abs/1707.08619
• Chilingirian, B., Z. Perumal, R.L. Rivest, G. Bowland, A. Conway, P.B. Stark, M. Blom, C. Culnane, and V. Teague, 2016. Auditing Australian Senate Ballots. https://arxiv.org/abs/1610.00127
• Verified Voting Foundation, 2015. Principles for New Voting Systems, http://www.verifiedvotingfoundation.org/voting-systems-principles
• Benaloh, J., R.L. Rivest, P.Y.A. Ryan, P.B. Stark, V. Teague, and P. Vora, 2015. End-to-end verifiability. http://arxiv.org/abs/1504.03778
• Stark, P.B., and V. Teague, 2014. Verifiable European Elections: Risk-limiting Audits for D'Hondt and Its Relatives, JETS: USENIX Journal of Election Technology and Systems, 3.1, https://www.usenix.org/jets/issues/0301/stark.
• Lindeman, M., R.L. Rivest, and P.B. Stark, 2013. Retabulations, Machine-Assisted Audits, and Election Verification, http://www.stat.berkeley.edu/~stark/Preprints/retabulation13.htm.
• Lindeman, M., R.L. Rivest, and P.B. Stark, 2013. Machine Retabulation is not Auditing, www.stat.berkeley.edu/~stark/Preprints/retabNotAudit13.pdf.
• Bell, S., J. Benaloh, M.D. Byrne, D. DeBeauvoir, B. Eakin, G. Fisher, P. Kortum, M. McBurnett, J. Montoya, M. Parker, O. Pereira, P.B. Stark, D.W. Wallach, and M. Winn, 2013. STAR-Vote: A Secure, Transparent, Auditable, and Reliable Voting System. JETS: USENIX Journal of Election Technology and Systems, 1, 18–37. Reprint: https://www.usenix.org/sites/default/files/jets0101-complete.pdf. Preprint: http://arxiv.org/abs/1211.1904.
• Stark, P.B., 2012. Ballot-Polling Audits in Two Pages (±1) http://www.stat.berkeley.edu/~stark/Preprints/bpa2pp.pdf
• Bretschneider, J., S. Flaherty, S. Goodman, M. Halvorson, R. Johnston, M. Lindeman, R.L. Rivest, P. Smith, and P.B. Stark, 2012. Risk-Limiting Post-Election Audits: Why and How. http://www.stat.berkeley.edu/~stark/Preprints/RLAwhitepaper12.pdf (Endorsed by the American Statistical Association: http://www.amstat.org/policy/pdfs/StarkEtAlLetterOfSupport.pdf)
• Banuelos, J.H. and P.B. Stark, 2012. Limiting Risk by Turning Manifest Phantoms into Evil Zombies, https://arxiv.org/abs/1207.3413
• Stark, P.B., and D.A. Wagner, 2012. Evidence-Based Elections. IEEE Security & Privacy, 10, 33–41. http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=6203498 (preprint: http://www.stat.berkeley.edu/~stark/Preprints/evidenceVote12.pdf)
• Lindeman, M. and P.B. Stark, 2012. A Gentle Introduction to Risk-Limiting Audits. IEEE Security & Privacy, 10, 42–49. http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=6175884 (preprint: http://www.stat.berkeley.edu/~stark/Preprints/gentle12.pdf)
• Lindeman, M., P.B. Stark, and V.S. Yates, 2012. BRAVO: Ballot-polling Risk-Limiting Audits to Verify Outcomes. 2012 Electronic Voting Technology Workshop/Workshop on Trustworthy Elections (EVT/WOTE '12). (reprint: https://www.usenix.org/system/files/conference/evtwote12/evtwote12-final27.pdf)
• Higgins, M.J., R.L. Rivest, and P.B. Stark, 2011. Sharper p-values for Stratified Post-Election Audits. Statistics, Politics, and Policy. (reprint: http://www.bepress.com/spp/vol2/iss1/7/)
• McLaughlin, K. and P.B. Stark, 2011. Workload Estimates for Risk-Limiting Audits of Large Contests.
• Benaloh, J., D. Jones, E. Lazarus, M. Lindeman, and P.B. Stark, 2011. SOBA: Secrecy-preserving Observable Ballot-level Audit. (reprint: http://static.usenix.org/events/evtwote11/tech/final_files/Benaloh.pdf). 2011 Electronic Voting Technology Workshop/Workshop on Trustworthy Elections (EVT/WOTE '11). Video.
• Stark, P.B., 2010. Risk-Limiting Vote-Tabulation Audits: The Importance of Cluster Size, Chance, 23(3), 9–12. http://www.stat.berkeley.edu/~stark/Preprints/auditingChance10.pdf
• Stark, P.B., 2010. Super-simple simultaneous single-ballot risk-limiting audits. 2010 Electronic Voting Technology Workshop/Workshop on Trustworthy Elections (EVT/WOTE '10). http://www.usenix.org/events/evtwote10/tech/full_papers/Stark.pdf
• Stark, P.B., 2010. Why small audit batches are more efficient: two heuristic explanations. http://www.stat.berkeley.edu/~stark/Preprints/smallBatchHeuristics10.htm
• Stark, P.B., 2009. The status and near future of post-election auditing.
• Stark, P.B., 2009. Efficient post-election audits of multiple contests: 2009 California tests. Refereed paper presented at the 2009 Conference on Empirical Legal Studies. (preprint: http://ssrn.com/abstract=1443314)
• Hall, J.L., L.W. Miratrix, P.B. Stark, M. Briones, E. Ginnold, F. Oakley, M. Peaden, G. Pellerin, T. Stanionis and T. Webber, 2009. Implementing Risk-Limiting Audits in California, USENIX EVT/WOTE. (preprint: http://arxiv.org/abs/0905.4691)
• Stark, P.B., 2009. Auditing a collection of races simultaneously. http://arxiv.org/abs/0905.1422v1
• Ash, A., S. Pierson and P.B. Stark, 2009. Thinking outside the urn: Statisticians make their marks on U.S. Ballots. Amstat News, 384. 37–40. (reprint: http://www.amstat.org/outreach/pdfs/SP_ANJun09.pdf)
• Miratrix, L.W. and P.B. Stark, 2009. Election Audits using a Trinomial Bound. IEEE Transactions on Information Forensics and Security, 4, 974–981. (preprint: http://www.stat.berkeley.edu/~stark/Preprints/trinomial09.pdf)
• Stark, P.B., 2009. Risk-limiting post-election audits: P-values from common probability inequalities. IEEE Transactions on Information Forensics and Security, 4, 1005–1014. (preprint: http://www.stat.berkeley.edu/~stark/Preprints/pvalues09.pdf)
• Stark, P.B., 2009. CAST: Canvass Audits by Sampling and Testing. IEEE Transactions on Information Forensics and Security: Special Issue on Electronic Voting, 4, 708–717. (preprint: http://www.stat.berkeley.edu/~stark/Preprints/cast09.pdf)
• Stark, P.B., 2008. A Sharper Discrepancy Measure for Post-Election Audits. The Annals of Applied Statistics, 2, 982–985. http://arxiv.org/abs/0811.1697
• Stark, P.B., 2008. Conservative Statistical Post Election Audits. The Annals of Applied Statistics, 2, 550–581. http://arxiv.org/abs/0807.4005
• Stark, P.B., 2008. Election audits by sampling with probability proportional to an error bound: dealing with discrepancies. Working draft.
• Jefferson, D., K. Alexander, E. Ginnold, A. Lehmkuhl, K. Midstokke & P.B. Stark, 2007. Post Election Audit Standards Report—Evaluation of Audit Sampling Models and Options for Strengthening California's Manual Count.

Talks and Testimony

• When Audits and Recounts Distract from Election Integrity: The 2020 U.S. Presidential Election in Georgia, E-Vote-ID, Tarragona, Spain 1–4 October 2024. Slides: https://www.stat.berkeley.edu/~stark/Seminars/auditEVote24.slides.pdf
• Risk-limiting audits: theory and practice, DEF CON Voting Village, Las Vegas, NV, 9 August 2024. Slides: https://www.stat.berkeley.edu/~stark/Seminars/auditDefCon24.slides.pdf
• Under Oath: Observations from the Curling v. Raffensperger Election Trial, Scrutineers, 21 February 2024.
• Risk-limiting audits in theory, law, and practice, acceptance talk for the IEEE Cybersecurity Award for Practice, IEEE Secure Development Conference, Atlanta, GA, 18 October 2023. Slides: https://www.stat.berkeley.edu/~stark/Seminars/auditIEEE23.slides.pdf
• A novel failure mode in elections, E-Vote-ID 2023, Luxembourg, 4–6 October 2023.
• Election Integrity and Electronic Voting Machines in 2018 Georgia, USA, Berkeley–Tuskegee Data Science Initiative, Data Science Scholars Program, 31 July 2023. Slides: https://www.stat.berkeley.edu/~stark/Seminars/auditTuskegee23.slides.pdf
• Overstatement-Net-Equivalent Risk-Limiting Audit: ONEAudit, Voting '23, Brac, Croatia, 5~May 2023. (presented by Jacob Spertus). Slides: https://www.stat.berkeley.edu/~stark/Seminars/auditOneAuditVoting23.slides.pdf
• A taxonomy of audits, and a root-cause audit in New Hampshire. U.S. Election Assistance Commission Board of Advisors, Washington, DC, 25 April 2023. Slides: https://www.stat.berkeley.edu/~stark/Seminars/auditEAC23.slides.pdf
• Invited panelist, Emerging Election Technologies Enhancing Integrity, Transparency, and Confidence, AAAS Annual Meeting, Washington, DC, 3 March 2023. Slides: https://www.stat.berkeley.edu/~stark/Seminars/auditAAAS23.slides.pdf
• Evidence-Based Elections, Panel on Securing the Election Infrastructure: Challenges and Opportunities, IEEE International Conference on Collaboration and Internet Computing, 15 December 2022. Slides: https://www.stat.berkeley.edu/~stark/Seminars/auditIEEE22.slides.pdf
• Evidence-Based Elections, Statistics 20 Plenary Guest Lecture, University of California, Berkeley, 9 November 2022. Slides: https://www.stat.berkeley.edu/~stark/Seminars/auditStat20-22.slides.pdf
• Riffing On (and Ripping Off) Ron, RivestFest, MIT, Boston, MA, 7 October 2022. Slides: https://www.stat.berkeley.edu/~stark/Seminars/rivestMIT22.slides.pdf
• Non(c)esuch Ballot-Level Risk-Limiting Audits, 1st International Workshop on Election Infrastructure Security, ESORICS, Copenhagen, DK, 30 September 2022. Slides: https://www.stat.berkeley.edu/~stark/Seminars/noncesuchEIS22.slides.pdf
• Through the looking-glass, or sabbatical adventures in post-2020 election integrity, Department of Statistics, University of California, Berkeley, 31 August 2022 Slides: https://www.stat.berkeley.edu/~stark/Seminars/auditUCBStat22.slides.pdf
• Evidence-based elections, Joint Statistical Meetings (JSM) invited session on Modern Machine Learning Tools for Social Science, 8 August 2022. Slides: https://www.stat.berkeley.edu/~stark/Seminars/auditJSM22.slides.pdf
• Invited Panelist, "Best Practices for Responding to Glitches During an Election," Election Verification Network Annual Conference, Washington, DC, 17&endash;18 March 2022. Slides: https://www.stat.berkeley.edu/~stark/Seminars/auditEVN22.pdf
• Evidence-Based Elections, Georgia Tech School of Cybersecurity and Privacy, 4 February 2022. Slides: https://www.stat.berkeley.edu/~stark/Seminars/auditGATech22.slides.pdf Video: https://smartech.gatech.edu/bitstream/handle/1853/66285/stark_videostream.html?sequence=2&isAllowed=y
• Evidence-Based Elections and the status of the Windham, NH, forensic audit, CCR-L, La Jolla, CA, 9 June 2021. Slides: https://www.stat.berkeley.edu/~stark/Seminars/auditCCRL21.slides.pdf, https://www.stat.berkeley.edu/~stark/Seminars/auditNH.pdf.
• Evidence-Based Elections, New Hampshire Election Integrity Project, 14 April 2021. Slides: https://www.stat.berkeley.edu/~stark/Seminars/auditNH21.slides.pdf
• Invited panelist, NSF Workshop, Lessons Learned: Navigating a Presidential Election Through a Pandemic, 25–26 March 2021. Slides: https://www.stat.berkeley.edu/~stark/Seminars/auditNSF21.slides.pdf
• Invited panelist, Free and Fair Elections: Securing the Vote and Preparing for What's Next, Center for Security in Politics, University of California, Berkeley, 10 March 2021. Video: https://www.youtube.com/watch?v=z5ovPya7P1M
• Evidence-based elections, Special Physics/Applied Mathematics Colloquium, University of Colorado, Boulder, CO, 24 February 2021. Slides: https://www.youtube.com/watch?v=z5ovPya7P1M\
• Evidence-based elections, Department of Statistics, Carnegie-Mellon University, Pittsburgh, PA, 22 February 2021. Slides: https://www.stat.berkeley.edu/~stark/Seminars/auditCMU21.slides.pdf
• Evidence-based elections, Santa Fe Institute, 27 January 2021. Slides: https://www.stat.berkeley.edu/~stark/Seminars/auditSantaFe21.slides.pdf
• Berkeley Conversations: Election Integrity and Security, Division of Computing, Data Science, and Society, University of California, Berkeley, 26 October 2020. https://bids.berkeley.edu/events/election-integrity-and-security
• Evidence-Based Elections, The Influencers Salon, 10 October 2020. Slides: https://www.stat.berkeley.edu/~stark/Seminars/auditInfluencers20.slides.pdf
• Testing Cannot Tell Whether Ballot-Marking Devices Alter Election Outcomes, Institute for Social Research, Center for Political Studies, University of Michigan, Ann Arbor, MI, 30 September 2020. Slides: https://www.stat.berkeley.edu/~stark/Seminars/bmd-p-um-20.slides.pdf
• Evidence-Based Elections, Stanford Biostatistics Workshop, Stanford University, Stanford, CA, 24 September 2020. Slides: https://www.stat.berkeley.edu/~stark/Seminars/auditStanfordBio20.slides.pdf
• Evidence-Based Elections, Center for Data Analysis and Risk (CDAR), University of California, Berkeley, 15 September 2020. Slides: https://www.stat.berkeley.edu/~stark/Seminars/auditCDAR20.slides.pdf
• Testing cannot tell whether Ballot-Marking Devices alter election outcomes, Def Con Voting Village, 6–8 August 2020. Slides: https://www.stat.berkeley.edu/~stark/Seminars/bmd-p-talk-20.slides.pdf
• Declarations in Curling et al. v. Raffensperger et al. (Northern District of Georgia). https://www.stat.berkeley.edu/~stark/Preprints/cgg-rept-1.pdf, https://www.stat.berkeley.edu/~stark/Preprints/cgg-rept-2.pdf, https://www.stat.berkeley.edu/~stark/Preprints/cgg-rept-3.pdf, https://www.stat.berkeley.edu/~stark/Preprints/cgg-rept-4.pdf, https://www.stat.berkeley.edu/~stark/Preprints/cgg-rept-5.pdf, https://www.stat.berkeley.edu/~stark/Preprints/cgg-rept-6.pdf, https://www.stat.berkeley.edu/~stark/Preprints/cgg-rept-7.pdf, https://www.stat.berkeley.edu/~stark/Preprints/cgg-rept-8.pdf, https://www.stat.berkeley.edu/~stark/Preprints/cgg-rept-9.pdf, https://www.stat.berkeley.edu/~stark/Preprints/cgg-rept-10.pdf
• Risk-Limiting Audits, Michigan Association of Municipal Clerks, 11 June 2020. Slides: https://www.stat.berkeley.edu/~stark/Seminars/auditMI20.slides.pdf
• Panelist, How COVID-19 will shape the 2020 election, University of California, Berkeley, 8 May 2020. https://news.berkeley.edu/2020/05/08/how-covid-19-will-shape-the-2020-election/
• Panelist, The Fight For Election Security, Electronic Frontier Foundation and Free Speech for People, 6 May 2020. https://www.youtube.com/watch?v=mVcTs9H62SE
• Risk-Limiting Audits and Evidence-Based Elections, Joint UC Berkeley – UC Davis Statistics Colloquium, 21 April 2020. https://www.stat.berkeley.edu/~stark/Seminars/auditUCBUCD20.slides.pdf
• Evidence-Based Elections: The Role of Risk-Limiting Audits, Election Integrity in the Networked Information Era, Georgetown Law, Washington, DC, 7 February 2020. https://www.georgetowntech.org/electionintegrity Slides: https://www.stat.berkeley.edu/~stark/Seminars/auditGLaw20.slides.pdf
• Risk-Limiting Audits, MAA Invited Paper Session on "Can Mathematics Help Us Trust Our Elections Again?," Joint Mathematics Meetings, Denver, CO, 15–18 January 2020. https://www.stat.berkeley.edu/~stark/Seminars/auditMAA20.slides.pdf
• Election Hacking and Security, Kensington Public Library, Kensington, CA, 13 January 2020. https://www.stat.berkeley.edu/~stark/Seminars/auditKensing20.slides.pdf.
• RLAs and my Beefs with BMDs, The Coming 2020 Election Crisis: In Paper We Trust—3rd National Election Integrity Conference, Berkeley, CA, 5–6 October 2019. https://www.stat.berkeley.edu/~stark/Seminars/auditVRTF19.slides.pdf. Video: https://youtu.be/3kICZB1pq0A
• Trustworthy Elections: Evidence and Dispute Resolution, Voting Village, Def Con, Las Vegas, NV, 8–11 August 2019. https://www.stat.berkeley.edu/~stark/Seminars/auditDefcon19.slides.pdf
• Evidence-Based Elections and Risk-Limiting Audits, University of Melbourne, Melbourne, Australia, 17 April 2019. https://www.stat.berkeley.edu/~stark/Seminars/auditUMelb19.htm
• Ballot-marking devices (BMDs) are not secure election technology, letter to Subcommittee on Voting Technology of the Government Affairs Committee, Georgia House of Representatives, 18 February 2019. https://www.stat.berkeley.edu/~stark/Preprints/bmd19.pdf
• Risk-Limiting Audits, Making Every Vote Count: A Practical Guide to Risk-Limiting Audits, Washington, DC, 31 January 2019. https://www.stat.berkeley.edu/~stark/Seminars/auditDC19.pdf Video: https://youtu.be/gMbz0_dizoA
• Classical Statistics in Modern Elections, Conference in Honor of Prof. Yoav Benjamini's 70th Birthday, Jerusalem, Israel, 17–20 December 2018. https://www.stat.berkeley.edu/~stark/Seminars/auditBenja18.htm
• Simulating a Ballot-Polling Risk-Limiting Audit with Cards and Dice, Multidisciplinary Conference on Election Auditing, MIT, Cambridge, MA, 7–8 December 2018. https://www.stat.berkeley.edu/~stark/Seminars/ballotPollingSimulation.pdf
• Risk-Limiting Audits and Evidence-Based Elections, Multidisciplinary Conference on Election Auditing, MIT, Cambridge, MA, 7–8 December 2018. https://www.stat.berkeley.edu/~stark/Seminars/auditMIT18.htm
• How to Tell if an Election Has Been Hacked, Nerd Nite, Oakland, CA, 26 November 2018. https://www.stat.berkeley.edu/~stark/Seminars/auditNerdNite18.htm
• Securing our Elections, Town Hall Meeting with Congressman Mark DeSaulnier and Secretary of State Alex Padilla, Walnut Creek, CA, 13 August 2018. https://desaulnier.house.gov/media-center/press-releases/congressman-desaulnier-announces-town-hall-securing-our-elections
• Audits and Evidence-Based Elections, 2nd Take Back the Vote Conference, Berkeley, CA, 7–8 October 2017. Video: https://www.youtube.com/watch?v=pPGTkgpijUU
• Sometimes a Paper Trail Isn't Worth the Paper It's Written On, Keynote lecture, Workshop on Advances in Secure Electronic Voting, Financial Crypto 2017, Malta, 3--7 April 2017. https://www.stat.berkeley.edu/~stark/Seminars/malta17.htm
• Risk-limiting Audits and Evidence-based Elections, Santa Clara County Citizens Advisory Committee on Elections, San Jose, CA, 7 March 2017. https://www.stat.berkeley.edu/~stark/Seminars/santaClara17.pdf
• Whose Votes (were) Counted in the Election of 2016?, ISF198, The 2016 U.S. Elections in Global Context: A Semester-Long Teach-In, University of California, Berkeley, 24 January 2017. https://www.stat.berkeley.edu/~stark/Seminars/teachIn17.pdf
• Risk-Limiting Audits and the Colorado Uniform Voting System Pilot, Colorado Pilot Election Review Committee Meeting, Office of the Colorado Secretary of State, Denver, CO, 9 October 2015. http://www.stat.berkeley.edu/~stark/Seminars/auditCO15.pdf
• Statistical Evidence and Election Integrity, XXIX International Forum on Statistics, UPAEP, Puebla, Mexico, 29 September–3 October 2014. http://www.stat.berkeley.edu/~stark/Seminars/foro14.pdf
• U.S. Election Assistance Commission roundtable: Expanding the Body of Knowledge of Election Administration–Reflections and Future Direction, 3 September 2014. http://www.eac.gov/eac_grants_expanding_the_body_of_knowledge_of_election_administration_\%E2\%80\%93_reflections_and_future_dire/ Video: http://mediasite.yorkcast.com/webcast/Play/a90f223fa61940cd893b70fab55fe1b51d
• Risk-Limiting Audits for Denmark and Mongolia, Third DemTech Workshop on Danish Elections, Trust, and Technology for the Mongolian General Election Commission, IT University of Copenhagen, Copenhagen, Denmark, 24 May 2014. http://www.stat.berkeley.edu/~stark/Seminars/itu14.pdf
• New Paradigms for Voting Systems, 2014 Election Verification Network Annual meeting, San Diego, CA, 5–7 March 2014. Slides: http://www.stat.berkeley.edu/~stark/Seminars/evn14NewParadigms.pdf
• Unpacking the Voting Technology Debate, 2014 Voting and Elections Annual Summit, Overseas Vote Foundation and U.S. Vote Foundation, George Washington University, Washington, D.C., 30 January 2014. https://www.overseasvotefoundation.org/initiatives-UOCAVAsummit-summit2014-agenda Video: http://www.youtube.com/watch?v=UXqqnOWhsmA\&list=PLtRB8fQ0zBR8Nza-G-RGln-HTrkp4UM6F\&feature=share\&index=1\#t=23m30s
• Risk-Limiting Audits for Party-List Elections, IT University of Copenhagen, Copenhagen, Denmark, 21 November 2013. Slides: www.stat.berkeley.edu/~stark/Seminars/itu13.pdf
• E2E to Hand-to-Eye: Verifiability, Trust, Audits, VoteID 2013: The 4th International Conference on e-Voting and Identity, University of Surrey, Guildford, UK, 17–19 July 2013. Slides: www.stat.berkeley.edu/~stark/Seminars/voteID13.pdf
• Leveraging Paper Ballots, Running Elections Efficiently, A Best Practices Convening, Common Cause – Common Cause / NY – Columbia University School of International and Public Affairs, Columbia University, New York, NY, 20 May 2013. Slides: www.stat.berkeley.edu/~stark/Seminars/ccNY13.pdf
• Brittle and Resilient Verifiable Voting Systems, Verifiable Voting Schemes Workshop: from Theory to Practice, Interdisciplinary Centre for Security, Reliability and Trust, University of Luxembourg, Luxembourg 21–22 March 2013. Slides: www.stat.berkeley.edu/~stark/Seminars/vv13.pdf
• Now what?, Election Verification Network Annual Conference, The Right to a Secure, Transparent and Accurate Election, Atlanta, Georgia 14–15 March 2013. Slides: www.stat.berkeley.edu/~stark/Seminars/evn13nowWhat.pdf
• Risk-limiting Audits and Evidence-Based Elections in a Nutshell, Election Verification Network Annual Conference, The Right to a Secure, Transparent and Accurate Election, Atlanta, Georgia 14–15 March 2013. Slides: www.stat.berkeley.edu/~stark/Seminars/evn13nutshell.pdf
• Evidence-Based Elections, E-Voting: Risk and Opportunity Conference, Center for Information Technology Policy, Princeton University, Princeton, NJ, 1 November 2012. Slides: www.stat.berkeley.edu/~stark/Seminars/princeton12.pdf Video: youtu.be/1Z6JW1t_sFI
• Evidence-Based Elections, Berkeley/Stanford Data, Society, and Inference Seminar, Stanford, CA, 8 October 2012. Slides: http://www.stat.berkeley.edu/~stark/Seminars/dataSocietyInference12.pdf
• BRAVO: Ballot-polling Risk-limiting Audits to Verify Outcomes, Workshop on Electronic Voting Technology / Workshop on Transparent Elections, (EVT/WOTE '12), USENIX, Bellevue, WA, 6–7 August 2012. Video: https://www.usenix.org/conference/evtwote12/s6-paper-title-tbd Slides: http://www.stat.berkeley.edu/~stark/Seminars/evt12.pdf
• The Will of the People and the Luck of the Draw: Using Statistics to Limit the Risk of Wrong Electoral Outcomes, Joint Statistical Meetings, San Diego, CA, 29 July 2012. http://www.stat.berkeley.edu/~stark/Seminars/jsm12.pdf
• Evidence-Based Elections, Risk-Limiting Audits, and Resilient Canvass Frameworks, SecVote 2012 Summer School on Secure Voting, Leibniz-Zentrum für Informatik, Schloss Dagstuhl, Germany, 16 July 2012. http://www.stat.berkeley.edu/~stark/Seminars/dagstuhl12.pdf
• Evidence-Based Elections, International Association of Clerks, Recorders, Election Officials & Treasurers (IACREOT) annual conference, Albuquerque, NM, 30 June 2012. http://www.stat.berkeley.edu/~stark/Seminars/iacreot12.pdf
• Evidence-Based Elections: Colorado's Future?, Colorado Elections Best Practices & Vision Commission, Denver, CO, 14 December 2011. (Audio)
• Fears, Predictions, Hopes & Plans, Panel on the Future, Election Integrity: Past, Present, and Future, Caltech/MIT Voting Technology Project, Cambridge, MA, 1 October 2011. (Video)
• SOBA: Secrecy-preserving Observable Ballot-level Audit, Workshop on Electronic Voting Technology / Workshop on Transparent Elections (EVT/WOTE'11), USENIX, San Francisco, CA, 9 August 2011.
• Risk Limiting Audits, Colorado Secretary of State, Colorado Risk Limiting Audit (CORLA) Kick-off Meeting, Denver, CO, 16 June 2011. https://www.stat.berkeley.edu/~stark/Seminars/co-11-6-16.pdf
• Close enough for government [to] work, Verified Voting Foundation, Palo Alto, CA, 27 April 2011.
• Close enough for government [to] work: Risk-limiting post-election audits, Berkeley/Stanford Joint Statistics Colloquium, Stanford University, Stanford, CA, 12 April 2011.
• Audits: The After-Math of Elections, Verify early, verify often: creating secure, transparent and accurate elections, Election Verification Network, Chicago, IL, 25–26 March 2011.
• Close enough for government work: Risk-Limiting Post-Election Audits, Wharton Statistics Department, University of Pennsylvania, 26 January 2011.
• Audits: The After-Math of Election Reform, Conference on Innovative Electoral Reforms and Strategies, Washington, DC, 10–11 December 2010.
• Testimony proffered to Judge Ira Warshawsky, New York Supreme Court, 4 December 2010.
• Risk-limiting post-election audits: statistics, policy and politics, Department of Statistics, Rice University, Houston, TX, 1 November 2010.
• Super-simple simultaneous single-ballot risk-limiting audits, 2010 Electronic Voting Technology Workshop/Workshop on Trustworthy Elections (EVT/WOTE '10), Washington, DC, 9–10 August 2010.
• Testimony to California State Senate Committee on Elections, Reapportionment and Constitutional Amendments, 15 June 2010.
• AB 2023 and Risk-Limiting Audits. California Association of Clerks and Election Officials Legislative Committee Meeting, 14 May 2010.
• Testimony before California Assembly Committee on Elections and Redistricting, 20 April 2010.
• Size Matters: Smaller Batches Yield More Efficient Risk-Limiting Audits. Small Batch Audit Meeting, Washington, DC, 27–28 March, 2010.
• Sexy Audits and the Single Ballot. Election Verification Network (EVN) annual conference, Washington, DC, 25–27 March, 2010.
• Simple, Affordable, Post-Election Audits. Institute for Mathematical Behavioral Sciences, University of California, Irvine, CA, 7 January 2010.
• Efficient Post-Election Audits of Multiple Contests: 2009 California Tests. Conference on Empirical Legal Studies, University of Southern California Gould School of Law, Los Angeles, CA, 20–21 November 2009.
• Risk-Limiting Audits, Audit Working Meeting, American Statistical Association, Alexandria, VA, 23–24 October 2009.
• Election Auditing: How Much is Enough? The Society for Political Methodology 26th Annual Summer Meeting, Institution for Social and Policy Studies, Yale University, 23 July 2009.
• Risk-Limiting Post-Election Audits. Department of Statistics, University of California, Berkeley, CA, 31 March 2009.
• 2008 Risk-limiting Audits in California. Pew Foundation Conference on Election Auditing, Salt Lake City, UT, 23–24 February 2009.
• Election Auditing and Nonparametric Confidence Bounds. Department of Mathematics, Reed College, Portland, OR, 20 November 2008.
• Risk-Limiting Post-Election Audits. Department of Statistics, Kansas State University, Manhattan, KS, 2 October 2008.
• CAST: Canvass Audits by Sampling and Testing. 2008 American Political Science Association Annual Meeting Panel 2008MP04292. Catch Me If You Can: Techniques to Detect Electoral Fraud. Boston, MA, 28–31 August 2008.
• Statistical Audits—Why and how much? 100th Anniversary Meeting of the California Association of Clerks and Election Officials, Long Beach, CA, 8–11 July 2008.
• Election Auditing: How Much is Enough? Mathematical Sciences Research Institute, Annual Meeting of Academic Sponsors and Steering Committee, Berkeley, CA, 7 March 2008.
• Statistical audits—why bother? 2007 Post Election Audit Summit, Minneapolis, MN, 25–27 October 2007.
• Urning Voter Confidence. Department of Mathematics, Reed College, 11 October 2007.

Software

• Interactive tools for ballot-level comparison risk-limiting audits
• Interactive tools for ballot-polling risk-limiting audits
• A simple random number generator using SHA-256
• https://github.com/pbstark/auditTools
• https://github.com/pbstark/SHANGRLA
• https://github.com/pbstark/DKDHondt14
• https://github.com/pbstark/CORLA18
• https://github.com/pbstark/MartInf
• https://github.com/pbstark/BernoulliBallotPolling

Other Documents

• Hursti, H., M. Lindeman, and P.B. Stark, 2021. New Hampshire SB 43 Forensic Audit Report https://www.doj.nh.gov/sb43/documents/20210713-sb43-forensic-audit-report.pdf
• Stark, P.B., 2019. Comments on Draft VVSG 2.0, https://www.stat.berkeley.edu/~stark/Preprints/vvsg19.pdf
• McCarthy, J., N. McBurnett, H. Branscomb, R. Rivest, and P.B. Stark, 2018. Colorado Risk-Limiting Tabulation Audit: Preserving Anonymity of Cast Vote Record https://www.sos.state.co.us/pubs/elections/VotingSystems/riskAuditFiles/2018/20180309PreservingAnonymityOfCVR.pdf
• Endorsement of Risk-Limiting Election Audits by the Board of the American Statistical Association and accompanying press release, April, 2010.
• Hall, J.L., P.B. Stark, H.E. Brady and J.S. Sekhon, 2009. Comments on the CA SoS' Precinct Level Data Pilot Project. November 2009.
• Data requirements for vote-tabulation audits: Statement to NIST, Audit Working Group, ElectionAudits.org, October 2009.
• Examples of challenged ballots in the 2008 Minnesota Senate recount, Minnesota Public Radio, November 2008.
• Principles and Best Practices for Post-Election Audits, ElectionAudits.org (endorsed by the American Statistical Association), September 2008.

Last modified 23 November 2024. P.B. Stark. www.stat.berkeley.edu/~stark/Vote/index.htm