Papers, Talks, Video, Legislation, Software, and Other Documents on Voting and Election Auditing
Papers
- Lindeman, M., R.L. Rivest, and P.B. Stark, 2013. Retabulations, Machine-Assisted Audits, and Election Verification, http://www.stat.berkeley.edu/~stark/Preprints/retabulation13.htm.
- Lindeman, M., R.L. Rivest, and P.B. Stark, 2013. Machine Retabulation is not Auditing, www.stat.berkeley.edu/~stark/Preprints/retabNotAudit13.pdf.
- Benaloh, J., M. Byrne, P. Kortum, N. McBurnett, O. Pereira, P.B. Stark, and D.S. Wallach, 2012. STAR-Vote: A Secure, Transparent, Auditable, and Reliable Voting System. http://arxiv.org/abs/1211.1904.
- Stark, P.B., 2012. Ballot-Polling Audits in Two Pages (±1) http://statistics.berkeley.edu/~stark/Preprints/bpa2pp.pdf
- Bretschneider, J., S. Flaherty, S. Goodman, M. Halvorson, R. Johnston, M. Lindeman, R.L. Rivest, P. Smith, and P.B. Stark, 2012. Risk-Limiting Post-Election Audits: Why and How. http://statistics.berkeley.edu/~stark/Preprints/RLAwhitepaper12.pdf (Endorsed by the American Statistical Association: http://www.amstat.org/policy/pdfs/StarkEtAlLetterOfSupport.pdf)
- Stark, P.B., and D.A. Wagner, 2012. Evidence-Based Elections. IEEE Computing Now, 10, 33–41. http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=6203498 (preprint: http://statistics.berkeley.edu/~stark/Preprints/evidenceVote12.pdf)
- Lindeman, M. and P.B. Stark, 2012. A Gentle Introduction to Risk-Limiting Audits. IEEE Computing Now, 10, 42–49. http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=6175884&tag=1 (preprint: http://statistics.berkeley.edu/~stark/Preprints/gentle12.pdf)
- Lindeman, M., P.B. Stark, and V.S. Yates, 2012. BRAVO: Ballot-polling Risk-Limiting Audits to Verify Outcomes. 2012 Electronic Voting Technology Workshop/Workshop on Trustworthy Elections (EVT/WOTE '12). (reprint: https://www.usenix.org/system/files/conference/evtwote12/evtwote12-final27.pdf)
- Higgins, M.J., R.L. Rivest, and P.B. Stark, 2011. Sharper p-values for Stratified Post-Election Audits. Statistics, Politics, and Policy. (reprint: http://www.bepress.com/spp/vol2/iss1/7/)
- McLaughlin, K. and P.B. Stark, 2011. Workload Estimates for Risk-Limiting Audits of Large Contests.
- Benaloh, J., D. Jones, E. Lazarus, M. Lindeman, and P.B. Stark, 2011. SOBA: Secrecy-preserving Observable Ballot-level Audit. (reprint: http://static.usenix.org/events/evtwote11/tech/final_files/Benaloh.pdf). 2011 Electronic Voting Technology Workshop/Workshop on Trustworthy Elections (EVT/WOTE '11). Video.
- Stark, P.B., 2010. Risk-Limiting Vote-Tabulation Audits: The Importance of Cluster Size, Chance, 23(3), 9–12. http://statistics.berkeley.edu/~stark/Preprints/auditingChance10.pdf
- Stark, P.B., 2010. Super-simple simultaneous single-ballot risk-limiting audits. 2010 Electronic Voting Technology Workshop/Workshop on Trustworthy Elections (EVT/WOTE '10). http://www.usenix.org/events/evtwote10/tech/full_papers/Stark.pdf
- Stark, P.B., 2010. Why small audit batches are more efficient: two heuristic explanations. http://statistics.berkeley.edu/~stark/Preprints/smallBatchHeuristics10.htm
- Stark, P.B., 2009. The status and near future of post-election auditing.
- Stark, P.B., 2009. Efficient post-election audits of multiple contests: 2009 California tests. Refereed paper presented at the 2009 Conference on Empirical Legal Studies. (preprint: http://ssrn.com/abstract=1443314)
- Hall, J.L., L.W. Miratrix, P.B. Stark, M. Briones, E. Ginnold, F. Oakley, M. Peaden, G. Pellerin, T. Stanionis and T. Webber, 2009. Implementing Risk-Limiting Audits in California, USENIX EVT/WOTE. (preprint: http://arxiv.org/abs/0905.4691)
- Stark, P.B., 2009. Auditing a collection of races simultaneously. http://arxiv.org/abs/0905.1422v1
- Ash, A., S. Pierson and P.B. Stark, 2009. Thinking outside the urn: Statisticians make their marks on U.S. Ballots. Amstat News, 384. 37–40. (reprint: http://www.amstat.org/outreach/pdfs/SP_ANJun09.pdf)
- Miratrix, L.W. and P.B. Stark, 2009. Election Audits using a Trinomial Bound. IEEE Transactions on Information Forensics and Security, 4, 974–981. (preprint: http://statistics.berkeley.edu/~stark/Preprints/trinomial09.pdf)
- Stark, P.B., 2009. Risk-limiting post-election audits: P-values from common probability inequalities. IEEE Transactions on Information Forensics and Security, 4, 1005–1014. (preprint: http://statistics.berkeley.edu/~stark/Preprints/pvalues09.pdf)
- Stark, P.B., 2009. CAST: Canvass Audits by Sampling and Testing. IEEE Transactions on Information Forensics and Security: Special Issue on Electronic Voting, 4, 708–717. (preprint: http://statistics.berkeley.edu/~stark/Preprints/cast09.pdf)
- Stark, P.B., 2008. A Sharper Discrepancy Measure for Post-Election Audits. The Annals of Applied Statistics, 2, 982–985. http://arxiv.org/abs/0811.1697
- Stark, P.B., 2008. Conservative Statistical Post Election Audits. The Annals of Applied Statistics, 2, 550–581. http://arxiv.org/abs/0807.4005
- Stark, P.B., 2008. Election audits by sampling with probability proportional to an error bound: dealing with discrepancies. Working draft.
- Jefferson, D., K. Alexander, E. Ginnold, A. Lehmkuhl, K. Midstokke & P.B. Stark, 2007. Post Election Audit Standards Report—Evaluation of Audit Sampling Models and Options for Strengthening California's Manual Count.
Talks and Testimony
- Leveraging Paper Ballots, Running Elections Efficiently, A Best Practices Convening, Common Cause – Common Cause / NY – Columbia University School of International and Public Affairs, Columbia University, New York, NY, 20 May 2013. Slides: statistics.berkeley.edu/~stark/Seminars/ccNY13.pdf
- Brittle and Resilient Verifiable Voting Systems, Verifiable Voting Schemes Workshop: from Theory to Practice, Interdisciplinary Centre for Security, Reliability and Trust, University of Luxembourg, Luxembourg 21–22 March 2013. Slides: statistics.berkeley.edu/~stark/Seminars/vv13.pdf
- Now what?, Election Verification Network Annual Conference, The Right to a Secure, Transparent and Accurate Election, Atlanta, Georgia 14–15 March 2013. Slides: statistics.berkeley.edu/~stark/Seminars/evn13nowWhat.pdf
- Risk-limiting Audits and Evidence-Based Elections in a Nutshell, Election Verification Network Annual Conference, The Right to a Secure, Transparent and Accurate Election, Atlanta, Georgia 14–15 March 2013. Slides: statistics.berkeley.edu/~stark/Seminars/evn13nutshell.pdf
- Evidence-Based Elections, E-Voting: Risk and Opportunity Conference, Center for Information Technology Policy, Princeton University, Princeton, NJ, 1 November 2012. Slides: statistics.berkeley.edu/~stark/Seminars/princeton12.pdf Video: youtu.be/1Z6JW1t_sFI
- Evidence-Based Elections Berkeley/Stanford Data, Society, and Inference Seminar, Stanford, CA, 8 October 2012. Slides: http://statistics.berkeley.edu/~stark/Seminars/dataSocietyInference12.pdf
- BRAVO: Ballot-polling Risk-limiting Audits to Verify Outcomes, Workshop on Electronic Voting Technology / Workshop on Transparent Elections, (EVT/WOTE '12), USENIX, Bellevue, WA, 6–7 August 2012. Video: https://www.usenix.org/conference/evtwote12/s6-paper-title-tbd Slides: http://statistics.berkeley.edu/~stark/Seminars/evt12.pdf
- The Will of the People and the Luck of the Draw: Using Statistics to Limit the Risk of Wrong Electoral Outcomes, Joint Statistical Meetings, San Diego, CA, 29 July 2012. http://statistics.berkeley.edu/~stark/Seminars/jsm12.pdf
- Evidence-Based Elections, Risk-Limiting Audits, and Resilient Canvass Frameworks, SecVote 2012 Summer School on Secure Voting, Leibniz-Zentrum für Informatik, Schloss Dagstuhl, Germany, 16 July 2012. http://statistics.berkeley.edu/~stark/Seminars/dagstuhl12.pdf
- Evidence-Based Elections, International Association of Clerks, Recorders, Election Officials & Treasurers (IACREOT) annual conference, Albuquerque, NM, 30 June 2012. http://statistics.berkeley.edu/~stark/Seminars/iacreot12.pdf
- Get out the Audit (GOTA): Risk-limiting ballot-polling audits are practical now!, Election Verification Network Annual Conference, Santa Fe, NM, 29–30 March 2012.
- The Long View: Evidence-Based Elections, Election Verification Network Annual Conference, Santa Fe, NM, 29–30 March 2012.
- The Will of the People and the Luck of the Draw: Risk-Limiting Audits and Resilient Canvass Frameworks, Meeting of the San Francisco Chapter of the American Statistical Association, Berkeley, CA, 16 February 2012.
- Evidence-Based Elections: Colorado's Future?, Colorado Elections Best Practices & Vision Commission, Denver, CO, 14 December 2011. (Audio)
- Fears, Predictions, Hopes & Plans, Panel on the Future, Election Integrity: Past, Present, and Future, Caltech/MIT Voting Technology Project, Cambridge, MA, 1 October 2011. (Video)
- Risk-limiting Audits: Soup to Nuts, and Beyond, Workshop on Electronic Voting Technology / Workshop on Transparent Elections (EVT/WOTE'11), USENIX, San Francisco, CA, 9 August 2011.
- SOBA: Secrecy-preserving Observable Ballot-level Audit, Workshop on Electronic Voting Technology / Workshop on Transparent Elections (EVT/WOTE'11), USENIX, San Francisco, CA, 9 August 2011.
- Risk Limiting Audits, Colorado Secretary of State, Colorado Risk Limiting Audit (CORLA) Kick-off Meeting, Denver, CO, 16 June 2011.
- Close enough for government [to] work, Verified Voting Foundation, Palo Alto, CA, 27 April 2011.
- Close enough for government [to] work: Risk-limiting post-election audits, Berkeley/Stanford Joint Statistics Colloquium, Stanford University, Stanford, CA, 12 April 2011.
- Audits: The After-Math of Elections, Verify early, verify often: creating secure, transparent and accurate elections, Election Verification Network, Chicago, IL, 25–26 March 2011.
- Close enough for government work: Risk-Limiting Post-Election Audits, Wharton Statistics Department, University of Pennsylvania, 26 January 2011.
- Audits: The After-Math of Election Reform, Conference on Innovative Electoral Reforms and Strategies, Washington, DC, 10–11 December 2010.
- Testimony proffered to Judge Ira Warshawsky, New York Supreme Court, 4 December 2010.
- Risk-limiting post-election audits: statistics, policy and politics, Department of Statistics, Rice University, Houston, TX, 1 November 2010.
- Super-simple simultaneous single-ballot risk-limiting audits, 2010 Electronic Voting Technology Workshop/Workshop on Trustworthy Elections (EVT/WOTE '10), Washington, DC, 9–10 August 2010.
- Testimony to California State Senate Committee on Elections, Reapportionment and Constitutional Amendments, 15 June 2010.
- AB 2023 and Risk-Limiting Audits. California Association of Clerks and Election Officials Legislative Committee Meeting, 14 May 2010.
- Testimony before California Assembly Committee on Elections and Redistricting, 20 April 2010.
- Size Matters: Smaller Batches Yield More Efficient Risk-Limiting Audits. Small Batch Audit Meeting, Washington, DC, 27–28 March, 2010.
- Sexy Audits and the Single Ballot. Election Verification Network (EVN) annual conference, Washington, DC, 25–27 March, 2010.
- Simple, Affordable, Post-Election Audits. Institute for Mathematical Behavioral Sciences, University of California, Irvine, CA, 7 January 2010.
- Efficient Post-Election Audits of Multiple Contests: 2009 California Tests. Conference on Empirical Legal Studies, University of Southern California Gould School of Law, Los Angeles, CA, 20–21 November 2009.
- Risk-Limiting Audits, Audit Working Meeting, American Statistical Association, Alexandria, VA, 23–24 October 2009.
- Election Auditing: How Much is Enough? The Society for Political Methodology 26th Annual Summer Meeting, Institution for Social and Policy Studies, Yale University, 23 July 2009.
- Risk-Limiting Post-Election Audits. Department of Statistics, University of California, Berkeley, CA, 31 March 2009.
- 2008 Risk-limiting Audits in California. Pew Foundation Conference on Election Auditing, Salt Lake City, UT, 23–24 February 2009.
- Election Auditing and Nonparametric Confidence Bounds. Department of Mathematics, Reed College, Portland, OR, 20 November 2008.
- Risk-Limiting Post-Election Audits. Department of Statistics, Kansas State University, Manhattan, KS, 2 October 2008.
- CAST: Canvass Audits by Sampling and Testing. 2008 American Political Science Association Annual Meeting Panel 2008MP04292. Catch Me If You Can: Techniques to Detect Electoral Fraud. Boston, MA, 28–31 August 2008.
- Statistical Audits—Why and how much? 100th Anniversary Meeting of the California Association of Clerks and Election Officials, Long Beach, CA, 8–11 July 2008.
- Election Auditing: How Much is Enough? Mathematical Sciences Research Institute, Annual Meeting of Academic Sponsors and Steering Committee, Berkeley, CA, 7 March 2008.
- Statistical audits—why bother? 2007 Post Election Audit Summit, Minneapolis, MN, 25–27 October 2007.
- Urning Voter Confidence. Department of Mathematics, Reed College, 11 October 2007.
Video
- Barbara Simons interviewed by Charlie Rose, 4 October 2012.
- J. Alex Halderman on SlashDot about why Internet voting is a bad idea, 10 March 2010.
- Elections procedures in Washington County, Beaverton, OR, 4 November 2008.
- erratic behavior of a WINVote touchscreen electronic voting machine, 4 November 2008.
- Lou Dobbs CNN report on hacking electronic voting machines in New Jersey, 20 October 2008.
- Bill Moyers interviews Mark Crispin Miller, 17 October 2008.
- People & Power–Protecting Democracy, Part I, Part II, 14 October 2008.
- California Secretary of State Debra Bowen's address to the 2007 Post-Election Audit Summit, Minneapolis, MN, 27 October 2007.
- Arlene Ash at the 2007 Post-Election Audit Summit, Minneapolis, MN, 27 October 2007.
- Joseph Lorenzo Hall at the 2007 Post-Election Audit Summit, Minneapolis, MN, 27 October 2007.
- Mark Lindeman at the 2007 Post-Election Audit Summit, Minneapolis, MN, 27 October 2007.
- Philip B. Stark at the 2007 Post-Election Audit Summit, Minneapolis, MN, 27 October 2007.
- A.J. Feldman, J.A. Halderman and E.W. Felten, Security analysis of the Diebold AccuVote-TS Electronic Voting Machine, 2006.
Legislation
- Amendment to California AB 2023 requiring pilot of risk-limiting audits, published 26 March 2010.
- Proposed emergency regulations, California Post-Election Manual Tally, 8 October 2008.
- 2007 New Jersey law requiring audits of a random sample of precincts
Software
Other Documents
- Endorsement of Risk-Limiting Election Audits by the Board of the American Statistical Association and accompanying press release, April, 2010.
- Hall, J.L., P.B. Stark, H.E. Brady and J.S. Sekhon, 2009. Comments on the CA SoS' Precinct Level Data Pilot Project. November 2009.
- Data requirements for vote-tabulation audits: Statement to NIST, Audit Working Group, ElectionAudits.org, October 2009.
- Examples of challenged ballots in the 2008 Minnesota Senate recount, Minnesota Public Radio, November 2008.
- Principles and Best Practices for Post-Election Audits, ElectionAudits.org (endorsed by the American Statistical Association), September 2008.
Last modified 20 May 2013. P.B. Stark. statistics.berkeley.edu/~stark/Vote/index.htm