Who Evaluates AI’s Social Impacts? Mapping Coverage and Gaps in First and Third Party Evaluations
Published in International Conference on Machine Learning (ICML), 2026
Recommended citation:
Download Paper
Publications
You can also find my articles on my Google Scholar profile.
Conference and journal papers, workshop contributions and preprints are listed separately. The 2025 STAIG and 2026 MURE entries are different versions of one arXiv record.
Journal and Conference Papers
When AI Benchmarks Plateau: A Systematic Study of Benchmark Saturation
Published in International Conference on Machine Learning (ICML), 2026
Recommended citation:
Download Paper
Challenges to Grassroots Organization Engagement with AI Policy
Published in ACM Conference on Fairness, Accountability, and Transparency (FAccT), 2026
Recommended citation:
Download Paper
“Taking Stock at FAccT”: Using Participatory Design to Co-Create a Vision for the Fairness, Accountability and Transparency Community
Published in ACM Conference on Fairness, Accountability, and Transparency (FAccT), 2026
Recommended citation:
Download Paper
Workshop Papers
Bayesian Inference and Decision Audits for Public Archives of Frontier AI Evaluations
Published in ICML 2026 Workshops CTB and HT, 2026
Recommended citation:
Download Paper
Participatory Governance for AGI Societal Impact: A Case Study of AI Ethics Community Reflexivity
Published in ICLR 2026 Workshop P-AGI, 2026
Recommended citation:
Download Paper
Embracing Ambiguity: Bayesian Nonparametrics and Stakeholder Participation for Ambiguity-Aware Safety Evaluation
Published in AAAI 2026 Workshop MURE, 2026
Recommended citation:
Download Paper
Position: Bayesian Statistics Facilitates Stakeholder Participation in Evaluation of Generative AI
Published in ACM CHI Workshop Sociotechnical AI Governance, 2025
Recommended citation:
Download Paper
Preprints
Every Eval Ever: A Unifying Schema and Community Repository for AI Evaluation Results
Preprint, 2026
A shared schema and community repository for AI evaluation results, with converters for heterogeneous reporting formats. Co-authored with Jan Batzner and collaborators.
Recommended citation:
Download Paper
Evaluation Cards: An Interpretive Layer for AI Evaluation Reporting
Preprint, 2026
Recommended citation:
Download Paper
Queer NLP: A Critical Survey on Literature Gaps, Biases and Trends
Preprint, 2026
Recommended citation:
Download Paper