Chief Technologist and Director of the AI Governance Lab @CenDemTech / responsible AI + policy
Washington, DC
Joined October 2008
- Tweets2.5K
- Following1.3K
- Followers2.4K
- Likes1.6K
Miranda Bogen retweeted
fundamentally the same issues that firms selling AI audits in the late 2010s/early 2020s encountered.
perhaps the FAccT/AIES/etc. literature offers helpful lessons from the past so as to not fumble into the same mistakes!
Anthropic and OpenAI have sought significant control over what outside evaluators can publish, concerned that findings could reveal trade secrets, according to two people familiar with the discussions. reuters.com/world/behind-ai-…
Miranda Bogen retweeted
🚀We launch Evaluation Cards (beta): a centralized public record of AI evaluation results 🚀
Not another leaderboard. Every score comes with who ran it, the settings they used, what the benchmark tests and the other results reported for the same model, side by side. 🧵👇
Miranda Bogen retweeted
Celebrating Thirty Years of the Internet Archive with the ‘Class of 1996’
🎓
Class President: Center for Democracy and Technology
They didn’t just show up—they helped write the rules of the internet. And 30 years later, they’re still fighting to keep it open.
See more of the Class of ’96 ➡️ blog.archive.org/2026/05/07/…
Go Wayback to 1996 👉 web.archive.org/web/19961022…
#classof96
ALT Yearbook-style page labeled “Class President” featuring a retro screenshot of the Center for Democracy and Technology website, decorated with a graduation cap, and doodles; caption notes the nonprofit’s role in advancing civil liberties, free expression, and privacy online.
Miranda Bogen retweeted
Today @CenDemTech released a report on the risks of AI to people with eating disorders. As AI systems become more prevalent, their mental-health impacts can't be ignored. To build safeguards, we must develop risk assessments that reflect how AI impacts people in the real world.
Miranda Bogen retweeted
I'm so excited to highlight a new report from @CenDemTech: "Opening the Book: A Rubric to Support Effective Transparency for EdTech Products That Incorporate AI." My colleagues introduce a rubric for assessing how transparently edtech vendors communicate about their AI products.
Miranda Bogen retweeted
AI companies are starting to build more and more personalization into their products, but there's a huge personalization-sized hole in conversations about AI safety/trust/impacts.
Delighted to feature @mbogen on Rising Tide today, on what's being built and why we should care:
Miranda Bogen retweeted
If we want to understand and shape how advanced AI behaves, we need to know the rules it’s supposed to follow. This requires a type of transparency that’s different from what most policymakers focus on today. @aawinecoff, @mbogen, and I explain in a new report for @CenDemTech:
Miranda Bogen retweeted
This last sentence seems false?
The system card does not appear to have been updated even to incorporate the information in this thread.
The whole point of the term system card is that the model isn’t the only thing that matters.
OpenAI o3-pro is available in the model picker for Pro and Team users starting today, replacing OpenAI o1-pro.
Enterprise and Edu users will get access the week after.
As o3-pro uses the same underlying model as o3, full safety details can be found in the o3 system card.
help.openai.com/en/articles/…
Miranda Bogen retweeted
NEW REPORT: CDT AI Governance Lab’s’s Assessing AI reportAudits looks at the rise of complex automated systems which demand a robust ecosystem for managing risks and ensuring accountability. cdt.org/insights/assessing-a… cc: @MBogen
ALT Graphic for CDT AI Gov Lab's report, "Assessing AI: Surveying the Spectrum of Approaches to Understanding and Auditing AI Systems." Illustration of a collection of AI "tools" and "toolbox" – a hammer and red toolbox – and a stack of checklists with a pencil.
Miranda Bogen retweeted
Machine unlearning is taking off! There is a ton of interest in getting generative AI models to “unlearn” targeted undesirable information, often to meet policy aims in privacy, copyright, safety, etc.
Our new cross-disciplinary collaboration shows why this isn’t simple.
Miranda Bogen retweeted
Companies often attribute their focus on English AI to the lack of resources in non-English langs. New brief written by @Evani_RD and @mbogen highlights the incredible work researchers are doing on multilingual AI if only companies wanted to work with them cdt.org/insights/beyond-engl…
Miranda Bogen retweeted
I’m honoured to be one of the @FAccTConference Programme Chairs this year, alongside the amazing @jennwvaughan @sinafazelpour @TaliaGillis 🤩 and we’ve been hard at work already. The CFP is coming soon, but the key dates everyone are now set. Happy paper planning 🚀
Miranda Bogen retweeted
Call for Tiny Papers!
Community Research!
Studying Social/Broader Impact!
Making Evaluations Better!
Submit your 2 pager by Sept 20 on eval perspectives, challenges, validity
And come to our #NeurIPS2024 workshop to work together on this part of safety
evaleval.github.io/call-for-…
Announcing NeurIPS Workshop: EvalEval 2024!
🚀 As generative AI rapidly transforms our world, a critical question looms: How do we measure and evaluate its broader societal impacts?
📄 Our recent collaborative paper (arxiv.org/pdf/2306.05949) reveals a lack of standardized methods to assess the full range of effects of generative AI on society, culture, and individual lives.
🔍 To bridge this gap, we're excited to announce our NeurIPS 2024 workshop: "Evaluating Evaluations: Examining Best Practices for Measuring Broader Impacts of Generative AI" aka EvalEval 2024!
🌐 Our workshop website is live! Visit evaleval.github.io/ to learn more and check out the call for tiny papers!
Key focus areas include:
• Conceptualization and operationalization of AI impact evaluations
• Ethical considerations in assessment methodologies
• Novel approaches for measuring social impact across different AI modalities
🌟 We're thrilled to have secured commitments from several stellar speakers in the field. Stay tuned for the full speaker list announcement coming soon!
This workshop aims to unite experts in evaluation science, AI practitioners, policymakers, and stakeholders. By fostering collaboration, we hope to develop comprehensive evaluation frameworks and policy recommendations for responsible AI development.
Are you passionate about ensuring AI benefits society? Join us in shaping the future of AI evaluation! Follow our page for updates and reach out with any questions or ideas.
See you at NeurIPS!
#EvalEval2024 #NeurIPS2024 #AIEthics #GenerativeAI #ResponsibleAI #AIPolicy
Miranda Bogen retweeted
so proud to release this report with @CenDemTech
alongside coauthors @BonnieSwenorPhD & @mbogen, in advance of the #ADA anniversary. minimizing the risks of #AlgorithmicBias for #disabled people starts with creating more equitable datasets -- here's how:
cdt.org/wp-content/uploads/2…
ALT Illustration of a sphere comprised of white lines and red dots that represents a connected set of data, with spotlights showing different aspects of disability data. There are five spotlights, including a person in a motorized wheelchair using a computer, an ear representing individuals who are deaf or hard of hearing, six dots representing Braille, a person with a limb difference using a pair of crutches, and a brain. In white text on a dark blue background, the title of the report says “To Reduce Disability Bias in Technology, Start with Disability Data.”
Miranda Bogen retweeted
court holds that Workday can be held liable under federal antidiscrimination law as an agent of employers, opening up liability for other vendors of AI-powered hiring tools to face liability for employment discrimination claims. storage.courtlistener.com/re…
Miranda Bogen retweeted
NEW REPORT: “To Reduce Disability Bias in Technology, Start With Disability Data” unpacks the factors that result in poor collection + availability of representative data sets, & provides recs for how to use a “disability data justice” approach. cdt.org/insights/report-to-r…
ALT Illustration of a sphere comprised of white lines and red dots that represents a connected set of data, with spotlights showing different aspects of disability data. There are five spotlights, including a person in a motorized wheelchair using a computer, an ear representing individuals who are deaf or hard of hearing, six dots representing Braille, a person with a limb difference using a pair of crutches, and a brain. In white text on a dark blue background, the title of the report says “To Reduce Disability Bias in Technology, Start with Disability Data.”
Miranda Bogen retweeted
Join @CenDemTech’s @MBogen on July 31st alongside @ChiraagBains, @DBrody_, & @SpencerOverton for an insightful panel on "what you need to know about #AI," moderated by @JonMGreenbaum, Founder of Justice Legal Strategies. RSVP Today: cdt.org/event/what-you-need-…
Miranda Bogen retweeted
TODAY: @CenDemTech’s #AI Governance Lab Director @MBogen spoke before the @PCLOB_Gov on the challenges that come with the use of #ArtificialIntelligence (AI) in counterterrorism and other national security programs. cdt.org/insights/cdts-mirand…
Miranda Bogen retweeted
📢 Timely tech policy job opportunity: work with Princeton SPIA-DC and faculty at Princeton CITP and across the university (including me) to develop programming that helps bridge AI expertise with policy making.
Pay: $105-115,000
Details and application: spia.princeton.edu/sites/def…
JOIN US! @PrincetonSPIA & the Center for Information Technology Policy @PrincetonCITP are hiring an AI Project Liaison to spearhead our new AI programming & engagement here at SPIA in Washington DC...THE PRINCETON AI DIALOGUES---> Details and Apply HERE: bit.ly/3VNVAzz
Miranda Bogen retweeted
Looking forward to a great conversation -- @theNASEM is hosting a public panel on "AI Risk Management: Evaluation, Testing, and Oversight" with @RishiBommasani @hannawallach @mbogen and myself, moderated by @wsisaac - register and come along on 20th June! nationalacademies.org/event/…
