DOE’s Irma Vetting Reviews Privacy and Security Only — Not AI Bias or Instructional Effectiveness, Council Told

The New York City Council Committee on Education and Technology held an oversight hearing on June 24, 2026, examining the Department of Education’s (DOE) enterprise vetting process — the enterprise request management application (Irma) — and found Irma currently approves edtech and AI tools based on data privacy and security but does not yet require reviews for algorithmic bias, equity impact, or instructional effectiveness. Source: https://youtu.be/VfIjWNkh0wk

# What’s happening
– DOE says Irma currently reviews tools for data privacy and security only. Source: https://youtu.be/VfIjWNkh0wk
– DOE says it is building capacity to review algorithmic bias, equity impact, and instructional effectiveness. Source: https://youtu.be/VfIjWNkh0wk
– DOE guidance requires Irma approval before AI tools use student or staff data. Source: https://youtu.be/VfIjWNkh0wk

# Why it matters
– Students, teachers, and families use DOE-approved digital tools in classrooms and schools. Source: https://youtu.be/VfIjWNkh0wk
– Without bias or effectiveness reviews, tools may be deployed without verified instructional benefits or equity assessments. Source: https://youtu.be/VfIjWNkh0wk

# Key details
– Hearing date: June 24, 2026; location: Council Chambers, City Hall. Source: https://youtu.be/VfIjWNkh0wk
– The enterprise request management application (Irma) is DOE’s privacy and security review process. Source: https://youtu.be/VfIjWNkh0wk
– DOE guidance states AI tools cannot be used with student or staff data unless they pass Irma. Source: https://youtu.be/VfIjWNkh0wk
– DOE officials testified Irma does not yet evaluate algorithmic bias, equity impact, or instructional effectiveness. Source: https://youtu.be/VfIjWNkh0wk
– DOE said it is developing a tool scorecard and conducting beta testing with about 50 teachers and school leaders. Source: https://youtu.be/VfIjWNkh0wk
– DOE described a teacher fellowship exploring bias and equity in tools conducted over the past year. Source: https://youtu.be/VfIjWNkh0wk

The Committee on Education and Technology convened on June 24, 2026, to question DOE officials about how digital learning tools and artificial intelligence are vetted for use in New York City public schools. Source: https://youtu.be/VfIjWNkh0wk

**Irma (enterprise request management application)**
– Role or jurisdiction: DOE’s enterprise vetting system for digital tools.
– Action taken or responsibility: Reviews tools for data privacy and security before district use.
– Relevant note: Guidance states AI tools cannot be used with student or staff data unless Irma-approved. Source: https://youtu.be/VfIjWNkh0wk

**New York City Department of Education (DOE)**
– Role or jurisdiction: New York City public school system.
– Action taken or responsibility: Operates Irma and is developing additional review capacity for bias, equity, and effectiveness.
– Relevant numbers/dates: Beta testing involves about 50 teachers and school leaders; equity fellowship ran over the past year. Source: https://youtu.be/VfIjWNkh0wk

Council members asked whether Irma evaluates algorithmic bias, equity impacts, or instructional effectiveness. DOE witnesses answered that Irma currently evaluates data privacy and security only. Source: https://youtu.be/VfIjWNkh0wk

DOE officials said the department is “actively building the capacity” to review algorithmic bias, equity impact, and instructional effectiveness, but they did not provide a firm timeline for when that capacity will be agency-wide. Source: https://youtu.be/VfIjWNkh0wk

DOE staff described a multi-step tool-approval flow. The first step requires a principal, superintendent, or central leader to demonstrate a tool’s educational value and impact before approval consideration. Source: https://youtu.be/VfIjWNkh0wk

DOE said legal and compliance reviews focus on legal terms, privacy protections, security measures, and transparency. DOE witnesses testified the legal team does not currently evaluate algorithmic bias, and a notation on the public guidance site that suggests legal reviews bias may be a website misprint. Source: https://youtu.be/VfIjWNkh0wk

DOE described work in progress to add richer evaluations: officials said they are developing a tool scorecard for educational value and outcomes, running beta tests with roughly 50 teachers and leaders, and running a teacher fellowship on ethics and equity to explore bias impacts. Source: https://youtu.be/VfIjWNkh0wk

Committee members, witnesses, and public commenters raised concerns that the public cannot verify which vendors have undergone Irma approval, and asked why some vendor data‑privacy agreements and vendor names are not publicly available. Testimony noted community concerns about third‑party data sharing and vendor dependence. Source: https://youtu.be/VfIjWNkh0wk

DOE witnesses said evaluating algorithmic bias across the full scale and variety of tools used in New York City schools is a development task requiring partnership with city technical offices and external vendors; they said they are consulting with the Department of Information Technology and Telecommunications (DIT/OTI) and enterprise partners. Source: https://youtu.be/VfIjWNkh0wk

Council members pressed DOE for clearer requirements, including whether tools must use curated datasets or provide vendor disclosures. DOE acknowledged there is no current requirement that all tools use curated datasets or that vendors must disclose certain materials, but officials said they are exploring options. Source: https://youtu.be/VfIjWNkh0wk

Public witnesses urged stronger pre-procurement standards. Testimony recommended independent efficacy and equity testing before classroom use, keeping sensitive student data within district control, and making vendor data and approvals publicly verifiable. Source: https://youtu.be/VfIjWNkh0wk

Key operational changes DOE described as in development include the tool scorecard, expanded professional learning pilots, and equity-and-ethics fellowship findings to inform future Irma criteria. DOE did not announce firm dates for when bias, equity, and effectiveness reviews will be required across all approved tools. Source: https://youtu.be/VfIjWNkh0wk

Source: https://youtu.be/VfIjWNkh0wk