Ķvlog

Ed-Tech Policy

Need Guidance on How to Avoid AI Pitfalls? New Resources Aim to Help Schools

By Arianna Prothero — November 25, 2024 4 min read
Photo illustration of teacher using AI for grading.
  • Save to favorites
  • Print
Email Copy URL

The U.S. Department of Education has released new resources for schools on artificial intelligence that include recommendations on a range of potentially thorny issues, including the use of AI detection tools that may falsely accuse students of plagiarism and how to build Ķvlog’ AI literacy skills.

The two reports come at a time when Ķvlog are still puzzling through how to approach this powerful and fast-advancing technology. Many teachers are hesitant of using AI in the classroom, surveys show. Meanwhile, students are increasingly using AI tools. A recent found that half of teens have used an AI text generator, 34 percent have used an image generator, and 22 percent have used a video generator.

Taken together, the department resources detail both potential pitfalls that could stem from AI and the opportunities that it has for K-12 education.

Even though many states are crafting AI guidance for schools, federal guidance on AI is still needed, said Pat Yongpradit, the chief academic officer at Code.org and a leader of .

“We really need to move beyond AI is bad [or] AI is good, and get super nuanced about the proper and improper uses of AI in education,” he said.

These resources, he said, give schools a good starting point to have those conversations.

The Education Department’s office for civil rights report, which was released last week, focuses on and details several scenarios where schools’ use of, or response to, AI could trigger an OCR investigation.
Among the examples:

  • A teacher uses an AI detection tool to determine if students used a generative AI program like ChatGPT to write an assignment. Unbeknownst to the teacher, the tool has a much higher false-positive rate with students who are learning English, meaning English learners are falsely flagged and accused of cheating while their native English-speaking peers are not. (Some research has found that this happens.)
  • School administrators don’t respond aggressively enough after being tipped off that a student is creating “deepfake” nude images of their female classmates.
  • A school uses an AI tool to create the schedule for sports practices and games, and female teams are assigned worse times and days to play. The school does not respond to the student-athletes’ complaints.
  • A school district purchases facial-recognition technology that misidentifies Black students and incorrectly flags them as known criminals from a database.

Those are a sampling of the potential issues OCR has identified that might arise from schools overrelying on AI and not keeping real people in the decisionmaking loop. But they’re not purely hypothetical: Schools are already dealing with some of these issues, such as students making sexually explicit deepfake images of their classmates.

“The examples that they have in the document are quite real,” said Yongpradit. “These are not two sentence descriptions of a potential action. These sound like they are already happening. And it should be a wake-up call when it comes to the risks of AI in schools. There’s actual discrimination that could be exacerbated or created because of improper use of AI in schools. And it really alludes to the need for comprehensive AI literacy.”

See also

Photo collage of computer with pixelated image of girl.
F. Sheehan for Education Week / Getty
Artificial Intelligence Explainer AI Literacy, Explained
Alyson Klein, May 10, 2023
10 min read

However, he said, the takeaway shouldn’t be that AI is bad, and education leaders shouldn’t react by trying to ignore or disengage from it.

That’s where the second , released in October, comes in. While a portion of the tool kit is devoted to the risks of AI, it also offers practical tips on approaching topics like evaluating AI interventions and updating school technology policies for AI.

The tool kit was developed with support from Digital Promise, a nonprofit group that focuses on equity and technology issues in schools. A group of 16 teachers, principals, superintendents, and other Ķvlog also contributed their insights.

The tool kit is comprised of eight modules that address three broad themes: AI risk mitigation, strategies for integrating AI into instruction, and effective use and evaluation of AI.

For example, that last theme includes a module on building AI literacy that gives an overview of what AI literacy looks like for Ķvlog, its importance, and a list of topics that AI literacy professional development initiatives should cover, including the technology’s history and origins and data and machine learning.

So, how should school leaders approach these reports? Yongpradit recommends using the resources to open up discussions in faculty meetings.

“The tool kit is more directive—the modules are set up as book club readings or practical activities that teachers can do,” he said. “The office of civil rights guidance is really focused on discussion and picking apart the scenarios and reflection on whether the school is proactively addressing the potential for discrimination, or if the school is doing some of these things, or if teachers are putting themselves at risk and their learners at risk.”

Events

This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
Teaching Webinar
Maximize Your MTSS to Drive Literacy Success
Learn how districts are strengthening MTSS to accelerate literacy growth and help every student reach grade-level reading success.
Content provided by 
College & Workforce Readiness Webinar How High Schools Can Prepare Students for College and Career
Explore how schools are reimagining high school with hands-on learning that prepares students for both college and career success.
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of Education Week's editorial staff.
Sponsor
School Climate & Safety Webinar
GoGuardian and Google: Proactive AI Safety in Schools
Learn how to safely adopt innovative AI tools while maintaining support for student well-being. 
Content provided by 

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide — elementary, middle, high school and more.
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.

Read Next

Ed-Tech Policy After FCC Cuts, This Nonprofit Keeps Schools’ Wi-Fi Connections Alive
Mission Telecom said it hopes other service providers follow its lead.
5 min read
Spencer Hollers works to equip Southside Independent School District buses with wifi on Aug. 13, 2020, in San Antonio, Texas. Southside will begin the year with remote teaching and will place the wifi-equipped buses around the school district to help students without access to the internet.
Spencer Hollers works to equip Southside Independent School District buses with Wi-Fi on Aug. 13, 2020, in San Antonio, Texas. Wi-Fi on school buses became E-rate-eligible in 2023 under the Biden administration, but in 2025 the Trump administration's FCC removed the service from the E-rate eligible services list.
Eric Gay/AP
Ed-Tech Policy Why Most Principals Say Cellphone Bans Improve School Climate
Nearly 3 in 4 principals believe banning cellphones has big upsides.
2 min read
Student Audreanna Johnson views her cell phone near a cell phone locker at Ronald McNair Sr. High School on Aug. 7, 2025, in Atlanta.
Student Audreanna Johnson views her phone near a cellphone locker at Ronald McNair Sr. High School in Atlanta on Aug. 7, 2025. Principals say cellphone bans are improving student behavior, according to a RAND study.
Mike Stewart/AP
Ed-Tech Policy Do School Cellphone Bans Work? What Early Findings Tell Us
A pair of research projects look at the impact on discipline and academic achievement.
6 min read
Student Keiran George uses her cellphone as she steps outside the Ramon C. Cortines School of Visual and Performing Arts High School in downtown Los Angeles on Aug. 13, 2024.
Student Keiran George uses her cellphone as she steps outside the Ramon C. Cortines School of Visual and Performing Arts High School in downtown Los Angeles on Aug. 13, 2024. California last year approved limits on the use of the devices in schools.
Damian Dovarganes/AP
Ed-Tech Policy AI Is Changing Teaching, But Few Labor Contracts Reflect It
Classroom Ķvlog are using artificial intelligence to help with their work, yet union agreements have not caught up.
7 min read
Flat isometric design of Artificially intelligent robot-Document Analysis-data analysis concept-contracts
DigitalVision Vectors