Question, friends: How familiar are you with artificial intelligence?
In the last few years, we’ve seen a whole host of AI tools that have popped up across the market for consumers to use – from chat boxes and generative tools to use in the workplace, to educational tech that helped schools facilitate remote learning during the height of the pandemic, and so much more.
All of these tools raise important ethical questions and new challenges for society to work through, but right now I’m particularly concerned about the ways schools are using AI – and causing harm to students in the process.
A recent report from the Center for Democracy and Technology shows that schools are using AI tools to monitor student activity, moderate and filter online content, and use predictive analytics at the expense of students' civil rights.
In practice, this looks like students from marginalized communities disproportionately receiving disciplinary actions (including being contacted by law enforcement) due to the use of AI-powered monitoring software in their schools.
This looks like LGBTQ+ students who have been outed by monitoring software without their consent – a horrifying violation of privacy that can have devastating impacts for vulnerable students.
This looks like targeted filtering and blocking of content associated with LGBTQ+ students and students of color, creating a new frontier of digital book bans.
The result is that students from protected classes are more likely to be impacted by this technology on the basis of race, sex, disability, and LGBTQ+ status than their peers.
No students should face discrimination while simply trying to receive an education, and that’s why my colleagues in the House and I are demanding answers from the U.S. Department of Education. If you agree, click here to add your name to mine and send a message that all students deserve the right to a quality education without fear of discrimination.
As one of the youngest members of Congress, I care deeply about the ways new technologies are helping and hurting Americans.
Digital privacy is a huge concern, and in response, I’ve created important legislation like the My Body, My Data Act to protect reproductive and sexual health data amid a changing landscape. The use of AI in schools is another area that will require us to consider the impacts and provide solutions to protect our civil liberties.
More soon.
-Sara
