DEV Community

David García
David García

Posted on

The problem with ‘AI in education’ tools nobody talks about

```html

TL;DR: Most "AI in education" tools are glorified glorified data collection machines, and we’re letting them do that without a serious look at the potential downsides for student privacy and learning.

The problem with ‘AI in education’ tools nobody talks about

Let’s be clear: the hype around AI in education is intense. We’re seeing promises of personalized learning, automated grading, and even AI tutors. As a developer and someone who’s spent years building automation tools, I’m naturally curious. But I’m also seeing a lot of incredibly naive enthusiasm, and frankly, a worrying lack of critical discussion. Most of these tools aren’t genuinely innovative; they’re just repackaged data collection systems masquerading as intelligent solutions.

The core issue isn’t the technology itself – AI can be useful. The problem is the assumptions being made about how it’s being deployed and what data it’s collecting. I recently tested out a popular "AI-powered learning platform" for high school algebra. The tool tracked everything: every keystroke, every time a student hovered over a concept, every attempt at a problem. It then generated "personalized recommendations" based on this data. Let's say a student struggled with quadratic equations. The AI flagged this, but instead of offering targeted support, it simply recommended another five problems on the same type of equation. It wasn't adapting to the student's specific needs; it was reinforcing a frustrating, repetitive cycle.

A Practical Tip: Data Minimization

This isn’t a failure of the AI itself, but a symptom of a larger problem: most of these platforms are designed to gather as much data as possible, with little thought given to what that data means or how it’s being used. Here’s a practical tip: if a tool is tracking every single interaction, ask yourself: "Is this truly necessary for effective learning, or is it just building a detailed profile of the student’s struggle?"


// Example: Simple data filtering

const rawData = [

{ student: 'Alice', problem: 'Quadratic Equation 1', attempt: 'Failed', time: 120 },

{ student: 'Alice', problem: 'Quadratic Equation 2', attempt: 'Failed', time: 180 },

{ student: 'Bob', problem: 'Linear Equation 1', attempt: 'Passed', time: 60 },

{ student: 'Alice', problem: 'Quadratic Equation 3', attempt: 'Failed', time: 90 }

];

const filteredData = rawData.filter(item => item.attempt === 'Failed' && item.problem.includes('Quadratic Equation'));

console.log(filteredData);

Tools like this simple filter demonstrate how you can control the data being sent to a service, reducing the amount of potentially sensitive information being collected. Don't just accept the default settings. Demand transparency about what data is being gathered and how it's being used. Explore tools like Matomo or Open Cookie Banner to give students and parents control over tracking.

Ultimately, we need to approach “AI in education” with a healthy dose of skepticism. Let’s focus on genuinely helpful tools that support human teachers, not ones that treat students like data points. If you're serious about building robust, privacy-conscious learning systems, I've got a resource that dives deep into automation and data management for education: Automation for Educators. It’s a practical guide for building your own solutions.

```


Itelnet Consulting

Top comments (0)