DEV Community

Paul Crinigan
Paul Crinigan

Posted on

Why AI Analytics Projects Stall Before Anyone Picks a Model

Most of the analytics work I watch fail never gets far enough to have a model problem. The pilot looks great on a sample CSV, then it meets the actual database and quietly dies there.

The failure is almost always structural rather than technical. Here is where the time actually goes, and what separates a demo from something a team uses on a normal Tuesday.

The Bottleneck Is Access, Not Intelligence

Ask anyone who has tried to ship an internal analytics tool where the month went. It was not tuning. It was getting a read only credential, agreeing on which of the three customer tables is canonical, and discovering that the revenue field in production has been nullable since 2021.

Models are close to a commodity now. Access to trustworthy data is not, and no amount of model selection compensates for a pipeline nobody is allowed to touch.

The practical move is to shrink the surface. Pick one question people ask every week, wire up exactly the tables that answer it, and ship that. A narrow thing that works beats a general thing that is still in review.

Plain Language Queries Are Plumbing, Not Magic

Natural language to SQL gets sold as intelligence. It is closer to plumbing, and that is the good news, because plumbing is testable.

What makes it work is boring: a schema the model can actually read, column descriptions written for a human, and a small set of known questions with known answers that you rerun after every change. Without that last part you do not have a tool, you have a slot machine.

It also changes who gets to ask. When the person holding the question can put it directly to MySQL, Postgres or a NoSQL store, the analyst stops being a ticket desk and starts owning definitions, which is the higher value job anyway.

Training a Model Without Writing Code

Prediction is where teams assume they need a data science hire. Often they do not. Classifiers, regressors, clusterers and anomaly detectors trained on your own labeled examples cover a large share of real business questions: which invoices will go late, which accounts look like churn, which sensor readings are out of family.

The hard part is not the algorithm, it is the labels. If nobody in the building agrees on what counts as a churned account, no training run fixes that.

Start with a label you can defend in one sentence, train on it, then check the model against a period where you already know the outcome.

The Trust Layer Most Teams Skip

A number with no visible query behind it gets used exactly once. Someone checks it against a spreadsheet, finds a difference nobody can explain, and goes back to the spreadsheet forever.

So show the work. The generated query, the rows it touched, the freshness of the underlying table. It feels like clutter right up until the first time it settles an argument.

Freshness is the one that quietly burns teams. An answer that is correct for yesterday's data, presented as though it is live, is worse than no answer at all.

The Takeaway

The model is the cheapest part of this stack now. What decides whether AI analytics sticks is access, testable plumbing, honest labels, and a trust layer people can see.

The full set of guides and tools we keep on this, from plain language analysis to no code model training and connecting AI to your own databases, lives here: https://www.aiappsapi.com/ai-analytics/

Top comments (0)