DEV Community

Cover image for Turning a Service Into an AI Product Is a Workflow-Splitting Problem, Not a Pricing One
yulyabrocoders for Brocoders

Posted on

Turning a Service Into an AI Product Is a Workflow-Splitting Problem, Not a Pricing One

"Service as software" gets pitched as a pricing and positioning question, charge for outcomes instead of seats. The actual engineering decision underneath it is a workflow decomposition problem: which steps in the service have a verifiable correct answer, and which don't. Get that boundary wrong in either direction and the product fails in a specific way. Automate a step that has no ground truth to check against and you're shipping confident guesses with no way to grade them. Leave a step with a clear correct answer stuck behind a human review queue and you've built an expensive, slow version of something that should have been an API call.

Every service splits into two kinds of work

Rules-based work with a verifiable correct answer, coding against a spec, medical coding, insurance claims processing, is what the "service as software" framing calls intelligence. It's testable. You can build an eval set and know when the system is wrong. Taste and experience-based decisions, strategic recommendations, feature prioritization, judgment calls with no single right answer, are the opposite. There's nothing to grade against, only a track record of outcomes over time.

Those two categories don't get the same system. Intelligence work belongs behind a synchronous, auditable pipeline with test coverage. Judgment work belongs in an assisted interface where the AI surfaces options and reasoning, and a human signs off, because there's no ground truth for the system to be silently wrong against.

Classifying a step, and what each answer implies for the build

function classifyStep(step) {
  if (step.hasVerifiableGroundTruth && step.isRulesBased) {
    return { path: "automate", requiresAudit: true };   // intelligence: testable, deterministic
  }
  return { path: "assist", requiresHumanApproval: true }; // judgment: no ground truth to grade against
}
Enter fullscreen mode Exit fullscreen mode

automate steps get the treatment intelligence work needs: an eval suite, an audit trail per decision, and a synchronous API contract, because you can prove it's right. assist steps get a queue or inbox interface, AI-generated options with reasoning attached, and a required human approval before anything ships, because you can't prove it's right, only that a qualified person agreed with it. Misclassifying a step doesn't just cost money, it's the difference between a defensible system and a liability.

What this looks like in two real builds

Brocoders built an Advisory AI Panel for a client that's squarely judgment work: a structured panel of independent AI experts with distinct viewpoints, an AI facilitator moderating multi-round discussion, and a live readiness score, but the panel surfaces perspectives, it doesn't hand down a verdict. That's the assist path done right, the system organizes judgment, it doesn't replace it.

AskAC.ai, built for Compressor World, sits on the other side. It's a technical support system covering 4,000+ product manuals and spec sheets, every answer traceable to a source document, with no hallucinated responses recorded. That's intelligence work: there's a correct answer in the manual, the system's job is retrieval and citation, not judgment, and it can be held to a testable standard because the ground truth actually exists.

What the pricing tells you about the split

Seven companies pricing this model make the intelligence/judgment split visible in what they charge for. Rillet, an AI accounting product, automates 93% of journal entries and charges a flat subscription, rules-based accounting work is intelligence almost all the way down, so the pricing looks like software pricing. Anterior, doing AI prior authorization, claims 90% automation and 74% faster processing, same shape: mostly verifiable, mostly automatable. Crosby, doing AI contract review, charges $250-$1,000 per document, a wider range that reflects real judgment content, contract review isn't purely rules-based, so the price varies with how much human-grade reasoning the document actually needs. Sierra and Decagon both charge per resolution in customer service AI, tens of thousands to $150,000+ annually plus setup, because resolution is closer to intelligence work (there's a definable "did this solve the ticket") but still needs enough judgment-adjacent handling that it isn't priced like a pure API call.

The three questions that actually decide the architecture

  1. Which workflow components are intelligence vs. judgment? This is the classification step above, run against every piece of the service, not the service as a whole.
  2. Is the work currently outsourced or in-house? This tells you what system of record you're integrating against and who owns the data you need.
  3. What would clients pay for the outcome alone? This is the same audit-trail-not-meter problem from outcome-based pricing: you can only charge for an outcome you can prove happened.
  4. How we build this

Brocoders runs both shapes on a React, Node.js, and TypeScript stack, with multi-tenant architecture as a default and our own DevOps end to end rather than outsourced infra. Internal tooling at bcboilerplates.com covers the auth and tenancy scaffolding either shape needs, so engineering time goes into the eval suite for intelligence work or the approval interface for judgment work, whichever the service actually requires.

Engineering checklist before you convert a service into a product

  • Classify every step, not the workflow as a whole, intelligence and judgment usually coexist in the same process.
  • Build an eval set for every automated step, so "correct" is measured, not assumed.
  • Build an audit trail for intelligence work, and a human-approval gate for judgment work, they're not interchangeable safeguards.
  • Don't over-automate judgment calls just because the model sounds confident, confidence isn't the same as ground truth.
  • Don't under-automate intelligence work out of caution, that's the expensive mistake in the other direction.
  • Revisit the boundary over time, a step that needed human approval at launch may earn its way into automation once the eval data backs it.
  • Tie billing to the outcome you can actually prove, not to the step you wish was fully automated yet.

If you're deciding where the intelligence/judgment line sits in your own service before committing to a build, brocoders.com is a reasonable place to start that conversation.

Top comments (0)