<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>DEV Community: Improving</title>
    <description>The latest articles on DEV Community by Improving (@improving).</description>
    <link>https://dev.to/improving</link>
    <image>
      <url>https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F3657055%2F82901aed-d6be-441b-880a-358715e70583.jpg</url>
      <title>DEV Community: Improving</title>
      <link>https://dev.to/improving</link>
    </image>
    <atom:link rel="self" type="application/rss+xml" href="https://dev.to/feed/improving"/>
    <language>en</language>
    <item>
      <title>How the Ratchet Pattern Keeps AI Code Quality from Slipping Backward</title>
      <dc:creator>Improving</dc:creator>
      <pubDate>Wed, 18 Nov 2026 06:53:46 +0000</pubDate>
      <link>https://dev.to/improving/how-the-ratchet-pattern-keeps-ai-code-quality-from-slipping-backward-14bp</link>
      <guid>https://dev.to/improving/how-the-ratchet-pattern-keeps-ai-code-quality-from-slipping-backward-14bp</guid>
      <description>&lt;p&gt;With time, the codebase became harder to maintain, more fragile, and more difficult to change. When teams tried to identify the source of the decline, they couldn't point to a single problematic merge because there wasn't one. The cause was the cumulative effect of hundreds of small changes that were acceptable on their own and harmful together.&lt;/p&gt;

&lt;p&gt;Most AI-era quality gates validate individual pull requests. Few ask whether AI code quality across the whole system is moving in the right direction. The ratchet pattern fixes it.&lt;/p&gt;

&lt;p&gt;In this blog post, we will cover the practices that keep a ratchet working once AI coding agents are writing the code, from mechanical gates and gaming-resistant metrics to a hand audit of tests and a named owner for the floor.&lt;/p&gt;

&lt;h2&gt;
  
  
  Define Quality Gates for AI-Assisted Development
&lt;/h2&gt;

&lt;p&gt;An AI development quality gate, sometimes called a code quality gate, is an automated check that blocks a change from merging unless it meets a stated standard.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;A conventional gate asks whether this change passes.&lt;/li&gt;
&lt;li&gt;A ratchet gate asks whether the system is still at least as good as it was at the last recorded floor, for every metric the team has chosen to track.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;The floors live in a checked-in file, and a human resets one only deliberately and with a recorded reason. Platform-level controls such as Azure DevOps &lt;a href="https://learn.microsoft.com/en-us/azure/devops/repos/git/branch-policies" rel="noopener noreferrer"&gt;branch policies&lt;/a&gt; are where the gate is enforced at merge time.&lt;/p&gt;

&lt;p&gt;A per-merge gate cannot see gradual regression. Each change clears its own bar, the system gets slightly worse, and no review ever has a single culprit to point at. Agents raise the volume of changes moving through the pipeline, which raises the rate of that drift. A gate that tracks the net direction of quality is the only kind that catches it.&lt;/p&gt;

&lt;h2&gt;
  
  
  How the Ratchet Pattern Maintains AI Code Quality
&lt;/h2&gt;

&lt;p&gt;A team running three or four parallel AI coding agent sessions can generate code in an afternoon at the volume a human team might take two weeks to produce. A review process already stretched at human velocity does not scale linearly when the input triples or quadruples.&lt;/p&gt;

&lt;p&gt;The arithmetic shows why.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Reviewers can properly cover 20 pull requests a day&lt;/li&gt;
&lt;li&gt;Agents triple the volume to 60&lt;/li&gt;
&lt;li&gt;Forty pull requests a day go unreviewed&lt;/li&gt;
&lt;li&gt;Backlog grows by 200 in a five-day week&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;A sufficiently rested reviewer with enough time could notice that coverage dipped in a file nobody touched in months. With the ratchet, the whole quantifiable category leaves the human queue, so it stops competing with architecture for the same finite hours.&lt;/p&gt;

&lt;p&gt;The gate never gets tired and never builds a backlog, and it will not wave a Friday afternoon deploy through on the assumption that someone will circle back Monday.&lt;/p&gt;

&lt;h3&gt;
  
  
  1. Keep Architectural Judgment with Humans
&lt;/h3&gt;

&lt;p&gt;I know of no metric that puts a floor under architectural coherence. Nothing measures whether a new module respects the intent of the system it joined, whether an abstraction will age well, or whether what an agent built solves the problem the ticket described.&lt;/p&gt;

&lt;p&gt;The judgment stays human in agentic coding, however sophisticated the gates get. The ratchet narrows what the human has to look at and leaves the judgment on the remainder untouched.&lt;/p&gt;

&lt;p&gt;We design the same narrowing in every &lt;a href="https://www.improving.com/expertise/ai/custom-ai-ml-development/" rel="noopener noreferrer"&gt;custom AI/ML development engagement&lt;/a&gt;: mechanical gates absorb what can be measured, and a senior engineer's limited hours go to the calls that cannot be. Our blog post on &lt;a href="https://www.improving.com/thoughts/embedding-ai-into-daily-development/" rel="noopener noreferrer"&gt;embedding AI into daily development&lt;/a&gt; covers what senior engineers learned doing it.&lt;/p&gt;

&lt;h3&gt;
  
  
  2. Expect AI Coding Agents to Game Code Coverage Targets
&lt;/h3&gt;

&lt;p&gt;When a measure becomes a target, it stops being a good measure.&lt;/p&gt;

&lt;p&gt;This is the problem with applying the ratchet to code coverage. Human developers sometimes write tests just to meet a coverage requirement. For example, they might write a test that executes a piece of code but never checks whether it produces the correct result. The coverage number goes up, but the test provides little real protection.&lt;/p&gt;

&lt;p&gt;AI coding agents can make this problem worse. Agents are designed to achieve the objectives they are given as efficiently as possible. If an agent is instructed to maintain a minimum branch coverage, it may find the easiest way to satisfy that requirement: write tests that execute every branch without checking the actual behavior.&lt;/p&gt;

&lt;p&gt;These tests pass, and the coverage target is met. But if the code starts producing incorrect results, the tests may not catch it.&lt;/p&gt;

&lt;p&gt;The ratchet is working as it was designed to work. The problem is that code coverage measures how much code a test executes, not whether the test actually verifies that the code works. AI agents can exploit this gap much faster than human developers, making it even more important to measure what matters, not just what is easy to count.&lt;/p&gt;

&lt;h3&gt;
  
  
  3. Choose Quality Metrics That Resist Gaming
&lt;/h3&gt;

&lt;p&gt;The practical response keeps the quantifiable gates and weights them by how hard they are to satisfy without improving what they claim to measure.&lt;/p&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fx0bnmaf043kw1mmbrew4.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fx0bnmaf043kw1mmbrew4.png" alt="Image - How the Ratchet Pattern Keeps AI Code Quality from Slipping Backward" width="799" height="505"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Common mistake:&lt;/strong&gt; Answering a gamed coverage number by raising the coverage floor. A higher floor adds a few more assert-free tests to the bill, and agents satisfy it the same way. When agents game a coverage number, swap in a metric that is harder to satisfy without real assertions.&lt;/p&gt;

&lt;p&gt;Picking harder metrics does not solve the problem permanently. Metric selection is an ongoing adversarial exercise, because whatever the ratchet enforces also tells agents what to optimize for. A team that sets a coverage floor and never revisits it runs the same gate for years against agents that keep improving.&lt;/p&gt;

&lt;h3&gt;
  
  
  4. Run a Ten-Test Sampling Audit
&lt;/h3&gt;

&lt;p&gt;A periodic human audit earns its keep alongside the automated check. It is the only process that tells a team whether the check has quietly stopped meaning what it was built to mean.&lt;/p&gt;

&lt;p&gt;A reviewer pulls ten tests at random from the merges the ratchet approved in the last two weeks and opens each one. The single question for each: if the behavior this test claims to cover broke tomorrow, would this test fail? A test that calls a function and checks it did not throw differs from a test that checks the function returned the right answer, and coverage tooling cannot tell them apart. A human reading ten tests for fifteen minutes every two weeks can.&lt;/p&gt;

&lt;p&gt;A few tests out of ten that exercise the target code without pinning down its behavior, usually concentrated in whichever part of the codebase saw the most agent-generated churn that cycle. The pattern is the signal. It shows whether the coverage floor still works as a regression check or has become a number that gets satisfied without being earned. It also costs far less than formalizing "does this test assert something meaningful" into a rule a linter could enforce.&lt;/p&gt;

&lt;h3&gt;
  
  
  5. Assign an Owner to the Floor
&lt;/h3&gt;

&lt;p&gt;Once the ratchet is running and the easy regressions are caught mechanically, the harder question moves up a level: who decides what the floor measures, and who is accountable when a metric gets gamed?&lt;/p&gt;

&lt;p&gt;It is an engineering leadership question, the one that appears whenever a team automates a category of oversight and has to decide what human judgment keeps a seat. I have worked through it from the opposite direction in adversarial reasoning architectures. A mechanical gate catches what it was built to measure, and someone still has to own deciding whether it measures the right thing.&lt;/p&gt;

&lt;p&gt;My answer is that the floor's metrics need an owner who revisits them on a cadence, the way a security team revisits a threat model. A ratchet installed once and forgotten still defines what quality means for that codebase, in a form that increasingly capable agents optimize against. With nobody maintaining it, the gate keeps passing while the quality it was built to protect erodes. The layered approach in our &lt;a href="https://www.improving.com/thoughts/multi-layered-testing-overview/" rel="noopener noreferrer"&gt;multi-layered testing overview&lt;/a&gt; is a useful companion for deciding which layers get a floor.&lt;/p&gt;

&lt;h3&gt;
  
  
  6. Treat Quality Gates as a Living Specification
&lt;/h3&gt;

&lt;p&gt;AI development quality gates cannot eliminate regression, and nothing else does either. What the ratchet can do is turn an entire category of drift, the quantifiable kind, from something that demands vigilance into something that needs only configuration, at a moment when the volume of code moving through a pipeline has outgrown what vigilance can cover.&lt;/p&gt;

&lt;p&gt;The floor holding is the minimum bar. The stronger signal is a team that keeps asking what the floor measures, because the agents on the other side of the gate will find the answer whether or not anyone is watching.&lt;/p&gt;

&lt;h2&gt;
  
  
  Next Step
&lt;/h2&gt;

&lt;p&gt;If you run AI agents against production code today, one narrow question is worth bringing to your next engineering review. Pick the single most-trusted quality metric, and ask when someone last read a sample of the tests or checks that pass it instead of the number they produced. In our experience, most teams can say what their floor currently is.&lt;/p&gt;

&lt;p&gt;Fewer can say who last checked that it still means what it was built to mean. If agents in your pipeline already touch multiple model providers or reasoning paths, the dispatcher pattern for keeping business logic decoupled from any single model pairs well with the ratchet.&lt;/p&gt;

&lt;h2&gt;
  
  
  Final Words
&lt;/h2&gt;

&lt;p&gt;Setting the floor is the easy part. Choosing metrics that agents cannot satisfy cheaply, and naming someone who owns them, is where most pipelines need help. Improving's &lt;a href="https://www.improving.com/expertise/ai/" rel="noopener noreferrer"&gt;AI practice&lt;/a&gt; works with engineering leaders on exactly this: deciding where a ratchet belongs in an agent-assisted pipeline, which metrics deserve a floor, and how to audit that the floor still measures something real.&lt;/p&gt;

</description>
      <category>ai</category>
      <category>machinelearning</category>
    </item>
    <item>
      <title>Improving Launches Internal AI Certification Program to Standardize Trusted AI Use</title>
      <dc:creator>Improving</dc:creator>
      <pubDate>Wed, 18 Nov 2026 06:52:53 +0000</pubDate>
      <link>https://dev.to/improving/improving-launches-internal-ai-certification-program-to-standardize-trusted-ai-use-2dh4</link>
      <guid>https://dev.to/improving/improving-launches-internal-ai-certification-program-to-standardize-trusted-ai-use-2dh4</guid>
      <description>&lt;p&gt;&lt;em&gt;Certification measures demonstrated capability and trust in AI output instead of familiarity with one specific platform.&lt;/em&gt;&lt;/p&gt;

&lt;p&gt;DALLAS – Improving, a global IT consulting firm, is offering an AI certification program, a hands-on credential built to answer a question every organization adopting AI is asking: &lt;strong&gt;how do I know I can trust the output?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;The AI certifications on the market now come from technology vendors, focusing on what their own products can do. Improving's certification focuses on how AI should be used, regardless of which platform is behind it. Rather than passing a test, candidates earn each level by showing they can do the work and that the results can be trusted.&lt;/p&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fce9j32fm9406arkzits0.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fce9j32fm9406arkzits0.png" alt="updated certification graph 2026" width="800" height="550"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;&lt;em&gt;Improving certifies through Stage 4 today, matching what the AI tools available to every job role can reliably support.&lt;/em&gt;&lt;/p&gt;

&lt;p&gt;This internal certification program is one that has been encouraged for all employees of the company to participate in, building the trust in AI output that every Improver will need. The company's goal is to have 1,000 employees certified at Stage 3 by the end of 2026, and at every employee certified at Stage 4 by the end of 2027. That includes far more than the software developers and IT consultants Improving employs in large numbers, with business development, accounting, marketing, and every other function held to the same standard.&lt;/p&gt;

&lt;p&gt;While mostly an internal program, some customers have partnered with Improving to bring the same AI rollout to their organizations through its &lt;a href="https://www.improving.com/services/training/ai/ai-deep-learning-program/" rel="noopener noreferrer"&gt;deep learning program for AI acceleration and transformation&lt;/a&gt;, which offers certifications to these teams. &lt;a href="https://www.improving.com/case-studies/topgolf-deep-learning-program/" rel="noopener noreferrer"&gt;Topgolf&lt;/a&gt; is one example. Over 12 weeks, its engineering teams moved from ad hoc AI use to disciplined, AI-assisted delivery, and participants reported a 15% increase in self-assessed AI adoption and confidence.&lt;/p&gt;

&lt;p&gt;“AI is changing everything about how we do work across all job roles, and we view these as fundamental skills. Vendor certifications teach you what a platform is capable of, but they don't teach you how to use AI well and make the results trustable. That is the gap we are trying to close. A certification should show that someone knows how to do the work, and that they have shown it.” - Tim Rayburn, VP of Technology and Head of AI Transformation&lt;/p&gt;

&lt;h2&gt;
  
  
  &lt;strong&gt;A Staged Path From Casual Use to Trusted Workflows&lt;/strong&gt;
&lt;/h2&gt;

&lt;p&gt;Improving's certification moves people from using AI casually to using it with measurable reliability &lt;strong&gt;and trust,&lt;/strong&gt;with each stage building on the last. Traditional technical certifications have leaned heavily on book knowledge, but Improving's program pairs the concepts with a live demonstration of capability.&lt;/p&gt;

&lt;p&gt;Stage 2 confirms that a person can build structured prompts and reusable skills, turning a one-off AI interaction into something repeatable. It is assessed with a written exam.&lt;/p&gt;

&lt;p&gt;Stage 3, known as evaluated systems, requires candidates to show a skill they built for their own day-to-day work and make it evaluable. Every time the skill changes, or the underlying AI model is updated, they can prove the result improved and did not regress, so the output stays trustworthy. Candidates also demonstrate an understanding of why evaluations matter.&lt;/p&gt;

&lt;p&gt;Stage 4, known as evaluated workflows, extends that discipline from a single step to a full sequence of steps. Once people are removed from between those steps, automatic guardrails take their place so the AI stays trustworthy from start to finish.&lt;/p&gt;

&lt;p&gt;To learn more about Improving's AI training and certification, visit &lt;a href="https://www.improving.com/services/training/ai/" rel="noopener noreferrer"&gt;https://www.improving.com/services/training/ai/&lt;/a&gt;&lt;/p&gt;

&lt;h3&gt;
  
  
  &lt;strong&gt;About Improving&lt;/strong&gt;
&lt;/h3&gt;

&lt;p&gt;Improving is a modern digital services firm specializing in artificial intelligence, data, and application development. Since 2018, it has partnered with private equity firm Trinity Hunt Partners to accelerate its growth, driven by a strong commitment to trust, diversity, and innovation. The company operates internationally, with 21 offices across the Americas and India. To learn more about Improving, visit &lt;a href="https://improving.com/" rel="noopener noreferrer"&gt;https://improving.com/&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;&lt;a href="https://www.improving.com/thoughts/newsroom/?category=News%20%26%20Announcements" rel="noopener noreferrer"&gt;News &amp;amp; Announcements&lt;/a&gt;&lt;/p&gt;

</description>
      <category>news</category>
      <category>ai</category>
    </item>
    <item>
      <title>The Complete Guide to Choosing a Business Agility Partner</title>
      <dc:creator>Improving</dc:creator>
      <pubDate>Wed, 18 Nov 2026 06:45:36 +0000</pubDate>
      <link>https://dev.to/improving/the-complete-guide-to-choosing-a-business-agility-partner-57ko</link>
      <guid>https://dev.to/improving/the-complete-guide-to-choosing-a-business-agility-partner-57ko</guid>
      <description>&lt;p&gt;Business agility is now a board-level priority, and buyers face a crowded field of firms with overlapping claims. Many organizations adopt a framework and see little change in how decisions get made, which is why partner selection carries real weight. The global enterprise agile transformation services market is projected to grow at a 16.54% compound annual growth rate (CAGR) from 2025 to 2032, according to &lt;a href="https://www.kingsresearch.com/report/enterprise-agile-transformation-services-market-2594" rel="noopener noreferrer"&gt;Kings Research&lt;/a&gt;. This guide compares best firms across coaching depth, framework fit, delivery model, and measurable outcomes. It also sets out the criteria that separate a transformation partner from a framework vendor, so enterprise leaders can build a shortlist that fits their scale and goals.&lt;/p&gt;

&lt;h2&gt;
  
  
  Executive Summary
&lt;/h2&gt;

&lt;p&gt;Business agility is an organization's ability to sense market change and respond quickly, combining leadership behaviors, operating model design, governance, and team practices. Organizations that build this capability shorten time to market, improve delivery predictability, and keep strategy and execution aligned.&lt;/p&gt;

&lt;p&gt;Nine firms are profiled side by side, from global consultancies to engineering-led partners and specialist agile firms. Each is assessed against a framework covering leadership coaching depth, framework flexibility, change management capability, delivery model, and measurable outcomes, so buyers can build a shortlist that fits their scale and goals.&lt;/p&gt;

&lt;h2&gt;
  
  
  Who Is This Guide For?
&lt;/h2&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Chief Operating Officers&lt;/strong&gt; responsible for operating model design and enterprise performance&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Chief Information Officers and CTOs&lt;/strong&gt; who need agility to extend beyond IT into the wider business&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;VPs of Transformation&lt;/strong&gt; leading multi-year change programs across business units&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Heads of Agile Centers of Excellence&lt;/strong&gt; building internal capability and standard practices&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Procurement and Sourcing Leads&lt;/strong&gt; evaluating consulting partners against defined outcomes&lt;/li&gt;
&lt;/ul&gt;

&lt;blockquote&gt;
&lt;p&gt;Each of these leaders shares the goal of turning agility from a set of team rituals into a repeatable, enterprise-wide capability.&lt;/p&gt;
&lt;/blockquote&gt;

&lt;h2&gt;
  
  
  What Is Business Agility &amp;amp; How Does It Work?
&lt;/h2&gt;

&lt;p&gt;Business agility extends agile principles beyond software teams to the whole organization, including funding, governance, leadership, and customer-facing decisions. It replaces annual planning cycles and large batch releases with shorter feedback loops and empowered teams aligned to business outcomes. Consulting partners help organizations design this shift, coach leaders through new ways of working, and build internal capability that lasts beyond the engagement.&lt;/p&gt;

&lt;p&gt;Common models and approaches include:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Enterprise agile frameworks&lt;/strong&gt; such as SAFe, LeSS, and Nexus, which coordinate multiple teams around shared planning and delivery cadences&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Executive and leadership coaching&lt;/strong&gt; that changes how leaders set priorities, measure results, and remove obstacles&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Organizational change management&lt;/strong&gt; that prepares roles, communication, and adoption for new operating models&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Business process and value stream redesign&lt;/strong&gt; that connects agile delivery to funding, portfolio decisions, and customer outcomes&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Agile training and certification&lt;/strong&gt; that builds shared vocabulary and practical skills across teams&lt;/li&gt;
&lt;/ul&gt;

&lt;h3&gt;
  
  
  Key Advantages of Business Agility
&lt;/h3&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Faster response to market change&lt;/strong&gt; because shorter planning cycles and incremental funding let the organization act on new information sooner.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Stronger alignment between strategy and execution&lt;/strong&gt; because business objectives flow into prioritized backlogs and measurable outcomes.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Greater delivery predictability&lt;/strong&gt; because regular cadences, visible work, and early risk detection reduce surprises for executives and customers.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Higher employee engagement&lt;/strong&gt; because teams gain ownership over how they work and make decisions closer to the customer.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Lower cost of change&lt;/strong&gt; because smaller releases and continuous feedback reduce rework and the expense of late-stage defects.&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  How To Choose the Best Business Agility Partner?
&lt;/h2&gt;

&lt;p&gt;Seven criteria separate firms that change how an organization works from those that only change its vocabulary.&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;
&lt;strong&gt;Leadership coaching depth:&lt;/strong&gt; Confirm that the partner coaches executives as well as delivery teams. Agility stalls when leaders keep setting priorities and measuring results the old way, so coaching at the top is a leading indicator of success.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Framework flexibility:&lt;/strong&gt; Look for partners who can work across SAFe, Scrum, Kanban, Nexus, and LeSS. A framework-agnostic partner adapts the approach to your operating model and avoids forcing a single methodology.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Change management capability:&lt;/strong&gt; Ask how the partner plans for role changes, communication, and resistance. Transformations succeed or fail on adoption, and change management is where most programs lose momentum.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Delivery model:&lt;/strong&gt; Determine whether the firm offers advisory-only engagements, embedded coaches, or full-service delivery. The right model depends on how much capacity and capability your internal teams already have.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Measurable outcomes:&lt;/strong&gt; Require a baseline and agreed metrics such as lead time, release frequency, and time to value before the engagement begins. Partners that cannot define success in measurable terms rarely deliver it.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Relevant industry experience:&lt;/strong&gt; Ask for references in your sector. Regulated industries face different governance and reporting requirements, and experience with them shortens the path to approval.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Knowledge transfer:&lt;/strong&gt; Confirm that the partner builds internal capability through training, coaching, and documented practices so your teams can sustain the change after the engagement ends.&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;&lt;strong&gt;Questions to ask:&lt;/strong&gt; How will you measure whether our transformation is working after 12 months? Which leaders will coach our executive team, and how much of their time will they commit? How do you adapt frameworks when our portfolio includes both regulated and fast-moving products?&lt;/p&gt;

&lt;blockquote&gt;
&lt;p&gt;&lt;strong&gt;The bottom line:&lt;/strong&gt; the best partner changes how leaders lead as well as how teams work.&lt;/p&gt;
&lt;/blockquote&gt;

&lt;h2&gt;
  
  
  Business Agility Companies Compared
&lt;/h2&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fq0h8olhboxhavvt4bujw.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fq0h8olhboxhavvt4bujw.png" alt="Image - The Complete Guide to Choosing a Business Agility Partner" width="800" height="553"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;h2&gt;
  
  
  Top 9 Business Agility Companies
&lt;/h2&gt;

&lt;h3&gt;
  
  
  1. BCG
&lt;/h3&gt;

&lt;p&gt;Boston Consulting Group is a global management consultancy whose agility work focuses on how executive teams redesign decision rights, governance, and performance management for faster, outcome-driven operations. Its business agility offering sits within a broader strategy, applied AI, and organizational transformation practice.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Quick Facts&lt;/strong&gt;&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Headquartered:&lt;/strong&gt; Boston, MA, USA&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Team Size:&lt;/strong&gt; 33,500+ global employees&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key verticals:&lt;/strong&gt; Sixteen industries, including financial institutions, health care, energy, public sector, and retail&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key platforms/technologies:&lt;/strong&gt; Applied AI and strategy capabilities&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Relevant strengths:&lt;/strong&gt; Executive-level strategy, organizational design, performance transformation&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Why Consider BCG?&lt;/strong&gt; BCG is a strong fit when the agility question starts in the boardroom and needs to be tied to strategy, operating model design, and financial outcomes.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Talent Pool Access:&lt;/strong&gt; Offices in more than 100 cities across over 50 countries, per bcg.com.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Proven Track Record:&lt;/strong&gt; BCG reports that its Top 100 clients achieved 12% higher shareholder returns than the S&amp;amp;P 1200, according to bcg.com.&lt;/p&gt;

&lt;h3&gt;
  
  
  2. McKinsey &amp;amp; Company
&lt;/h3&gt;

&lt;p&gt;McKinsey &amp;amp; Company is a global management consultancy that works with C-suite leaders on strategy, organizational health, and operating model transformation. Its agility work addresses how large organizations change structures, leadership behaviors, and talent practices to move faster.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Quick Facts&lt;/strong&gt;&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Headquartered:&lt;/strong&gt; New York, NY, USA&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Team Size:&lt;/strong&gt; 10,001+&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key verticals:&lt;/strong&gt; 22 industry practices, including financial services, healthcare, public sector, energy and materials, and technology, media, and telecommunications, according to mckinsey.com&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key platforms/technologies:&lt;/strong&gt; McKinsey Solutions (proprietary software and data), with alliances spanning cloud and AI&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Relevant strengths:&lt;/strong&gt; Enterprise strategy, organizational health, technology and AI transformation&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Why Consider McKinsey?&lt;/strong&gt; McKinsey suits organizations that want agility framed as a top-level performance agenda supported by structured organizational diagnostics.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Talent Pool Access:&lt;/strong&gt; Industry and functional practices connect clients to McKinsey's global expert network, according to mckinsey.com.&lt;/p&gt;

&lt;h3&gt;
  
  
  3. Improving
&lt;/h3&gt;

&lt;p&gt;Improving Enterprises is a technology consulting and software development firm with a dedicated Business Agility practice. The practice pairs executive coaching, organizational change management, and agile certification training with delivery support, and it works across five agile frameworks. Its engagement approach, the ACT Delivery Framework, keeps each transformation tied to measurable business value and a sustainable transition.&lt;/p&gt;

&lt;h4&gt;
  
  
  Why Is Improving the Best Business Agility Partner?
&lt;/h4&gt;

&lt;p&gt;We pair executive coaching with hands-on agile delivery, so each transformation covers leadership behaviors, team practices, and the tools teams use every day. Our practice is framework-agnostic, which lets us match the approach to each organization's operating model.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Global footprint:&lt;/strong&gt; 8 countries, 3 continents, 21 offices, and 2,500+ consultants&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key verticals:&lt;/strong&gt; Energy, financial services, aviation, manufacturing, and real estate&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Platform stack:&lt;/strong&gt; Jira, Azure DevOps, and sticky-note workshop tools for agile planning and team alignment&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Relevant strengths:&lt;/strong&gt; Executive coaching and training, organizational change management, agile certification and leadership training, Product Owner and Scrum Master staffing, and business transformation consulting.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Global Delivery Access&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Improving operates 21 offices across the United States, Canada, Mexico, Argentina, Chile, Guatemala, Costa Rica, and India, so business agility coaching can be delivered onsite and by distributed teams.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Proven Track Record&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Avenue Living is a property management company with a large portfolio across Western Canada and the United States. Its IT department was understaffed, its project intake process was tangled, and several overlapping CRM tools caused poor prioritization and project management problems. Improving led an 18-month Agile transformation that introduced Disciplined Agile, Kanban, and Scrum across teams, &lt;a href="https://www.improving.com/case-studies/avenue-living/" rel="noopener noreferrer"&gt;resulting in procurement cycle times falling from 8-10 weeks to 2 weeks&lt;/a&gt;.&lt;/p&gt;

&lt;p&gt;&lt;em&gt;Customer testimonial for Don McGreal's Agile training:&lt;/em&gt;&lt;/p&gt;

&lt;blockquote&gt;
&lt;p&gt;“Don was clear, practical and guided us step by step. We discussed the real life use-cases, pictorial representations were good and tips on how to be successful using Agile were great.” ~ Devendra Singh Rathore&lt;/p&gt;
&lt;/blockquote&gt;

&lt;p&gt;&lt;strong&gt;Strategic Advantage&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Improving's business agility practice combines executive coaching, change management, and certification training with delivery experience across five agile frameworks, so leadership alignment and team-level change move forward together. Organizations that need both an operating model shift and day-to-day delivery improvement can work with one partner on both. &lt;a href="https://www.improving.com/expertise/business-agility/" rel="noopener noreferrer"&gt;Explore our business agility services.&lt;/a&gt;&lt;/p&gt;

&lt;h3&gt;
  
  
  4. Deloitte
&lt;/h3&gt;

&lt;p&gt;Deloitte is a global professional services network offering audit, tax, consulting, and advisory services. Its business transformation work spans enterprise technology and performance, human capital, and finance transformation, which allows agility initiatives to be designed alongside wider operating model changes.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Quick Facts&lt;/strong&gt;&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Headquartered:&lt;/strong&gt; London, UK&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Team Size:&lt;/strong&gt; 10,001+&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key verticals:&lt;/strong&gt; Consumer, energy, financial services, government and public services, life sciences and health care, and technology&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key platforms/technologies:&lt;/strong&gt; Alliances with Adobe, AWS, Google, NVIDIA, Oracle, Salesforce, SAP, ServiceNow, and Workday&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Relevant strengths:&lt;/strong&gt; Multi-industry depth, enterprise technology alliances, operating model transformation&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Why Consider Deloitte?&lt;/strong&gt; Deloitte fits enterprises that want agility tied to finance, HR, and technology transformation within a single program.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Talent Pool Access:&lt;/strong&gt; Deloitte.com reports operations in more than 150 countries and territories.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Proven Track Record:&lt;/strong&gt; Deloitte states that it provides services to nearly 90% of the Fortune Global 500 companies, according to Deloitte.com.&lt;/p&gt;

&lt;h3&gt;
  
  
  5. Thoughtworks
&lt;/h3&gt;

&lt;p&gt;Thoughtworks is a global technology consultancy founded in Chicago in 1993. Its agility work is delivered alongside engineering and AI services, which suits enterprises where agile ways of working depend on modernizing software delivery and data platforms.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Quick Facts&lt;/strong&gt;&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Headquartered:&lt;/strong&gt; Chicago, IL, USA&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Team Size:&lt;/strong&gt; 10,000+&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key verticals:&lt;/strong&gt; Automotive, public sector, energy, media and publishing, retail and e-commerce, financial services, and life sciences&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key platforms/technologies:&lt;/strong&gt; Microsoft, AWS, Google Cloud, Databricks, and Snowflake partnerships&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Relevant strengths:&lt;/strong&gt; Engineering-led agility, platform modernization, AI-first software delivery&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Why Consider Thoughtworks?&lt;/strong&gt; Thoughtworks is a strong choice when agility must extend into the engineering practices and platforms that teams use to deliver.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Talent Pool Access:&lt;/strong&gt; Its About us page lists 47 offices across 18 countries.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Proven Track Record:&lt;/strong&gt; Thoughtworks was named AWS Global Partner of the Year for data and analytics in 2025, according to its news releases.&lt;/p&gt;

&lt;h3&gt;
  
  
  6. Adaptavist
&lt;/h3&gt;

&lt;p&gt;Adaptavist is a UK-based technology services group that helps organizations configure and adopt Atlassian and related platforms. Its agile offering combines strategy, platform setup, and people enablement to help teams collaborate and deliver against business goals.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Quick Facts&lt;/strong&gt;&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Headquartered:&lt;/strong&gt; London, UK&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Team Size:&lt;/strong&gt; 1,000+&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key verticals:&lt;/strong&gt; Financial services, real estate, higher education, iGaming, and social sector organizations, according to customer stories on adaptavist.com&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key platforms/technologies:&lt;/strong&gt; Atlassian (Platinum Solution Partner), AWS (Advanced Tier Services), GitLab (Select Partner), monday.com&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Relevant strengths:&lt;/strong&gt; Atlassian ecosystem configuration, agile consulting, managed services&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Why Consider Adaptavist?&lt;/strong&gt; Adaptavist suits organizations that want agile operating models implemented directly inside the Atlassian tools their teams already use.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Talent Pool Access:&lt;/strong&gt; Consultants are based across Europe, North America, South East Asia, and South Africa, based on the company website.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Proven Track Record:&lt;/strong&gt; Adaptavist states that it serves Fortune 500 businesses globally, and it received two Atlassian Partner of the Year 2026 awards, according to its website.&lt;/p&gt;

&lt;h3&gt;
  
  
  7. Excella
&lt;/h3&gt;

&lt;p&gt;Excella is a transformative technology firm that combines organizational transformation, agile software delivery, and AI and analytics work. Its teams help federal, commercial, and nonprofit organizations deliver technology that supports their missions.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Quick Facts&lt;/strong&gt;&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Headquartered:&lt;/strong&gt; Arlington, VA, USA&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Team Size:&lt;/strong&gt; 100+&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key verticals:&lt;/strong&gt; Federal, commercial, and nonprofit markets&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key platforms/technologies:&lt;/strong&gt; AWS Advanced Consulting Partner, Red Hat partner, Scrum Alliance; ISO 9001, ISO 20000-1, ISO 27001, and CMMI Dev ML3&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Relevant strengths:&lt;/strong&gt; Organizational transformation, modern software delivery, AI and analytics&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Why Consider Excella?&lt;/strong&gt; Excella suits organizations that want agile coaching backed by in-house software delivery and certified delivery processes.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Talent Pool Access:&lt;/strong&gt; Roughly 130 Excellians are listed on its About page.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Proven Track Record:&lt;/strong&gt; Excella partnered with the HHS Office of Inspector General to develop the Contracts and Grants Analytics Portal, an AI-enabled analytics tool that helps combat fraud, waste, and abuse, according to excella.com.&lt;/p&gt;

&lt;h3&gt;
  
  
  8. Cprime
&lt;/h3&gt;

&lt;p&gt;cPrime, an ALTEN Group company, is a US-based Agile and Scrum trainer and software development consultant. It provides consulting, managed services, and custom solutions, and it is a Platinum Atlassian partner.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Quick Facts&lt;/strong&gt;&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Headquartered:&lt;/strong&gt; Plano, TX, USA&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Team Size:&lt;/strong&gt; 501-1,000&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key verticals:&lt;/strong&gt; Financial services, healthcare, and technology clients, according to client listings on cprime.com&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key platforms/technologies:&lt;/strong&gt; Atlassian, ServiceNow, IBM | Apptio&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Relevant strengths:&lt;/strong&gt; Scaled agile training, Scrum consulting, Atlassian and ServiceNow transformation&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Why Consider Cprime?&lt;/strong&gt; Cprime is a practical choice for Atlassian-centric enterprises that need scaled agile training and coaching for large numbers of teams.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Talent Pool Access:&lt;/strong&gt; Cprime's stated reach covers 30 countries, per cprime.com.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Proven Track Record:&lt;/strong&gt; Cprime reports that it has worked with 300 Fortune 500 companies and more than 2,500 clients, according to cprime.com.&lt;/p&gt;

&lt;h3&gt;
  
  
  9. Net Solutions
&lt;/h3&gt;

&lt;p&gt;Net Solutions is an engineering firm that designs, builds, and modernizes commerce platforms and digital products. Its delivery model pairs product engineering with application modernization, so agile ways of working are applied to systems that customers use every day.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Quick Facts&lt;/strong&gt;&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Headquartered:&lt;/strong&gt; Chandigarh, India (engineering campus)&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Team Size:&lt;/strong&gt; 300+&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key verticals:&lt;/strong&gt; Retail and consumer goods, media and publishing, healthcare, education, and sports and entertainment&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key platforms/technologies:&lt;/strong&gt; Adobe Commerce, Shopify, BigCommerce, AWS, Microsoft, Contentful, Akeneo, Klaviyo&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Relevant strengths:&lt;/strong&gt; Commerce engineering, phased application modernization, product and platform engineering&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Why Consider Net Solutions?&lt;/strong&gt; Net Solutions suits digital product and commerce organizations that want agile delivery tied to platform modernization and measurable revenue outcomes.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Talent Pool Access:&lt;/strong&gt; Offices in Los Angeles, New York, Toronto, London, and Chandigarh, India, are listed on its website.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Proven Track Record:&lt;/strong&gt; Net Solutions reports a 140% revenue increase for GSF Car Parts after a headless commerce replatform, according to its case studies.&lt;/p&gt;

&lt;h2&gt;
  
  
  Frequently Asked Questions
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;1) What is the difference between business agility and agile software development?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Agile software development applies iterative delivery practices to engineering teams. Business agility extends those principles across leadership, funding, governance, and operating model decisions so the whole organization can respond to change.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;2) How long does a business agility transformation usually take?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Enterprise transformations typically run over multiple years, with early gains in team delivery and leadership behaviors appearing first. The timeline depends on the size of the organization, the number of teams involved, and how deeply governance and funding models must change.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;3) Should we choose a framework like SAFe before selecting a partner?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Choose the partner first, then let them help you select the framework. A framework-agnostic partner can match SAFe, LeSS, Nexus, or a custom approach to your operating model.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;4) What should we measure during a business agility engagement?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Track lead time, release frequency, time to value, and predictability of delivery against commitments. Pair these with business outcomes such as customer retention, cost of change, or time to market for priority products.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;5) Do we need external coaching if we already have internal agile teams?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;External coaching accelerates leadership change and helps scale practices across teams that already use agile methods. Internal teams sustain the change over time, so the strongest engagements build internal capability alongside external expertise.&lt;/p&gt;

&lt;h2&gt;
  
  
  Building a Business Agility Partnership That Lasts
&lt;/h2&gt;

&lt;p&gt;Business agility works when leaders change how they set priorities, fund work, and measure results, and when teams have the practices to act on those choices. The right partner brings coaching, change management, and delivery experience that connect these pieces. Buyers should look for a partner that can define measurable outcomes before the work begins.&lt;/p&gt;

&lt;p&gt;We bring that combination to our business agility clients. Our work with &lt;a href="https://www.improving.com/case-studies/avenue-living/" rel="noopener noreferrer"&gt;Avenue Living&lt;/a&gt; showed how an 18-month transformation can cut procurement cycle times from 8-10 weeks to 2 weeks while building a more accountable culture. &lt;a href="https://www.improving.com/expertise/business-agility/" rel="noopener noreferrer"&gt;Explore our business agility services&lt;/a&gt; and discuss your transformation goals.&lt;/p&gt;

</description>
      <category>agile</category>
      <category>career</category>
    </item>
    <item>
      <title>AI Agent Dispatcher Patterns To Survive the Model Swapping</title>
      <dc:creator>Improving</dc:creator>
      <pubDate>Wed, 18 Nov 2026 06:44:57 +0000</pubDate>
      <link>https://dev.to/improving/ai-agent-dispatcher-patterns-to-survive-the-model-swapping-1l5i</link>
      <guid>https://dev.to/improving/ai-agent-dispatcher-patterns-to-survive-the-model-swapping-1l5i</guid>
      <description>&lt;p&gt;Model providers update APIs, release new versions, deprecate old ones, and adjust pricing on a timescale of months, sometimes weeks. Agent logic changes more slowly than that.&lt;/p&gt;

&lt;p&gt;Production software already solved the same problem for storage. The application does not know which database host it is talking to. It talks to an abstraction layer that routes to the appropriate host, because the host changes more often than the logic built on top of it, and coupling the two creates a migration cost that compounds with every change. David Parnas named the principle &lt;a href="https://en.wikipedia.org/wiki/Information_hiding" rel="noopener noreferrer"&gt;information hiding&lt;/a&gt; in 1972: isolate the decision most likely to change behind an interface that does not change with it.&lt;/p&gt;

&lt;p&gt;Among the AI agent architecture patterns I have shipped in production, the one I return to most applies that idea to model selection, and enterprises skip it more than any other. The dispatcher pattern is a model routing layer that accepts a task request, selects the model based on the task’s actual characteristics, and returns a result in a common format regardless of which model handled it. Agent code sees only the task it submitted and the result that came back.&lt;/p&gt;

&lt;h2&gt;
  
  
  Dispatcher Among AI Agent Architecture Patterns
&lt;/h2&gt;

&lt;p&gt;An AI agent architecture pattern is a reusable structure for how an agent receives tasks, reaches models and tools, and returns results. In agentic AI architecture, some patterns decide how agents divide work, such as orchestrator-worker and multi-agent designs. The dispatcher pattern decides which model handles each task, and it keeps that decision in configuration.&lt;/p&gt;

&lt;h2&gt;
  
  
  Importance of Decoupling Agents From Models
&lt;/h2&gt;

&lt;p&gt;A team that wires agents directly to one provider pays at every model transition, in engineering hours spent hunting down references and in per-task spend on a model tier that may be more than the task needs. The cost sits dormant until the model changes, and then it arrives all at once. Price gaps make the cost concrete.&lt;/p&gt;

&lt;p&gt;In an April 2025 Improving comparison on Amazon Bedrock, Amazon Nova Pro came in &lt;a href="https://www.improving.com/thoughts/switch-from-openai-to-amazon-bedrock/" rel="noopener noreferrer"&gt;68% cheaper than OpenAI’s gpt-4o&lt;/a&gt; on list price per million tokens. A team with agents wired directly to one provider cannot act on a gap like that without a rewrite, which is why multi-provider LLM routing belongs in the architecture early.&lt;/p&gt;

&lt;h2&gt;
  
  
  Recognize Four Signs of Model Coupling
&lt;/h2&gt;

&lt;p&gt;Coupling to a model is easier to spot in its symptoms. Four show up repeatedly:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Hardcoded model names:&lt;/strong&gt; A model name appears as a string constant scattered through application code. With one model, a version change is a find-and-replace. With five models serving five purposes, it is a change that touches half the codebase.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Prompts tuned to one model's style:&lt;/strong&gt; Model families respond differently to phrasing, and a prompt tuned for one can produce degraded output on another because the instruction framing no longer matches what the new model was trained to expect. Every prompt in the system inherits the retuning cost.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Response parsing tied to one output format:&lt;/strong&gt; Parsing fails silently when a different model structures its output differently. A silent parse failure is worse than a crash, because nothing alerts anyone that the data downstream is now wrong.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Retry and error handling written for one provider:&lt;/strong&gt; Rate limits, context-length errors, and content-policy rejections each have their own shape per provider. Error handling calibrated to one provider mishandles another's failures, so the system degrades exactly when it needs to be resilient.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;The dispatcher pattern moves all four out of scattered agent logic and into a single dispatch layer, where they are managed once. The decision belongs early in &lt;a href="https://www.improving.com/expertise/ai/custom-ai-ml-development/" rel="noopener noreferrer"&gt;custom AI and ML development&lt;/a&gt; work, before agent code has shipped against a single provider.&lt;/p&gt;

&lt;p&gt;A common mistake is moving the model name into a config file and calling the system decoupled. The prompts, the parsers, and the error handling still assume the old model, so a swap produces worse output with no error while the config looks clean.&lt;/p&gt;

&lt;h2&gt;
  
  
  Build Three Layers Into the Dispatcher
&lt;/h2&gt;

&lt;h3&gt;
  
  
  Layer 1: AI Model Routing With a Classification Table
&lt;/h3&gt;

&lt;p&gt;The routing layer accepts a task request built from two inputs: the task content and a classification describing the task along the dimensions that determine which model fits. Those dimensions are:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Reasoning depth&lt;/li&gt;
&lt;li&gt;Context window size&lt;/li&gt;
&lt;li&gt;Output format&lt;/li&gt;
&lt;li&gt;Latency sensitivity&lt;/li&gt;
&lt;li&gt;Cost tolerance&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;A routing table maps classifications to model selections. Teams sometimes call this component an LLM router or model router. Simple, well-defined tasks route to smaller, faster, cheaper models, and tasks requiring synthesis across large context or multi-step reasoning route to models built for that.&lt;/p&gt;

&lt;p&gt;The table is a configuration artifact, so moving a task type to a different model, for cost, for quality, or because a new model shipped, becomes a table edit that needs no deployment. Microsoft Foundry offers a &lt;a href="https://learn.microsoft.com/en-us/azure/ai-foundry/openai/concepts/model-router" rel="noopener noreferrer"&gt;managed model router&lt;/a&gt; that applies a similar idea as a service.&lt;/p&gt;

&lt;h3&gt;
  
  
  Layer 2: Adapt Prompts for Each Model
&lt;/h3&gt;

&lt;p&gt;The prompt adapter is the layer teams skip, because it looks like extra work until the first model swap proves otherwise. Each model in the routing table gets an adapter that transforms the agent's canonical prompt format into what that model expects: instruction prefix conventions, system prompt structure, and tool specification format.&lt;/p&gt;

&lt;p&gt;Agent code writes prompts once, in the canonical format, and the adapter does the translation. The adapter is a one-time investment per model, and it saves retuning every prompt each time a model changes.&lt;/p&gt;

&lt;h3&gt;
  
  
  Layer 3: Normalize Output Into One Format
&lt;/h3&gt;

&lt;p&gt;Two models given structurally identical requests produce structurally different responses: keys named differently, null values handled inconsistently, the JSON payload wrapped in whatever structure the model prefers.&lt;/p&gt;

&lt;p&gt;Each model's adapter normalizes its output into the format agent code already expects, so agent code receives a consistent structure no matter which model ran the task.&lt;/p&gt;

&lt;h2&gt;
  
  
  Encode Model Differences in the Routing Table
&lt;/h2&gt;

&lt;p&gt;The routing table is where the quality and cost characteristics of each model, for each task type, get written down. A cheap, fast model handles simple classification because someone evaluated it on that task and it performed well. The dispatcher records that knowledge as configuration.&lt;/p&gt;

&lt;p&gt;A property-technology client I worked with builds this discipline into its architecture. It pins a specific model version to each of its AI skills in production. When a new version ships, nothing routes to it automatically. The update triggers a re-approval and a regression run against that skill’s existing test suite before the skill may use it. For this client the routing table doubles as a governance control, and every routing decision has test results behind it.&lt;/p&gt;

&lt;h2&gt;
  
  
  Test Cheaper Models Against Your Golden Dataset
&lt;/h2&gt;

&lt;p&gt;Running the existing golden dataset for a task segment against a candidate lower-tier model, with the same scoring rubric used for the current model, answers whether the cheaper option meets the quality floor for that segment. Public benchmark leaderboards cover a general task mix, so they cannot say whether a cheaper model meets your quality floor. The discipline matches the ratchet pattern, quality gates that only move forward: a routing change earns its way in with evidence or it does not ship.&lt;/p&gt;

&lt;p&gt;Simple, well-structured tasks such as template composition, bounded summarization, and structured output generation meet the quality floor on smaller models more often than tasks with ambiguous instructions or long-context synthesis.&lt;/p&gt;

&lt;p&gt;In my experience, the quality gap between tiers is largest on the tasks hardest to specify clearly, which is also where teams are most tempted to assume the frontier model is required. Test those tasks first. An unchecked assumption there is the most expensive one in the pipeline.&lt;/p&gt;

&lt;h2&gt;
  
  
  Quantify What Skipping the Dispatcher Costs
&lt;/h2&gt;

&lt;p&gt;Model pricing across capability tiers can differ by a factor of five to fifteen within a single provider’s lineup. If every task routes to the frontier tier because nothing was built to route it elsewhere, the weighted cost per task sits at the high end however many tasks were simple enough for a fraction of the price.&lt;/p&gt;

&lt;p&gt;Illustrative numbers show the size of the gap. Say the frontier tier costs 1.0 per task and a smaller tier costs 0.1, a 10x spread. If 70% of tasks are simple enough for the smaller tier, routing brings the weighted cost to 0.7 × 0.1 + 0.3 × 1.0 = 0.37. Sending everything to the frontier tier costs 1.0, which is 2.7 times the routed figure (1.0 ÷ 0.37). The more the pipeline skews toward simple tasks, the larger the savings from routing.&lt;/p&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2F5xxu3gyr7vt4t1bai2h8.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2F5xxu3gyr7vt4t1bai2h8.png" alt="Image - AI Agent Dispatcher Patterns To Survive the Model Swapping    " width="800" height="625"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;Time costs compound too. Without a dispatcher, every model change forces a choice: absorb degraded service from a deprecated or struggling provider, or push an emergency code change through review, testing, and deployment to route around it.&lt;/p&gt;

&lt;p&gt;Both options cost more than a configuration update, and both repeat. Over three or four model transitions, a realistic count for any team running agents in production for more than a year, the repeated migrations can outweigh the cost of building the dispatcher in the first place.&lt;/p&gt;

&lt;p&gt;Our webinar on &lt;a href="https://www.improving.com/thoughts/webinars/smarter-ai-spending-controlling-token-costs-without-sacrificing-performance/" rel="noopener noreferrer"&gt;controlling token costs without sacrificing performance&lt;/a&gt; covers the spending side in more depth.&lt;/p&gt;

&lt;h2&gt;
  
  
  Skip the Dispatcher When It Is Overkill
&lt;/h2&gt;

&lt;p&gt;A dispatcher on day one of every agent project is the wrong default. A team running a single model with no near-term plan to change it carries no coupling cost, because nothing ever exercises the coupling.&lt;/p&gt;

&lt;p&gt;A basic dispatcher, meaning a routing table plus adapters and normalizers for the initial model set, runs a few days of engineering. The investment pays for itself at the first model transition for any team with more than one model in play, and for any team operating where model releases arrive faster than its own release cadence. Most enterprise AI programs I have worked inside over the past two years fit that description.&lt;/p&gt;

&lt;h2&gt;
  
  
  Stop Betting on a Stable Model Landscape
&lt;/h2&gt;

&lt;p&gt;In enterprise AI agent architecture, the dispatcher is the pattern that assumes the model landscape will keep changing. Skipping it is a wager that models will hold still long enough for the coupling never to matter. That wager was defensible in 2022, when the field moved in years. Providers now ship material model updates within months, and sometimes weeks, and pricing tiers shift under contracts signed on the assumption of stable rates. The dispatcher earns its place by keeping agents running through those changes.&lt;/p&gt;

&lt;p&gt;Before your next model contract renewal, put two questions to your team. How many files would need to change if you swapped providers tomorrow? When did a task type last get re-tested against a cheaper model? Most teams can answer the first. Far fewer can answer the second, and it is usually the more expensive gap. If nobody has revisited a pipeline’s model choice since launch, block thirty minutes this quarter to do it.&lt;/p&gt;

&lt;p&gt;If you would like to map where model coupling sits in your agent pipelines today, &lt;a href="https://www.improving.com/contact/" rel="noopener noreferrer"&gt;Improving’s AI team can walk through it with you&lt;/a&gt;.&lt;/p&gt;

</description>
      <category>ai</category>
      <category>machinelearning</category>
    </item>
    <item>
      <title>MLOps Best Practices to Keep Your Machine Learning Models From Dying</title>
      <dc:creator>Improving</dc:creator>
      <pubDate>Fri, 13 Nov 2026 06:01:14 +0000</pubDate>
      <link>https://dev.to/improving/mlops-best-practices-to-keep-your-machine-learning-models-from-dying-3b18</link>
      <guid>https://dev.to/improving/mlops-best-practices-to-keep-your-machine-learning-models-from-dying-3b18</guid>
      <description>&lt;p&gt;AI models rarely break loudly. The model continues to serve predictions and the infrastructure appears to be functioning normally. Warning signs, such as customers receiving less relevant recommendations, fraud cases slipping through, or business forecasts becoming less reliable, emerge gradually. When teams finally investigate, they often discover that the model's performance started declining weeks or even months earlier, with no clear record of when the drift began or why it happened.&lt;/p&gt;

&lt;p&gt;MLOps best practices can help prevent these issues. In this blog post, we cover six ways model drift and related failures emerge in production and introduce a practical fix borrowed from code quality practices: the ratchet.&lt;/p&gt;

&lt;h2&gt;
  
  
  MLOps Best Practices
&lt;/h2&gt;

&lt;p&gt;MLOps is the set of practices that run a machine learning model as an operated system, including automated training and deployment, monitoring of prediction quality, and named ownership of both.&lt;/p&gt;

&lt;p&gt;Google's guide to MLOps pipelines and automation levels and Microsoft's documentation on &lt;a href="https://learn.microsoft.com/en-us/azure/machine-learning/concept-model-management-and-deployment" rel="noopener noreferrer"&gt;model management and deployment in Azure Machine Learning&lt;/a&gt; cover the full lifecycle.&lt;/p&gt;

&lt;p&gt;The MLOps best practices below target the period after launch, when a model meets data it was not trained on and nothing in the infrastructure reports a problem.&lt;/p&gt;

&lt;h2&gt;
  
  
  1. Recognize Six Ways Models Degrade in Production
&lt;/h2&gt;

&lt;p&gt;The six failure modes below run from the data, through the system, to the organization.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Data drift:&lt;/strong&gt; The statistical properties of the input data shift away from what the model trained on, a common cause of model drift. A model trained on pre-pandemic consumer spending patterns does not know that behavior changed permanently in several categories. Drift is the normal condition of any system trained on a snapshot of a world that keeps moving.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Feature skew (also called training-serving skew):&lt;/strong&gt; The features computed at training time and the features computed at serving time diverge. Two different code paths, often maintained by two different teams, compute the same feature. "Orders in the last 30 days" can mean a rolling calendar window in the batch training pipeline and a fixed billing cycle in the real-time serving layer, and the two produce meaningfully different numbers. The model is fine. The inputs it receives in production differ from the inputs it trained on.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Silent failures:&lt;/strong&gt; An upstream component degrades. A feature pipeline starts returning nulls that get imputed to zero. A third-party data feed changes its schema and a join starts failing. The model keeps producing confident-looking predictions on degraded or missing inputs, because nothing in the stack was told to object.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Missing retraining pipelines:&lt;/strong&gt; The team ships the model, celebrates, and never builds the automated path to retrain it as new ground truth arrives. A model trained on last year's labels keeps scoring this year's customers. Retraining becomes a manual, occasional, deprioritized project, and the gap between what the model knows and what is currently true widens every week.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Poor monitoring:&lt;/strong&gt; Most teams watch infrastructure health, meaning latency, uptime, and error rates, and call it observability. Those signals say nothing about whether the model's predictions are still good. Model monitoring has to track the quality signal itself: prediction distributions, calibration against outcomes as they arrive, and performance broken out by segment.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Governance gaps:&lt;/strong&gt; MLOps governance means named owners and documented decisions. Without them, quality regressions sit unresolved while teams with competing priorities debate whose problem they are.&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  2. Verify the MLOps Platform Actually Exists
&lt;/h2&gt;

&lt;p&gt;We worked with a construction hardware manufacturer that believed it already had an MLOps platform. The client was building an AI-powered bidding tool that reads architectural drawings and RFP documents and generates a bill of materials automatically. When the engagement started, the client's team described the platform as in place.&lt;/p&gt;

&lt;p&gt;Once we asked the basic operating questions, it turned out none of the pieces existed:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;no system for tracking model accuracy in production&lt;/li&gt;
&lt;li&gt;no error collection&lt;/li&gt;
&lt;li&gt;no human-in-the-loop path for feeding corrections&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;The platform existed only as a line on a slide. Building the governance layer, including error collection, a retraining cadence, and clear ownership of the quality floor, became a bigger part of the engagement than the machine learning work itself. The client had never assigned anyone to own these responsibilities.&lt;/p&gt;

&lt;p&gt;A serious &lt;a href="https://www.improving.com/expertise/ai/custom-ai-ml-development/" rel="noopener noreferrer"&gt;custom AI and ML development&lt;/a&gt; engagement has to close that gap.&lt;/p&gt;

&lt;h2&gt;
  
  
  3. Apply the Ratchet to Model Quality
&lt;/h2&gt;

&lt;p&gt;The ratchet pattern is a mechanism that stops quality metrics from decreasing. A checked-in file records the current floor for each metric, such as coverage percentage (which cannot fall) or lint violations and type errors (which cannot rise). Any change that would push a metric past its recorded floor is blocked at the merge gate.&lt;/p&gt;

&lt;p&gt;The quality gate sits in front of model deployment and, ideally, in front of the retraining pipeline's decision to promote a new model version. A retrained model that scores meaningfully worse than the deployed model on any tracked metric (outside the tolerance bands described below) does not get promoted unless a human signs off on the tradeoff explicitly.&lt;/p&gt;

&lt;p&gt;In most organizations a model degrades and nothing stops it, because nothing was built to stop it. With a ratchet in place, a drop below the recorded floor is the event that requires action, and staying at or above the floor happens automatically.&lt;/p&gt;

&lt;h2&gt;
  
  
  4. Replace Hard Floors With Tolerance Bands
&lt;/h2&gt;

&lt;p&gt;Lint violations and coverage percentage are deterministic. Measure an unchanged codebase twice and you get the same number twice. Model quality metrics are not. Accuracy on a rolling window of live traffic fluctuates from sampling variance alone, even when the model is unchanged and the data is stationary. A direct port of the code ratchet produces a hard floor that treats noise as regression.&lt;/p&gt;

&lt;p&gt;A worked example shows the scale of the problem:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Baseline accuracy:&lt;/strong&gt; 91%&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Weekly predictions:&lt;/strong&gt; 2,000&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Standard error from sampling:&lt;/strong&gt; √(0.91 × 0.09 / 2,000) ≈ 0.64 percentage points&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Problem with a hard floor:&lt;/strong&gt; Setting the threshold at 91% means roughly half of ordinary weeks will fall below it due to natural sampling variation.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;A more practical threshold:&lt;/strong&gt; Use a band of three standard errors around the baseline: 91% ± (3 × 0.64%), giving a range of approximately 89.1% to 92.9%.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;What this means:&lt;/strong&gt; The band helps flag changes that exceed normal sampling noise, reducing unnecessary deployment blocks and repeated threshold resets.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;The fix is to treat the floor as a tolerance band around the baseline, borrowing from &lt;a href="https://www.itl.nist.gov/div898/handbook/pmc/pmc.htm" rel="noopener noreferrer"&gt;statistical process control&lt;/a&gt;. A metric that stays outside its historical band for several consecutive windows signals a genuine change, while a single dip followed by a recovery is more likely to be noise. A ratchet that cannot distinguish between the two will either generate constant false alarms or lose the team's trust and eventually be disabled.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Common mistake:&lt;/strong&gt; A common mistake is building the band from the weeks right after launch. Build it from the held-out validation set or a labeled window you have verified as healthy. If drift started in those weeks, the band encodes the degraded state as the acceptable normal, and every later alert is measured against a baseline that was already wrong.&lt;/p&gt;

&lt;p&gt;The defense is the same discipline the code ratchet requires for coverage-lowering commits. Floor and band resets need an owner, a recorded reason, and ideally a second reviewer. Recalibrating the baseline becomes a deliberate, audited decision instead of a quiet way to keep a degrading model shipping under the label of expected variance.&lt;/p&gt;

&lt;h2&gt;
  
  
  5. Map the Ratchet to the Six Failures
&lt;/h2&gt;

&lt;p&gt;Each failure mode maps to a specific piece of this infrastructure, which helps prioritize where to invest first.&lt;/p&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fqivtgj973fi4hc7o9f1m.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fqivtgj973fi4hc7o9f1m.png" alt="Image - MLOps Best Practices to Keep Your Machine Learning Models From Dying" width="799" height="425"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;h2&gt;
  
  
  6. Accept What the Ratchet Cannot Judge
&lt;/h2&gt;

&lt;p&gt;None of this replaces judgment about qualitative model behavior.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Do the model's errors matter to the business?&lt;/li&gt;
&lt;li&gt;Is a slight accuracy drop in a low-stakes segment worth blocking a deployment that fixes a real problem in a high-stakes one?&lt;/li&gt;
&lt;li&gt;Is a technically calibrated model making decisions nobody would defend if asked to explain them out loud?&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Goodhart's law applies as it does in code: a tracked metric becomes a target, and a target can be optimized without improving the thing you care about. A ratchet on accuracy alone can reward a model that gets more confidently, precisely wrong on the segment nobody thought to track.&lt;/p&gt;

&lt;p&gt;Choosing what to track deliberately is the first job. The ratchet is the floor beneath which quality cannot fall silently, and a human still has to ask periodically whether the floor measures the right thing.&lt;/p&gt;

&lt;h2&gt;
  
  
  Give the Pipeline Authority to Object
&lt;/h2&gt;

&lt;p&gt;MLOps best practices come down to one structural change. Models die after deployment because nothing objects when they start to. Once something in the pipeline has the authority to object, the quiet three-month decline becomes a decision someone had to make on the record.&lt;/p&gt;

&lt;p&gt;If you are earlier in the process and still deciding what to build rather than what to protect, the same habit of tracking the right thing applies to model selection and design. For your highest-stakes production model, who would get paged if its accuracy quietly dropped ten points, and how would they find out?&lt;/p&gt;

&lt;p&gt;If you want a second set of eyes on your highest-stakes production model, talk to &lt;a href="https://www.improving.com/expertise/ai/custom-ai-ml-development/" rel="noopener noreferrer"&gt;Improving's AI and ML team&lt;/a&gt;. We will review your monitoring, retraining, and ownership setup and show you where a quiet decline could slip through.&lt;/p&gt;

</description>
      <category>ai</category>
      <category>machinelearning</category>
    </item>
    <item>
      <title>Top Custom AI/ML Development Companies for Production-Ready Models</title>
      <dc:creator>Improving</dc:creator>
      <pubDate>Fri, 13 Nov 2026 06:00:36 +0000</pubDate>
      <link>https://dev.to/improving/top-custom-aiml-development-companies-for-production-ready-models-2d7h</link>
      <guid>https://dev.to/improving/top-custom-aiml-development-companies-for-production-ready-models-2d7h</guid>
      <description>&lt;p&gt;Choosing a custom AI or machine learning partner is harder than it looks, because many firms can build a proof of concept but far fewer can run models in production. Demand for tailored model development is growing quickly, with the &lt;a href="https://www.giikorea.co.kr/report/ires1803725-custom-ai-model-development-services-market-by.html" rel="noopener noreferrer"&gt;custom AI model development services segment projected to rise from $18.13 billion in 2025 to $34.91 billion by 2030 at a 13.86% compound annual growth rate&lt;/a&gt;, according to 360iResearch. This guide profiles leading firms and explains how to evaluate them.&lt;/p&gt;

&lt;h2&gt;
  
  
  Executive Summary
&lt;/h2&gt;

&lt;p&gt;Custom AI and machine learning development builds predictive models, natural language systems, and computer vision tools trained on an organization's own data and tied to its specific business processes. Buyers turn to these partners when off-the-shelf tools cannot address their data, workflows, or compliance requirements, and the right partner converts those models into production systems that produce measurable returns.&lt;/p&gt;

&lt;p&gt;This guide profiles leading custom AI/ML development companies and outlines how to assess partners based on delivery model, data and platform expertise, governance, production track record, and team scalability. It also compares company profiles side by side and closes with the questions a buyer should ask before signing a statement of work.&lt;/p&gt;

&lt;h2&gt;
  
  
  Who Is This Guide For?
&lt;/h2&gt;

&lt;ul&gt;
&lt;li&gt;Chief Technology Officers deciding whether to build AI capability in-house or with a partner&lt;/li&gt;
&lt;li&gt;VPs of Engineering responsible for shipping machine learning models into existing applications&lt;/li&gt;
&lt;li&gt;Chief Data Officers defining the data and governance foundation for AI initiatives&lt;/li&gt;
&lt;li&gt;Procurement and sourcing leads comparing vendor proposals and delivery models&lt;/li&gt;
&lt;/ul&gt;

&lt;blockquote&gt;
&lt;p&gt;Each of these roles shares the same goal: selecting a partner that turns models into measurable, governed business outcomes.&lt;/p&gt;
&lt;/blockquote&gt;

&lt;h2&gt;
  
  
  What Is Custom AI/ML Development &amp;amp; How Does It Work?
&lt;/h2&gt;

&lt;p&gt;Custom AI and ML development is the design, training, evaluation, and deployment of models built for a specific business problem. Teams start with data assessment and use case selection, then choose model types such as classification, regression, forecasting, natural language processing, or computer vision. They train and validate models against business metrics, then package them with APIs, monitoring, and retraining pipelines so they operate inside production systems. The work spans data engineering, modeling, MLOps, and change management.&lt;/p&gt;

&lt;h3&gt;
  
  
  Key Advantages of Custom AI/ML Development
&lt;/h3&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Domain-specific accuracy:&lt;/strong&gt; Models trained on an organization's own data reflect its customers, processes, and edge cases, which makes them more reliable on the tasks that matter most.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Proprietary differentiation:&lt;/strong&gt; Custom models encode institutional knowledge that competitors cannot license, creating advantages that persist beyond a single product release.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Data control and compliance:&lt;/strong&gt; Organizations keep training data, model artifacts, and inference inside their own governed environments, which simplifies audit and regulatory review.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Integration with existing systems:&lt;/strong&gt; Custom models are built to fit current APIs, data pipelines, and workflows, reducing the rework that comes with bolting on third-party tools.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Lower long-run cost at scale:&lt;/strong&gt; Once deployed, owned models can reduce per-transaction licensing fees that accumulate with high-volume usage.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Controlled roadmap:&lt;/strong&gt; The organization sets retraining cadence, performance thresholds, and feature priorities on its own timeline.&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  How To Choose the Best Custom AI/ML Development Partner?
&lt;/h2&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Production track record:&lt;/strong&gt; Look for evidence that the partner has moved models into live systems, not only built prototypes. Ask for named deployments with monitoring, retraining, and measured business results.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Data engineering depth:&lt;/strong&gt; Models are only as good as the pipelines behind them. Confirm the partner can handle ingestion, data quality, feature engineering, and governance on your existing platforms.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Platform and cloud alignment:&lt;/strong&gt; Verify certified expertise on your primary cloud and ML platforms, such as Azure Machine Learning, Amazon SageMaker, Google Vertex AI, or Databricks. Alignment shortens delivery and reduces integration risk.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;MLOps and deployment maturity:&lt;/strong&gt; Assess CI/CD for models, model registries, drift monitoring, and rollback procedures. A model without an operating plan degrades quickly in production.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Responsible AI and governance:&lt;/strong&gt; Require documented practices for bias testing, explainability, security review, and human oversight, especially in regulated industries.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Delivery model and team continuity:&lt;/strong&gt; Clarify whether the team is onshore, nearshore, or offshore, and how knowledge transfers at the end of the engagement. Continuity of named engineers often matters as much as seniority.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Industry context:&lt;/strong&gt; Partners with experience in your sector understand regulatory constraints, data availability, and the workflows where models create the most value.&lt;/li&gt;
&lt;li&gt;Buyers should also put these questions to every shortlisted firm. How many of your AI projects reached production in the last two years, and what outcomes were measured? Who owns the model weights, training data, and code at the end of the engagement? How do you monitor model performance after launch, and who is accountable when accuracy drops?&lt;/li&gt;
&lt;/ul&gt;

&lt;blockquote&gt;
&lt;p&gt;Bottom line: the strongest partners combine verified production results, governed MLOps, and platform expertise that matches your existing environment.&lt;/p&gt;
&lt;/blockquote&gt;

&lt;h2&gt;
  
  
  Custom AI/ML Development Companies Compared
&lt;/h2&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2F0fhq5fa1xn4g1e6se5ci.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2F0fhq5fa1xn4g1e6se5ci.png" alt="Image - Top Custom AI/ML Development Companies for Production-Ready Models" width="800" height="691"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;h2&gt;
  
  
  Top Custom AI/ML Development Companies
&lt;/h2&gt;

&lt;h3&gt;
  
  
  1. Improving
&lt;/h3&gt;

&lt;p&gt;Improving Enterprises builds custom AI and machine learning systems for enterprises across predictive analytics, natural language processing, computer vision, and intelligent automation. Its delivery follows a 5D framework of Discovery, Design, Develop, Demonstrate, and Deploy, pairing consulting-led strategy with engineering-led execution. The firm remains platform-agnostic while maintaining named partnerships with Microsoft, AWS, and Google Cloud.&lt;/p&gt;

&lt;h4&gt;
  
  
  Why Is Improving the Best Custom AI/ML Development Partner?
&lt;/h4&gt;

&lt;p&gt;We pair structured delivery governance with a lifecycle framework built for models, so each solution moves from discovery through deployment with defined handoffs and accountable owners. Our custom AI work is designed to fit the cloud, data, and operating environments our clients already run.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;NPS 90+:&lt;/strong&gt; among the highest in modern enterprise technology services.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;7.5-year average partnership length:&lt;/strong&gt; built around long-term relationships, not one-off projects.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Global footprint:&lt;/strong&gt; 7+ countries, 3 continents, 21 offices, and 2,500+ consultants.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key verticals:&lt;/strong&gt; healthcare, financial services, energy, logistics, and automotive.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Platform stack:&lt;/strong&gt; Azure Machine Learning, Amazon SageMaker and Bedrock, Vertex AI, and Databricks.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Relevant strengths:&lt;/strong&gt; full-lifecycle AI delivery, NLP and computer vision expertise, and fairness and explainability reviews.&lt;/li&gt;
&lt;/ul&gt;

&lt;h4&gt;
  
  
  Global Delivery Access
&lt;/h4&gt;

&lt;p&gt;Improving can place an embedded engineer directly inside a client's delivery teams for the length of an engagement. In one banking engagement, a full-time on-site engineer worked alongside the client's software teams for three months while Improving ran biweekly training sessions alongside that work.&lt;/p&gt;

&lt;h4&gt;
  
  
  Proven Track Record
&lt;/h4&gt;

&lt;p&gt;Topgolf's engineering teams used AI sporadically and needed a repeatable approach. A 12-week Deep Learning Program, combining classroom sessions with embedded mentorship, raised self-assessed AI usage and confidence by 15%. First United Bank's software delivery teams had uneven AI maturity and rising token costs. A full-time AI engineer and structured training cut idea-to-user-story time from 70 hours to 11 and saved an estimated $40,000 on one migration project. Read the full &lt;a href="https://www.improving.com/case-studies/topgolf-deep-learning-program" rel="noopener noreferrer"&gt;Topgolf&lt;/a&gt; and &lt;a href="https://www.improving.com/case-studies/first-united-bank" rel="noopener noreferrer"&gt;First United Bank&lt;/a&gt; case studies.&lt;/p&gt;

&lt;h4&gt;
  
  
  Strategic Advantage
&lt;/h4&gt;

&lt;p&gt;Improving's custom AI and ML development covers the full model lifecycle:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Model design and architecture:&lt;/strong&gt; Technical strategy, feature selection, and model types aligned with business and data constraints.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Supervised and unsupervised learning:&lt;/strong&gt; Custom classification, regression, clustering, and anomaly detection models for actionable insight.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;NLP and computer vision development:&lt;/strong&gt; Language and image-based models for intelligent automation, summarization, search, and more.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Model training and evaluation:&lt;/strong&gt; Real-world validation, hyperparameter tuning, and fairness, explainability, and bias checks.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Production deployment and integration:&lt;/strong&gt; Models packaged and served through CI/CD, APIs, and containerized environments for secure, scalable production use.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;These services are backed by Microsoft Solutions Partner status, AWS and Google Cloud partnerships, and certifications including Microsoft Azure AI Engineer, AWS Machine Learning, Google Cloud Machine Learning, Databricks Data Engineer Professional, and SnowPro Core. &lt;a href="https://www.improving.com/expertise/ai/custom-ai-ml-development/" rel="noopener noreferrer"&gt;Explore Improving's custom AI and machine learning development services&lt;/a&gt;.&lt;/p&gt;

&lt;h3&gt;
  
  
  2. IBM
&lt;/h3&gt;

&lt;p&gt;IBM combines its watsonx AI and data platform with IBM Consulting to deliver enterprise AI across hybrid cloud environments. Its governed AI deployments and modernization programs serve large, regulated organizations. Its custom model work typically sits within broader transformation programs.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Headquartered:&lt;/strong&gt; Armonk, New York, USA&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Team Size:&lt;/strong&gt; 250,000+&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key verticals:&lt;/strong&gt; financial services, healthcare, government, telecommunications&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key platforms/technologies:&lt;/strong&gt; watsonx, Red Hat OpenShift AI, hybrid cloud&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Relevant strengths:&lt;/strong&gt; enterprise AI governance and hybrid deployment&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Why Consider IBM?&lt;/strong&gt; IBM is a strong choice when a buyer needs AI deployed within a hybrid architecture under strict governance controls.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Talent Pool Access:&lt;/strong&gt; IBM Consulting draws on a global workforce and can staff large, multi-year programs with specialized AI, data, and industry teams.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Proven Track Record:&lt;/strong&gt; IBM offers watsonx as its enterprise AI platform and runs hybrid cloud modernization programs for large regulated organizations.&lt;/p&gt;

&lt;h3&gt;
  
  
  3. Accenture
&lt;/h3&gt;

&lt;p&gt;Accenture delivers AI and data services spanning strategy, custom model engineering, and industry-specific solutions for large enterprises. Its strength is scaling AI across complex organizations, backed by partnerships with major hyperscale cloud and AI platforms. Its AI practice combines consulting, engineering, and change management in a single engagement model.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Headquartered:&lt;/strong&gt; Dublin, Ireland&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Team Size:&lt;/strong&gt; 700,000+&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key verticals:&lt;/strong&gt; financial services, health, consumer goods, public service&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key platforms/technologies:&lt;/strong&gt; Microsoft Azure, AWS, Google Cloud, Databricks&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Relevant strengths:&lt;/strong&gt; scale and industry depth&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Why Consider Accenture?&lt;/strong&gt; Accenture fits enterprises that need AI transformation across many business units, countries, and functions at once.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Talent Pool Access:&lt;/strong&gt; Accenture staffs programs across dozens of countries, with large capacity in AI, data engineering, and cloud.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Proven Track Record:&lt;/strong&gt; Accenture operates in more than 120 countries, with AI and data work spread across its industry practices.&lt;/p&gt;

&lt;h3&gt;
  
  
  4. McKinsey &amp;amp; Company
&lt;/h3&gt;

&lt;p&gt;McKinsey &amp;amp; Company pairs strategy consulting with AI engineering through QuantumBlack, its AI and advanced analytics arm. Its AI work connects investment to enterprise strategy, operating model change, and measurable economic impact. Its custom AI work is typically led by senior consultants with engineering teams embedded in the program.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Headquartered:&lt;/strong&gt; New York, New York, USA&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Team Size:&lt;/strong&gt; 40,000+&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key verticals:&lt;/strong&gt; financial services, healthcare, energy, consumer and retail&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key platforms/technologies:&lt;/strong&gt; QuantumBlack AI, generative AI tooling, cloud platforms&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Relevant strengths:&lt;/strong&gt; strategy-to-value alignment and executive governance&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Why Consider McKinsey &amp;amp; Company?&lt;/strong&gt; McKinsey suits executive teams that need AI investments tied to board-level strategy and a defined business case before any build begins.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Talent Pool Access:&lt;/strong&gt; McKinsey's global consultant base and QuantumBlack engineers can staff cross-functional teams across regions.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Proven Track Record:&lt;/strong&gt; McKinsey built Lilli, its internal generative AI assistant, and advises large enterprises across industries on AI-driven transformation.&lt;/p&gt;

&lt;h3&gt;
  
  
  5. BCG
&lt;/h3&gt;

&lt;p&gt;Boston Consulting Group works on AI through BCG X, its technology and AI unit, which builds custom models and AI products alongside BCG's strategy consultants. BCG links AI programs to business value and redesigns operating models around them. Engagements often pair product and data science teams with change management.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Headquartered:&lt;/strong&gt; Boston, Massachusetts, USA&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Team Size:&lt;/strong&gt; 30,000+&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key verticals:&lt;/strong&gt; financial services, healthcare, industrials, consumer&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key platforms/technologies:&lt;/strong&gt; generative AI platforms, predictive analytics, cloud platforms&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Relevant strengths:&lt;/strong&gt; product-led AI development, strategy alignment, change management&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Why Consider BCG?&lt;/strong&gt; BCG fits organizations that want AI embedded across products and operating models.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Talent Pool Access:&lt;/strong&gt; BCG X combines data scientists, engineers, and designers with BCG's consultant network across its global offices.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Proven Track Record:&lt;/strong&gt; BCG rolled out generative AI tools across its own consultant workforce and works with multinational clients on AI product and transformation programs.&lt;/p&gt;

&lt;h3&gt;
  
  
  6. LeewayHertz
&lt;/h3&gt;

&lt;p&gt;LeewayHertz is an AI consulting and development firm that builds custom generative AI, machine learning, and agent-based solutions for enterprise and mid-market clients. It offers ZBrain, a low-code platform for orchestrating generative AI applications. Its focus is short build cycles on defined AI use cases.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Headquartered:&lt;/strong&gt; Gurgaon, India&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Team Size:&lt;/strong&gt; 100-500&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key verticals:&lt;/strong&gt; financial services, healthcare, logistics, manufacturing&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key platforms/technologies:&lt;/strong&gt; ZBrain, generative AI and large language model frameworks, cloud AI services&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Relevant strengths:&lt;/strong&gt; generative AI orchestration and focused build cycles&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Why Consider LeewayHertz?&lt;/strong&gt; LeewayHertz is a practical choice for teams that want custom generative AI and agent-based applications delivered on a focused scope and timeline.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Talent Pool Access:&lt;/strong&gt; Its engineering team is based in India, which supports cost-efficient staffing for ongoing AI development work.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Proven Track Record:&lt;/strong&gt; Clutch lists the firm with more than 15 years of experience, and its ZBrain platform supports production generative AI applications.&lt;/p&gt;

&lt;h3&gt;
  
  
  7. Cleveroad
&lt;/h3&gt;

&lt;p&gt;Cleveroad is a custom software and AI development company that builds machine learning solutions for product companies and regulated sectors, including healthcare and fintech. Its work combines end-to-end product development with AI features and web and mobile engineering. The firm emphasizes its Clutch recognition in market materials.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Headquartered:&lt;/strong&gt; Tallinn, Estonia&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Team Size:&lt;/strong&gt; 250-999&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key verticals:&lt;/strong&gt; healthcare, fintech, retail, logistics&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key platforms/technologies:&lt;/strong&gt; machine learning frameworks, cloud AI services, web and mobile stacks&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Relevant strengths:&lt;/strong&gt; end-to-end product development for healthcare and fintech&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Why Consider Cleveroad?&lt;/strong&gt; Cleveroad suits organizations that want AI embedded in a complete product, from discovery and design through engineering and support.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Talent Pool Access:&lt;/strong&gt; Cleveroad operates development teams from Estonia and maintains a U.S. presence, which supports both European and North American engagements.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Proven Track Record:&lt;/strong&gt; Clutch lists more than 80 verified reviews for Cleveroad with an average rating of 4.9 out of 5, and the firm reports a place on the Clutch 1000 list for 2025.&lt;/p&gt;

&lt;h3&gt;
  
  
  8. Innowise
&lt;/h3&gt;

&lt;p&gt;Innowise is a software engineering company that delivers AI and machine learning solutions alongside custom software, data services, and cybersecurity. Its engineering capacity scales, and it staffs specialized AI teams on client programs. Its AI work covers both custom model development and integration into enterprise systems.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Headquartered:&lt;/strong&gt; Warsaw, Poland&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Team Size:&lt;/strong&gt; 3,500+&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key verticals:&lt;/strong&gt; fintech, enterprise software, retail, healthcare&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key platforms/technologies:&lt;/strong&gt; AI and ML frameworks, cloud platforms, custom software stacks&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Relevant strengths:&lt;/strong&gt; scalable engineering capacity with multi-country delivery&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Why Consider Innowise?&lt;/strong&gt; Innowise is a fit for buyers that need dedicated AI engineering capacity at scale alongside broader software delivery.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Talent Pool Access:&lt;/strong&gt; With more than 3,500 IT professionals and offices in the United States, Poland, Germany, the United Kingdom, Italy, and the UAE, Innowise can staff multi-country programs.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Proven Track Record:&lt;/strong&gt; Innowise reports more than 1,600 completed projects and lists 2026 industry recognitions on its About page, with AI and data solutions named as a core service on its Clutch profile.&lt;/p&gt;

&lt;h3&gt;
  
  
  9. XenonStack
&lt;/h3&gt;

&lt;p&gt;XenonStack builds agentic AI, computer vision, and data platform solutions for enterprises that need AI systems in live operation. It combines agent orchestration with data engineering and observability. The firm focuses on live systems across analytics and vision use cases.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Headquartered:&lt;/strong&gt; Mohali, India&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Team Size:&lt;/strong&gt; 50-249&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key verticals:&lt;/strong&gt; industrial operations, logistics, enterprise analytics&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key platforms/technologies:&lt;/strong&gt; agentic AI frameworks, computer vision, operational data pipelines&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Relevant strengths:&lt;/strong&gt; agentic AI systems and computer vision&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Why Consider XenonStack?&lt;/strong&gt; XenonStack is worth considering for organizations that need agentic or vision-based AI systems built on their operational data.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Talent Pool Access:&lt;/strong&gt; Its engineering team is based in India and organized into focused, senior-led squads suited to a defined AI scope.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Proven Track Record:&lt;/strong&gt; XenonStack's Clutch profile shows verified client reviews, and the firm publishes case material on agentic AI and vision deployments.&lt;/p&gt;

&lt;h3&gt;
  
  
  10. Algoscale
&lt;/h3&gt;

&lt;p&gt;Algoscale is a data and AI engineering firm that builds machine learning models, data pipelines, and analytics solutions for business clients. Its practice centers on data-led AI engineering with a focus on deployment. The firm has been operating since 2014.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Headquartered:&lt;/strong&gt; Noida, India (delivery center; a U.S. office is listed in Newark, New Jersey)&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Team Size:&lt;/strong&gt; 50-249&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key verticals:&lt;/strong&gt; technology and enterprise data&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key platforms/technologies:&lt;/strong&gt; machine learning frameworks, cloud data platforms, analytics tooling&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Relevant strengths:&lt;/strong&gt; data engineering and ML model development&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Why Consider Algoscale?&lt;/strong&gt; Algoscale suits mid-sized organizations that need data engineering and ML model development delivered by one partner.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Talent Pool Access:&lt;/strong&gt; Its team of 50 to 249 people is small enough for focused squads and broad enough to cover data engineering and ML roles.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Proven Track Record:&lt;/strong&gt; Algoscale has been recognized as a Clutch Champion and reports a 4.9 overall Clutch rating across 12 reviews.&lt;/p&gt;

&lt;h2&gt;
  
  
  Building a Custom AI/ML Partnership That Reaches Production
&lt;/h2&gt;

&lt;p&gt;Custom AI and machine learning development delivers value only when models reach live use, stay governed, and improve through retraining. The companies in this guide cover a wide range of delivery models, from strategy-led consultancies to engineering-focused firms, so the right choice depends on the outcome you need first.&lt;/p&gt;

&lt;p&gt;At Improving, we pair model engineering with certified cloud expertise and a structured delivery lifecycle. Our Topgolf and First United Bank engagements produced a 15% increase in AI adoption and confidence and reduced idea-to-user-story time from 70 hours to 11.&lt;/p&gt;

&lt;p&gt;Ready to scope your first production model? Explore our &lt;a href="https://www.improving.com/expertise/ai/custom-ai-ml-development/" rel="noopener noreferrer"&gt;custom AI and machine learning development services.&lt;/a&gt;&lt;/p&gt;

&lt;h2&gt;
  
  
  Frequently Asked Questions
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;1) What is the difference between custom AI development and off-the-shelf AI tools?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Off-the-shelf tools are built for common tasks and trained on general data, so they often fall short on the specific workflows and data a business relies on. Custom development trains models on the organization's own data and integrates them with existing systems. The tradeoff is a larger upfront investment in data work, engineering, and governance.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;2) How long does a custom machine learning project usually take?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Timelines depend on data readiness and scope. A focused proof of concept can often be completed in weeks, while a production deployment with integration, monitoring, and governance typically takes several months. Partners that show a clear path from proof of concept to production reduce the risk of a stalled pilot.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;3) What data do we need before starting a custom AI project?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;You need labeled or otherwise usable historical data that reflects the decision the model will support, along with access rights and documentation of its quality. A good partner will run a data assessment during discovery to identify gaps before committing to a build plan.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;4) How do we measure ROI on a custom AI model?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Define the business metric before development begins, such as processing time, conversion rate, forecast accuracy, or cost per transaction. Track that metric against a baseline after deployment, and monitor model performance over time so gains do not erode.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;5) Should we build an AI capability in-house or hire a partner?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Most organizations use a hybrid approach. A partner can deliver the first production models and train internal teams, while internal staff take ownership of retraining and operations over time. The right mix depends on how much AI work is ongoing and how quickly you need results.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;6) Who should own the model and training data after the engagement ends?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Your contract should state that the organization owns the code, model artifacts, and training data, along with documentation and handoff requirements. Clarify this before signing, since ownership terms vary widely across vendors.&lt;/p&gt;

</description>
      <category>ai</category>
      <category>machinelearning</category>
    </item>
    <item>
      <title>Role-Based AI Training for Employees That Drives Adoption</title>
      <dc:creator>Improving</dc:creator>
      <pubDate>Fri, 13 Nov 2026 06:00:00 +0000</pubDate>
      <link>https://dev.to/improving/role-based-ai-training-for-employees-that-drives-adoption-5dmh</link>
      <guid>https://dev.to/improving/role-based-ai-training-for-employees-that-drives-adoption-5dmh</guid>
      <description>&lt;p&gt;Most of the companies I talk to have bought AI tools for their employees. Few have a plan for what happens after the licenses activate. That gap is where AI training for employees stops being a nice-to-have and becomes the difference between a tool that pays for itself and a tool that gets ignored.&lt;/p&gt;

&lt;p&gt;The pattern repeats inside my own company as much as inside client organizations. Leadership announces an AI initiative. The people who were already curious dive in. Usage looks great for a quarter. Then the initiative stalls, because everyone who was going to adopt AI on their own already has, and the people left need a structured path to change how they work.&lt;/p&gt;

&lt;h2&gt;
  
  
  What AI Training for Employees Includes
&lt;/h2&gt;

&lt;p&gt;AI training for employees, sometimes called corporate AI training, is a designed program that moves people from having access to an AI tool to doing their job differently with it.&lt;/p&gt;

&lt;p&gt;A single webinar does not qualify. A program has a defined audience, a defined outcome, a period of applied practice, and a way to tell whether anyone changed their work afterward.&lt;/p&gt;

&lt;p&gt;The rest of this blog post covers what happens when those pieces are missing and what they look like when they are present. Our &lt;a href="https://www.improving.com/services/training/ai/" rel="noopener noreferrer"&gt;AI training program&lt;/a&gt; is built around them.&lt;/p&gt;

&lt;h2&gt;
  
  
  The Cost of Skipping AI Training for Employees
&lt;/h2&gt;

&lt;p&gt;An AI seat license without a trained user behind it costs more than the license fee. It also forfeits the productivity gain the business case was built on, plus a quieter cost. Every unused seat becomes evidence, inside the organization, that the AI initiative was hype. It is proof the program works for the people who need the least help.&lt;/p&gt;

&lt;p&gt;I have sat in the planning meetings where this gets decided. The mistake I see most is treating training as a single event: a one-hour kickoff webinar, a link to a vendor's onboarding video, an email that says "here's your new AI assistant, have at it."&lt;/p&gt;

&lt;p&gt;The result is strong early usage from people who did not need training and near-zero uptake from everyone else, because nobody built an on-ramp for people who do not change how they work after one session. Our post on &lt;a href="https://www.improving.com/thoughts/why-most-ai-training-fails/" rel="noopener noreferrer"&gt;why most AI training fails&lt;/a&gt; covers the wider pattern.&lt;/p&gt;

&lt;h2&gt;
  
  
  Design AI Training for Employees as a System
&lt;/h2&gt;

&lt;p&gt;I built a corporate learning program once, long before generative AI, on the belief that values without operational structure are wishes. You can say you value learning in every all-hands. If the learning that happens depends on which individuals are self-motivated enough to pursue it on their own time, you have an uneven capability curve. Teams with a few strong self-directed learners pull the rest of the team up. Other teams stay flat while their competitors compound.&lt;/p&gt;

&lt;p&gt;AI adoption training works the same way. The organizations that get real adoption design a cadence, define what completion means, and build a mechanism that keeps the learning compounding after the session ends.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;A workshop produces exposure. Only applied practice with accountability produces behavior change.&lt;/strong&gt; Between "I attended a session" and "I now do my job differently" sits a period of applied practice. Accountability can be a follow-on assignment, a peer check-in, or a manager conversation that references what was learned.&lt;/p&gt;

&lt;p&gt;A structured program closes that gap by building the practice period in from the start.&lt;/p&gt;

&lt;h2&gt;
  
  
  Build Role-Based AI Training for Employees
&lt;/h2&gt;

&lt;p&gt;The biggest design mistake I see is skipping role-based training and running one curriculum for the whole company. A developer, a project manager, and a sales representative do not do the same job. A single generic course has to stay shallow enough to be relevant to all three, so it serves none of them.&lt;/p&gt;

&lt;p&gt;When we designed our own internal AI upskilling program, the version that worked split into tracks by role:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Developers and delivery professionals:&lt;/strong&gt; The largest group and the one with the clearest path from using AI as a tool to building agentic workflows with it. They got a multi-course sequence from basic tool fluency to building and operating task-level automation.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Information workers:&lt;/strong&gt; Project managers, business analysts, and process owners who touch delivery without writing code. They got a track calibrated to what their job requires them to do with AI, not a stripped-down developer curriculum.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Executives:&lt;/strong&gt; The group with the most influence over adoption. They got a compressed, high-touch series that moved people who had never opened the tool to functional AI literacy.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Three role-based tracks deliver more than one generic course. A generic course has to stay vague enough to apply to everyone, which leaves it too vague to help anyone. A role-based track goes deep on the workflows a given employee will run, and that depth is what produces behavior change.&lt;/p&gt;

&lt;h3&gt;
  
  
  What We Learned From the 150-Consultant Rollout That Failed
&lt;/h3&gt;

&lt;p&gt;An early push went out to roughly 150 consultants on the bench. They were the group with the most open time to learn and, on paper, the clearest incentive. Fifteen replied. Fewer than twenty enrolled. Some directors and VPs waved off the invitation outright.&lt;/p&gt;

&lt;p&gt;Fifteen replied to the invitation, a 10% response rate. Fewer than twenty enrolled, which is below 13% of the group.&lt;/p&gt;

&lt;p&gt;One generic invitation sent to a population that ran from junior developers to VP-level architects could not tell any single person what to learn or what finishing would change about their job. Engagement turned around once the tracks split by role and "done" meant something specific for each one. For more on why this happens almost everywhere it is tried, see our blog post on why AI projects fail from &lt;a href="https://www.improving.com/thoughts/top-10-reasons-ai-projects-fail/lack-of-talent-and-team-alignment/" rel="noopener noreferrer"&gt;lack of talent and team alignment&lt;/a&gt;.&lt;/p&gt;

&lt;h2&gt;
  
  
  Measure AI Adoption Alongside Completion
&lt;/h2&gt;

&lt;p&gt;Two numbers separate AI training programs for employees that look successful from ones that are.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Completion means someone finished every defined step of a course.&lt;/li&gt;
&lt;li&gt;Adoption means someone is measurably using what they learned three months later.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;The gap between them is where I see training investments stall most often.&lt;/p&gt;

&lt;p&gt;I have watched people register for a course, show up for a few minutes to satisfy an attendance requirement, and never touch the material again.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;If your metric is registration or completion, that person is a win.&lt;/li&gt;
&lt;li&gt;If your metric is whether people build workflows, run agents, or change how they approach a task, that person is wasted spend.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Track completion and adoption as two separate numbers, and close the gap between them.&lt;/p&gt;

&lt;p&gt;The first wave of participants is the group that is already curious enough to volunteer. Every organization I have watched roll out AI training gets strong early engagement from this group and reads it as proof the program works. It is proof the program works for the people who need the least help.&lt;/p&gt;

&lt;p&gt;Two harder groups come next:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Second wave&lt;/strong&gt;: People who need to be convinced the time investment is worth it before they engage.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Third wave:&lt;/strong&gt; People who are actively skeptical.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;A program designed around the first wave's enthusiasm breaks down once it reaches the second and third. The content, pacing, and pitch that worked on volunteers land differently on people who showed up because they were told to.&lt;/p&gt;

&lt;p&gt;Plan for the full curve from day one, so you are not discovering in month four that what worked in month one has stopped working.&lt;/p&gt;

&lt;h2&gt;
  
  
  Check Your AI Training Program Against Four Traits
&lt;/h2&gt;

&lt;p&gt;Four traits separate good AI training for employees from the kind that fills a calendar.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Role-specific content:&lt;/strong&gt; What a developer, an information worker, and an executive each need to do differently, not one deck stretched across all three.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Completion that means capability:&lt;/strong&gt; A clear statement of what someone should be able to do afterward that they could not do before.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;A built-in applied-practice period:&lt;/strong&gt; Real work with accountability attached after the initial session.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;A plan for the whole adoption curve:&lt;/strong&gt; A different approach for the skeptics than for the volunteers.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Before you sign off on the next training budget, pull your own numbers. How many people completed every step of the program, and how many still use what they learned three months later? If those two numbers live in different systems, or nobody has put them side by side, that is the gap to close first. What would your organization's comparison show?&lt;/p&gt;

&lt;p&gt;If you are designing or rescuing an AI training program, Improving can help you build role-based tracks, define what completion means for each one, and measure adoption three months out. &lt;a href="https://www.improving.com/contact/" rel="noopener noreferrer"&gt;Talk with our team about AI training for employees&lt;/a&gt;.&lt;/p&gt;

&lt;h2&gt;
  
  
  FAQ
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;What is an applied-practice period?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;A period after the workshop where people do real work with what they learned, with accountability attached. That can be a follow-on assignment, a peer check-in, or a manager conversation that references the training.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Should everyone get the same AI training?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;No. A generic course stays shallow enough to apply to everyone, so it helps no one. Split by role, based on what each role does with AI.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;What if completion and usage numbers live in different systems?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Pull them anyway and compare by hand. Putting the two side by side for the first time is the gap to close first.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Why does enterprise AI adoption stall after the first quarter?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;The employees curious enough to volunteer adopt early, and everyone else needs structure to change how they work. Without role-specific content, applied practice, and a plan for skeptics, enterprise AI adoption flattens once the volunteers are done.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;How do we reach employees who will not volunteer?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Tell each person specifically what to learn and what finishing will change about their job. The 150-consultant invitation failed because a generic message could not tell anyone either.&lt;/p&gt;

&lt;p&gt;If you are designing or rescuing an AI training program, I am happy to talk it through. &lt;a href="https://www.improving.com/contact/" rel="noopener noreferrer"&gt;Reach out and we can set up a conversation&lt;/a&gt;&lt;/p&gt;

</description>
      <category>ai</category>
      <category>machinelearning</category>
    </item>
    <item>
      <title>Improving Expands Its AI Leadership with a New Central Team Across Innovation and Acceleration</title>
      <dc:creator>Improving</dc:creator>
      <pubDate>Fri, 13 Nov 2026 05:59:05 +0000</pubDate>
      <link>https://dev.to/improving/improving-expands-its-ai-leadership-with-a-new-central-team-across-innovation-and-acceleration-3ehi</link>
      <guid>https://dev.to/improving/improving-expands-its-ai-leadership-with-a-new-central-team-across-innovation-and-acceleration-3ehi</guid>
      <description>&lt;p&gt;&lt;em&gt;Centers of Excellence in the US, Canada, and Mexico and a dedicated acceleration practice extend Improving’s AI momentum into its next phase of delivery.&lt;/em&gt;&lt;/p&gt;

&lt;p&gt;Improving has created a central AI leadership team that will grow the company’s capacity for complex AI programs, bring consistent standards to AI delivery in every country, and help clients move faster with AI. Five technology leaders have stepped into expanded roles, effective October 1, to guide this work across two areas: Innovation and Acceleration. The team builds on Improving’s continued investment in AI and gives that growth a dedicated leadership structure. All five will stay active in their local technology and business communities.&lt;/p&gt;

&lt;p&gt;"These improvers have helped to establish Improving as a market leader in Enterprise AI, and with the formation of this leadership team we are well positioned for the direction the industry is taking into the future" said Devlin Liles, Chief AI Officer at Improving.&lt;/p&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2F2lksxg10dax59jbhuir2.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2F2lksxg10dax59jbhuir2.png" alt="Image 1 - Improving Expands Its AI Leadership with a New Central Team Across Innovation and Acceleration" width="800" height="1000"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Innovation: Centers of Excellence by country&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Three leaders are building Innovation Centers of Excellence in their home countries. They are working with Improving’s country leadership to expand the company’s capacity for complex AI programs. They are also defining role standards and profiles for AI/ML team leads and solutions architects, so the same title carries the same meaning in every country. That consistency matters most on the most demanding AI-centric engagements, where teams build new ways for software to make an impact.&lt;/p&gt;

&lt;p&gt;The Innovation leaders are:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Michael Slater&lt;/strong&gt;, VP of Technology, Head of AI US&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Michael Ell&lt;/strong&gt;, VP of Technology, Head of AI Canada&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Luis Gerardo&lt;/strong&gt;, VP of Technology, Head of AI Mexico&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  &lt;strong&gt;Acceleration: Moving Improving and its clients faster&lt;/strong&gt;
&lt;/h2&gt;

&lt;p&gt;Two leaders are focused on accelerating both Improving’s own business and the businesses of its clients.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Tim Rayburn&lt;/strong&gt;, VP of Technology, Head of AI Transformation, has led programs that trained more than 10,000 internal and external professionals on effective AI usage, and those programs have produced measurable results. He continues to lead Improving’s internal and external AI transformation offerings, expanding the learning programs and advancing Improving’s own AI maturity along with that of its clients.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Bill Curry&lt;/strong&gt;, VP of Technology, Head of Microsoft AI, is expanding his focus to lead forward-deployed engineering. The next frontier in AI is deep integration with business operations, and Improving is growing its forward-deployed engineering teams to work directly with business groups outside of IT, such as operations and finance. The work starts on the Microsoft stack and builds on the Microsoft and AI leadership Bill already provides.&lt;/p&gt;

&lt;h2&gt;
  
  
  &lt;strong&gt;What comes next&lt;/strong&gt;
&lt;/h2&gt;

&lt;p&gt;All five leaders bring sales support and sales engineering strengths. Each will set aside dedicated time for innovation, training, and building their Centers of Excellence. Improving will share more about their work over the next several quarters.&lt;/p&gt;

&lt;p&gt;"Improving has pour in tremendous resources and effort into growing the next generation of technical skills and careers, and we are already seeing the industry follow that lead. The investments will continue to maintain our pole position in this disruptive wave as we help both our employees and clients navigate the next several years" said Devlin Liles, Chief AI Officer.&lt;/p&gt;

&lt;p&gt;&lt;a href="https://www.improving.com/thoughts/newsroom/?category=News%20%26%20Announcements" rel="noopener noreferrer"&gt;News &amp;amp; Announcements&lt;/a&gt;&lt;/p&gt;

</description>
      <category>news</category>
      <category>ai</category>
    </item>
    <item>
      <title>Leading Data Strategy &amp; Governance Companies: What to Look for in a Partner</title>
      <dc:creator>Improving</dc:creator>
      <pubDate>Fri, 13 Nov 2026 05:58:25 +0000</pubDate>
      <link>https://dev.to/improving/leading-data-strategy-governance-companies-what-to-look-for-in-a-partner-3m9h</link>
      <guid>https://dev.to/improving/leading-data-strategy-governance-companies-what-to-look-for-in-a-partner-3m9h</guid>
      <description>&lt;p&gt;Every organization reaches a point where its data has outgrown its informal rules, and that is when strategy and governance become essential. Whether you are launching a first governance program or realigning an existing one, this guide introduces firms with different strengths, from global advisory networks to specialist engineering teams. It also explains the questions that help you match a partner to your goals, platforms, and regulatory environment.&lt;/p&gt;

&lt;h2&gt;
  
  
  &lt;strong&gt;Executive Summary&lt;/strong&gt;
&lt;/h2&gt;

&lt;p&gt;Data strategy and governance is the practice of defining a long-term vision for data and establishing the ownership, policies, and controls that keep data accurate, compliant, and usable. It delivers value by aligning data investments with business outcomes and by giving leaders reporting they can trust.&lt;/p&gt;

&lt;p&gt;This guide profiles 10 leading data strategy and governance companies and outlines how to assess partners based on delivery model, governance framework expertise, platform experience, regulatory fit, and measurable outcomes. It also compares team scale, headquarters, and best-fit use cases so buyers can build a shortlist that matches their goals.&lt;/p&gt;

&lt;h2&gt;
  
  
  &lt;strong&gt;Who Is This Guide For?&lt;/strong&gt;
&lt;/h2&gt;

&lt;ul&gt;
&lt;li&gt;Chief Data Officers responsible for enterprise data strategy and governance programs&lt;/li&gt;
&lt;li&gt;CIOs and CTOs deciding how to modernize data architecture and controls&lt;/li&gt;
&lt;li&gt;VPs of Data or Analytics building a roadmap that connects data to business priorities&lt;/li&gt;
&lt;li&gt;Procurement and sourcing leads evaluating consulting partners for multi-year data initiatives&lt;/li&gt;
&lt;li&gt;Compliance, risk, and privacy leaders who need enforceable data standards&lt;/li&gt;
&lt;/ul&gt;

&lt;blockquote&gt;
&lt;p&gt;All of these buyers share a goal: turning data into a governed, business-ready asset that supports confident decisions.&lt;/p&gt;
&lt;/blockquote&gt;

&lt;h2&gt;
  
  
  &lt;strong&gt;What Is Data Strategy &amp;amp; Governance and How Does It Work?&lt;/strong&gt;
&lt;/h2&gt;

&lt;p&gt;Data strategy defines where an organization wants to take its data capabilities and in what order, while data governance sets the rules for ownership, quality, access, privacy, and lineage. Together, they connect executive priorities to the standards and tooling that data teams use every day. Effective programs typically combine a phased roadmap, a governance operating model, and technical enforcement built on the organization's existing platforms.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Strategy-led engagements that start with a data vision, maturity assessment, and prioritized roadmap&lt;/li&gt;
&lt;li&gt;Governance-framework engagements that establish data ownership roles, policies, stewardship councils, and standards&lt;/li&gt;
&lt;li&gt;Platform-embedded governance that implements cataloging, lineage, classification, and access controls in tools such as Microsoft Purview or Databricks Unity Catalog&lt;/li&gt;
&lt;li&gt;Managed or ongoing governance that operates the program after initial design and handoff&lt;/li&gt;
&lt;/ul&gt;

&lt;h3&gt;
  
  
  &lt;strong&gt;Key Advantages of Data Strategy &amp;amp; Governance&lt;/strong&gt;
&lt;/h3&gt;

&lt;p&gt;A well-run program delivers benefits that reach past the data team and into everyday decisions.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Clear business alignment&lt;/strong&gt; ensures data investments fund the priorities that matter most to the executive team.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Single ownership model&lt;/strong&gt; assigns accountable owners for critical data domains, reducing conflicting definitions and duplicated work.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Trusted reporting&lt;/strong&gt; gives leaders consistent metrics because data quality rules and lineage are enforced at the source.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Reduced compliance exposure&lt;/strong&gt; embeds privacy and regulatory controls into daily data operations, so compliance does not depend on periodic audits.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Faster analytics delivery&lt;/strong&gt; removes the rework that comes from unclear standards, letting data teams build on governed foundations.&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  &lt;strong&gt;How To Choose the Best Data Strategy &amp;amp; Governance Partner?&lt;/strong&gt;
&lt;/h2&gt;

&lt;p&gt;The right partner fit depends on your goals, your platforms, and the regulations you operate under. These criteria help you compare firms on those terms.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Business outcome orientation:&lt;/strong&gt; Look for a partner that begins with executive goals and ties every roadmap phase to a measurable result. Firms that start with tooling alone often deliver controls nobody uses.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Governance framework fluency:&lt;/strong&gt; Confirm the team works from recognized frameworks such as the DAMA Data Management Body of Knowledge (DMBOK) and can explain how they adapt those standards to your operating model. Ask for examples of ownership structures they have implemented.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Platform expertise:&lt;/strong&gt; Your partner should be fluent in the platforms you already run, whether that is Microsoft Purview, Snowflake, or Databricks. Vendor partnerships and certifications are a useful signal of depth.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Regulatory and industry experience:&lt;/strong&gt; Privacy and compliance requirements vary by sector and geography. Prioritize firms with documented work in regulated industries similar to yours.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Delivery model fit:&lt;/strong&gt; Decide whether you need onshore strategy leadership, nearshore or offshore implementation capacity, or a blend. Confirm how the firm manages governance, communication, and quality across locations.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Change management capability:&lt;/strong&gt; Governance fails when people do not adopt it. Look for partners that include stewardship training, communication plans, and adoption metrics.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Proof of results:&lt;/strong&gt; Request named references, case studies with quantified outcomes, and examples of programs that remained operational after the engagement ended.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Security and data handling:&lt;/strong&gt; Confirm how the partner protects your data during the engagement and whether a data processing agreement is in place before any sensitive information is shared.&lt;/li&gt;
&lt;li&gt;Buyers evaluating partners often ask: Which governance framework will you apply, and how will you adapt it to our structure? Who will own data domains after the engagement ends? How will you measure whether governance is working six months after go-live?&lt;/li&gt;
&lt;/ul&gt;

&lt;blockquote&gt;
&lt;p&gt;The strongest partner combines strategic clarity, governance depth, platform fluency, and a delivery model that matches your organization's scale and risk profile.&lt;/p&gt;
&lt;/blockquote&gt;

&lt;h2&gt;
  
  
  &lt;strong&gt;Data Strategy &amp;amp; Governance Companies Compared&lt;/strong&gt;
&lt;/h2&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fphc6rt9rh23wgf45msnk.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fphc6rt9rh23wgf45msnk.png" alt="Image - Leading Data Strategy &amp;amp; Governance Companies: What to Look for in a Partner" width="800" height="563"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;h2&gt;
  
  
  &lt;strong&gt;Top 10 Data Strategy &amp;amp; Governance Companies&lt;/strong&gt;
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;1. Deloitte&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Deloitte is a global professional services network that brings data governance into its audit, risk, and regulatory practices. Its data work connects governance controls to regulatory and assurance requirements, which makes it a common choice for highly regulated organizations. Deloitte serves clients across financial services, government and public services, life sciences and health care, and energy.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Quick Facts&lt;/strong&gt;&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Headquartered: London, United Kingdom (global network coordinating entity)&lt;/li&gt;
&lt;li&gt;Team Size: Nearly 500,000&lt;/li&gt;
&lt;li&gt;Key verticals: Financial services, government and public services, life sciences and health care, energy&lt;/li&gt;
&lt;li&gt;Key platforms/technologies: Alliances with AWS, Google, Oracle, Salesforce, SAP, ServiceNow, and Workday&lt;/li&gt;
&lt;li&gt;Relevant strengths: Regulatory, risk, and forensic services; scale across 150 countries and territories&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Why Consider Deloitte?&lt;/strong&gt;Choose Deloitte when governance must answer to audit and regulatory assurance. Its global network allows it to staff large, multi-year programs across many jurisdictions.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Talent Pool Access:&lt;/strong&gt;Deloitte's network spans more than 150 countries and territories, giving multinational buyers broad coverage for governance programs.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Proven Track Record:&lt;/strong&gt;Deloitte states that it serves nearly 90% of the Fortune 500. Ask Deloitte for two governance references from your sector before shortlisting.&lt;/p&gt;

&lt;h3&gt;
  
  
  &lt;strong&gt;2. KPMG&lt;/strong&gt;
&lt;/h3&gt;

&lt;p&gt;KPMG is a global organization of independent professional services firms that delivers Audit, Tax, and Advisory services. Its governance work often sits within broader risk, control, and compliance programs.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Quick Facts&lt;/strong&gt;&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Headquartered: Amstelveen, Netherlands (global coordinating entity)&lt;/li&gt;
&lt;li&gt;Team Size: 276,000+ partners and employees&lt;/li&gt;
&lt;li&gt;Key verticals: Automotive, energy and natural resources, financial services, government, healthcare, and life sciences&lt;/li&gt;
&lt;li&gt;Key platforms/technologies: Alliances with Google Cloud, Microsoft, Oracle, Salesforce, SAP, ServiceNow, and Workday&lt;/li&gt;
&lt;li&gt;Relevant strengths: Audit and assurance, tax, advisory, and trusted AI frameworks&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Why Consider KPMG?&lt;/strong&gt;KPMG fits organizations that want governance built into operating models and controls. It suits buyers whose primary driver is compliance-led transformation.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Talent Pool Access:&lt;/strong&gt;KPMG firms operate in 138 countries and territories, providing access to a large global advisory workforce.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Proven Track Record:&lt;/strong&gt;KPMG has operated since 1891. Ask KPMG for named governance engagements that match your control environment.&lt;/p&gt;

&lt;h3&gt;
  
  
  &lt;strong&gt;3. Improving&lt;/strong&gt;
&lt;/h3&gt;

&lt;p&gt;Improving Enterprises is a technology consulting and software development company that delivers data strategy and governance through a hybrid model combining strategic advisory with hands-on implementation. Its data practice draws on DAMA DMBOK and cloud best practices, with delivery aligned to Microsoft, Databricks, and Snowflake platforms.&lt;/p&gt;

&lt;h4&gt;
  
  
  &lt;strong&gt;Why Is Improving the Best Data Strategy &amp;amp; Governance Partner?&lt;/strong&gt;
&lt;/h4&gt;

&lt;p&gt;Improving pairs governance strategy with implementation capacity, so roadmaps and policies reach tooling and daily operations. Its consultants apply structured frameworks to define data ownership, quality standards, and compliance controls for each client.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Net Promoter Score (NPS) 90+:&lt;/strong&gt; among the highest in modern enterprise technology services.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;7.5-year average partnership length:&lt;/strong&gt; built around long-term relationships that compound over time.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Global footprint:&lt;/strong&gt; 7+ countries, 3 continents, 21 offices, and 2,500+ consultants.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Key verticals:&lt;/strong&gt; manufacturing, financial services, government, and logistics.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Platform stack:&lt;/strong&gt; Microsoft Azure and Purview, Databricks Unity Catalog, Snowflake, and AWS.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Relevant strengths:&lt;/strong&gt; Tier 1 Microsoft partner status, Databricks and Snowflake partnerships, and hands-on governance delivery.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Global Delivery Access&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Improving combines strategy leadership in North America with delivery teams in Mexico, Guatemala, Costa Rica, Argentina, Chile, and India. Clients can align governance decisions with business leaders while scaling implementation capacity across time zones.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Proven Track Record&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Improving has supported energy and utilities clients on data modernization and governance programs. One representative engagement is described below.&lt;/p&gt;

&lt;p&gt;Inter Pipeline, a Canadian energy infrastructure company, engaged Improving to design a secure Azure architecture for its supervisory control and data acquisition (SCADA) data. The work used a Medallion data lake with zero-trust security, multi-factor authentication (MFA), and role-based access control, so &lt;a href="https://www.improving.com/case-studies/inter-pipeline" rel="noopener noreferrer"&gt;stakeholders across departments could run self-service analytics on one governed source&lt;/a&gt;.&lt;/p&gt;

&lt;p&gt;&lt;em&gt;Looking to achieve similar results with a trusted partner? Connect with our&lt;/em&gt;&lt;a href="https://www.improving.com/expertise/data/strategy-governance/" rel="noopener noreferrer"&gt;&lt;em&gt;data strategy experts&lt;/em&gt;&lt;/a&gt;&lt;em&gt;to explore how we can accelerate your governance goals.&lt;/em&gt;&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Strategic Advantage&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Improving's differentiator for data strategy and governance is the combination of framework-based governance design, implementation on the platforms enterprises already run, and delivery in regulated industries. As a Tier 1 Microsoft partner, Improving aligns governance strategies with the Azure Well-Architected Framework and implements Azure Purview. Its Snowflake and Databricks partnerships extend that approach to unified governance across lakehouses and warehouses.&lt;/p&gt;

&lt;h3&gt;
  
  
  &lt;strong&gt;4. EY&lt;/strong&gt;
&lt;/h3&gt;

&lt;p&gt;EY is a global professional services organization with a data governance practice focused on governance operating models, policies, standards, and ownership frameworks. Its work typically connects governance to broader transformation and compliance programs.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Quick Facts&lt;/strong&gt;&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Headquartered: London, United Kingdom&lt;/li&gt;
&lt;li&gt;Team Size: 400,000+&lt;/li&gt;
&lt;li&gt;Key verticals: Consumer and health, financial services, government and infrastructure, industrials and energy, technology&lt;/li&gt;
&lt;li&gt;Key platforms/technologies: EY.ai platform and EY Nexus platform&lt;/li&gt;
&lt;li&gt;Relevant strengths: Assurance, consulting, strategy and transactions, and tax across four integrated service lines&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Why Consider EY?&lt;/strong&gt;EY suits enterprises that treat governance as part of a larger transformation. Its operating model work helps clarify ownership and accountability.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Talent Pool Access:&lt;/strong&gt;EY describes nearly 400,000 people across 150 countries, giving buyers large multi-disciplinary teams.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Proven Track Record:&lt;/strong&gt;EY publishes client case studies in supply chain risk, including a Novartis engagement that added real-time risk insight to supply chain operations. Ask EY for governance references from organizations in your industry.&lt;/p&gt;

&lt;h3&gt;
  
  
  &lt;strong&gt;5. PwC&lt;/strong&gt;
&lt;/h3&gt;

&lt;p&gt;PwC is a global professional services network known for privacy governance and regulatory control design, particularly for organizations operating across multiple jurisdictions. Its governance work frequently addresses data protection requirements and cross-border obligations.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Quick Facts&lt;/strong&gt;&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Headquartered: London, United Kingdom&lt;/li&gt;
&lt;li&gt;Team Size: 350,000+&lt;/li&gt;
&lt;li&gt;Key verticals: Consumer markets, energy, financial services, government, health, and technology&lt;/li&gt;
&lt;li&gt;Key platforms/technologies: Multi-cloud governance and privacy tooling&lt;/li&gt;
&lt;li&gt;Relevant strengths: Audit and assurance, risk and regulation, and deals and consulting across a 136-country network&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Why Consider PwC?&lt;/strong&gt;PwC is the logical shortlist entry for privacy-heavy, multi-regime programs. Its control design expertise helps organizations align governance with regulatory obligations.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Talent Pool Access:&lt;/strong&gt;PwC's 2025 Global Annual Review reports about 364,000 people across 136 countries.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Proven Track Record:&lt;/strong&gt;PwC reports US$56.9 billion in gross revenue for the year ending June 30, 2025. Ask PwC for named privacy and governance references before a decision.&lt;/p&gt;

&lt;h3&gt;
  
  
  &lt;strong&gt;6. Dreamix&lt;/strong&gt;
&lt;/h3&gt;

&lt;p&gt;Dreamix is a Sofia, Bulgaria-based software development company that builds custom software and modernizes legacy systems. Its public materials center on software engineering, so buyers should confirm governance capabilities directly.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Quick Facts&lt;/strong&gt;&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Headquartered: Sofia, Bulgaria&lt;/li&gt;
&lt;li&gt;Team Size: 200+&lt;/li&gt;
&lt;li&gt;Key verticals: Aviation, healthcare, RegTech, fintech, transportation, and ESG&lt;/li&gt;
&lt;li&gt;Key platforms/technologies: Java, Angular, React, .NET, and Python&lt;/li&gt;
&lt;li&gt;Relevant strengths: Legacy system modernization, RegTech and know your customer (KYC) compliance software, and engineering depth&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Why Consider Dreamix?&lt;/strong&gt;Dreamix suits buyers who need an engineering partner to build governed data products or modernize legacy systems. Its RegTech and compliance software experience is relevant to regulated data environments.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Talent Pool Access:&lt;/strong&gt;Dreamix's engineering team is based in Sofia, Bulgaria, giving European clients nearshore delivery capacity.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Proven Track Record:&lt;/strong&gt;Dreamix's site lists RegTech work including KYC compliance, anti-money laundering (AML) readiness, and trade surveillance software, along with healthcare AI accelerators. Ask Dreamix for data governance case studies before shortlisting.&lt;/p&gt;

&lt;h3&gt;
  
  
  &lt;strong&gt;7. Itransition&lt;/strong&gt;
&lt;/h3&gt;

&lt;p&gt;Itransition is a global software engineering company with a data analytics and business intelligence practice. Its data services focus on building analytics and data platforms, with governance delivered as part of engineering work.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Quick Facts&lt;/strong&gt;&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Headquartered: Decatur, Georgia, United States&lt;/li&gt;
&lt;li&gt;Team Size: 3,000+ engineers&lt;/li&gt;
&lt;li&gt;Key verticals: Healthcare, finance, manufacturing, retail, insurance, and professional services&lt;/li&gt;
&lt;li&gt;Key platforms/technologies: Microsoft Fabric, Power BI, Dynamics 365, Salesforce, AWS, and Azure&lt;/li&gt;
&lt;li&gt;Relevant strengths: Engineering scale, 800+ clients served, and more than 25 years of delivery&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Why Consider Itransition?&lt;/strong&gt;Itransition is a fit for organizations that want governed analytics delivered by a large engineering team. Its Microsoft data platform work is relevant to organizations standardizing on Azure and Fabric.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Talent Pool Access:&lt;/strong&gt;Itransition operates with more than 3,000 engineers across 40 countries, giving buyers broad scale and time-zone flexibility.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Proven Track Record:&lt;/strong&gt;Itransition reports 12+ years of cooperation on a cloud-based data management and analytics suite for a US pharmaceutical multinational with 500 million patient records in its data assets.&lt;/p&gt;

&lt;h3&gt;
  
  
  &lt;strong&gt;8. Ciklum&lt;/strong&gt;
&lt;/h3&gt;

&lt;p&gt;Ciklum is a global experience engineering firm that offers data platform, AI governance, and engineering services. Its governance work is often paired with AI and data platform programs.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Quick Facts&lt;/strong&gt;&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Headquartered: London, United Kingdom&lt;/li&gt;
&lt;li&gt;Team Size: 4,000+ engineers, experience designers, and consultants&lt;/li&gt;
&lt;li&gt;Key verticals: Banking and financial services, retail, healthcare, hi-tech, insurance, and automotive&lt;/li&gt;
&lt;li&gt;Key platforms/technologies: Modern data platforms, cloud services, and AI engineering&lt;/li&gt;
&lt;li&gt;Relevant strengths: Enterprise-ready AI, governance built into delivery, and platform-agnostic architecture&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Why Consider Ciklum?&lt;/strong&gt;Ciklum makes sense when data governance and AI governance need one owner. Its platform-agnostic approach avoids locking the governance design to a single vendor.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Talent Pool Access:&lt;/strong&gt;Ciklum draws on distributed engineering teams across Europe, India, and other locations, supporting flexible delivery models.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Proven Track Record:&lt;/strong&gt;Ciklum reports a 50% reduction in testing time for Seeking Alpha through an automation testing framework. Ask Ciklum for governance-specific references before shortlisting.&lt;/p&gt;

&lt;h3&gt;
  
  
  &lt;strong&gt;9. Oxagile&lt;/strong&gt;
&lt;/h3&gt;

&lt;p&gt;Oxagile is a custom software development company with domain expertise in video, AdTech, FinTech, AI, and computer vision. Its data work centers on engineering delivery for analytics and data platform systems.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Quick Facts&lt;/strong&gt;&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Headquartered: New York, New York, United States&lt;/li&gt;
&lt;li&gt;Team Size: 300+ professionals&lt;/li&gt;
&lt;li&gt;Key verticals: Online video, AdTech, FinTech, healthcare, retail, and sports&lt;/li&gt;
&lt;li&gt;Key platforms/technologies: AI and computer vision, big data, and cloud platforms&lt;/li&gt;
&lt;li&gt;Relevant strengths: 20+ years of software engineering experience and Microsoft partner status&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Why Consider Oxagile?&lt;/strong&gt;Oxagile is a fit for buyers who want engineering-led data platform work supported by domain experience in regulated and high-volume environments such as FinTech and healthcare.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Talent Pool Access:&lt;/strong&gt;Oxagile operates distributed engineering teams that support flexible staffing for data platform programs.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Proven Track Record:&lt;/strong&gt;Oxagile reports more than 350 clients, including Fortune 500 and Forbes 2000 companies. Ask Oxagile for governance-specific references before shortlisting.&lt;/p&gt;

&lt;h3&gt;
  
  
  &lt;strong&gt;10. Ispirer&lt;/strong&gt;
&lt;/h3&gt;

&lt;p&gt;Ispirer is a Tallinn, Estonia-based company that specializes in automated database and application migration. Its tools and services help organizations move legacy data systems to modern platforms while preserving schema and data integrity.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Quick Facts&lt;/strong&gt;&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Headquartered: Tallinn, Estonia&lt;/li&gt;
&lt;li&gt;Team Size: 80+ engineers&lt;/li&gt;
&lt;li&gt;Key verticals: Finance, insurance, healthcare, retail, IT, education, and logistics&lt;/li&gt;
&lt;li&gt;Key platforms/technologies: C#, .NET, Java, PHP, Python, Azure, and AWS&lt;/li&gt;
&lt;li&gt;Relevant strengths: Automated migration, schema and data transfer, and legacy transformation&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Why Consider Ispirer?&lt;/strong&gt;Ispirer earns a place when legacy migration and governance requirements must move together. Its automation reduces manual conversion effort.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Talent Pool Access:&lt;/strong&gt;Ispirer's team of more than 80 engineers and migration specialists focuses on migration tooling and conversion services.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Proven Track Record:&lt;/strong&gt;Ispirer reports more than 1,500 completed projects and 1,100+ clients, including Fortune 500 companies.&lt;/p&gt;

&lt;h2&gt;
  
  
  &lt;strong&gt;Turning Governed Data into Lasting Business Value&lt;/strong&gt;
&lt;/h2&gt;

&lt;p&gt;Data strategy and governance turn scattered records into a trusted foundation for decisions, compliance, and growth. The right partner connects executive priorities to the standards and tooling that make those priorities stick. Governance designed well becomes part of daily operations, so it keeps delivering value long after the first engagement ends.&lt;/p&gt;

&lt;p&gt;Our work starts with a clear answer to what governance should accomplish for your business, before any decision about how to build it. From there, we align data ownership with your priorities, design the policies and controls your teams will use, and implement them on the platforms you already run. If you are ready to define your data vision and move it into practice, &lt;a href="https://www.improving.com/expertise/data/strategy-governance/" rel="noopener noreferrer"&gt;schedule a consultation with our data strategy experts&lt;/a&gt;.&lt;/p&gt;

&lt;h2&gt;
  
  
  &lt;strong&gt;Frequently Asked Questions&lt;/strong&gt;
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;1) What does a data strategy and governance partner do?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;A data strategy and governance partner defines a long-term data vision, designs ownership and policy frameworks, and implements the controls that keep data accurate and compliant. Good partners also train internal stewards so the program continues after the engagement ends.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;2) Should we choose a Big Four firm or a specialist partner?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Big Four firms suit organizations that need audit-linked governance and large-scale regulatory programs. Specialist firms often deliver faster implementation and deeper platform engineering, so clarify which outcome matters most before shortlisting.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;3) Which governance frameworks should a partner use?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Many mature programs reference DAMA DMBOK for data management principles and align with cloud provider frameworks such as the Azure Well-Architected Framework. Ask each partner how it adapts these standards to your organization.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;4) How do we measure governance success?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Measure data quality scores, the share of critical data domains with named owners, reporting consistency across teams, and time to resolve data issues. Track these metrics from the first phase of the engagement.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;5) How should we handle data privacy during a governance engagement?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Confirm the partner's data handling practices before sharing sensitive information, and ensure a data processing agreement is in place. Limit partner access to the minimum data required for the work.&lt;/p&gt;

</description>
      <category>data</category>
      <category>analytics</category>
    </item>
    <item>
      <title>How to Design Role Based AI Training for Employees</title>
      <dc:creator>Improving</dc:creator>
      <pubDate>Fri, 13 Nov 2026 05:57:43 +0000</pubDate>
      <link>https://dev.to/improving/how-to-design-role-based-ai-training-for-employees-9c</link>
      <guid>https://dev.to/improving/how-to-design-role-based-ai-training-for-employees-9c</guid>
      <description>&lt;p&gt;Someone builds one AI training curriculum for employees and rolls it out to the whole company. Engagement looks strong in week one and collapses by week six, and leadership spends the next two quarters wondering why.&lt;/p&gt;

&lt;p&gt;I watched this happen at a Fortune 500 client. The course was well made, but it was made for an imaginary average employee. "AI training" turned out to be several different skills under one name. An AI adoption strategy that treats training as one deliverable fails because what an engineer needs looks almost nothing like what an executive needs.&lt;/p&gt;

&lt;h2&gt;
  
  
  Role of AI Training in AI Adoption
&lt;/h2&gt;

&lt;p&gt;An AI adoption strategy is the plan for how an organization moves people, processes, and tools from experimenting with AI to using it in daily work. AI training for employees is the layer where that plan tends to succeed or fail, because it decides who learns what, to what depth, and how anyone knows it worked. Everyone in the company is entrusted with a particular set of tasks, as per their roles and skillset. A role-based AI adoption strategy sets those answers per role instead of per company.&lt;/p&gt;

&lt;h2&gt;
  
  
  What Goes Wrong Without Role-Based AI Training
&lt;/h2&gt;

&lt;p&gt;Without a role-based design, three things go wrong at once.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Technical staff feel the curriculum is beneath them&lt;/li&gt;
&lt;li&gt;Non-technical staff feel they have been handed a developer bootcamp&lt;/li&gt;
&lt;li&gt;Nobody knows which track applies to them&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Most people do nothing and eventually, the AI &lt;a href="https://www.improving.com/thoughts/why-most-ai-training-fails/" rel="noopener noreferrer"&gt;training fails&lt;/a&gt;. The completion numbers still look fine, which hides the problem until the next planning cycle.&lt;/p&gt;

&lt;h2&gt;
  
  
  How to Achieve Role Based AI Adoption
&lt;/h2&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fe349jfe7kzrj3quwz9is.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fe349jfe7kzrj3quwz9is.png" alt="Image - How to Design Role Based AI Training for Employees   " width="800" height="1340"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;h3&gt;
  
  
  1. Separate Literacy from Construction
&lt;/h3&gt;

&lt;p&gt;Two skill transitions sit inside every AI training program, and most organizations design for only the first.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Literacy:&lt;/strong&gt;AI literacy training moves someone from not touching an AI tool to using it competently for tasks they already do. It includes off-the-shelf usage, permission-based, one prompt at a time, and a human controlling every step. Almost everyone needs it. It is teachable in a few hours and is where most of an organization's population should start.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Construction:&lt;/strong&gt;Moving from using a tool someone else built to building workflows, agents, and repeatable systems around it. This stage covers task agents, defined constraints, governance, audit trails, and a shift from "I used AI to help with this task" to "I built something that does this task with AI doing most of the work." It is not for everyone.&lt;/li&gt;
&lt;/ul&gt;

&lt;h3&gt;
  
  
  2. Map Each Population to Its Depth
&lt;/h3&gt;

&lt;p&gt;We hit this while designing the communication plan for our own rollout. We kept getting stuck because three populations were being described with one message.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Delivery professionals:&lt;/strong&gt;They need the full construction pathway, a multi-course sequence that starts with the foundational literacy everyone gets, then specializes in building agentic workflows in their discipline. This group includes developers and the project managers, and business analysts who work alongside them.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Executives:&lt;/strong&gt;They needed enough exposure to know what ‘stage four’ looks like and enough hands-on time to stop being afraid of the tools. They did not need deep construction skills, because directing and evaluating AI-driven work is a different job than building it.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Sales and marketing:&lt;/strong&gt;Supporting business teams needed a third profile, closer to literacy plus department-specific specialization than to the engineering pathway.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Describing all three on one slide failed, and the confusion in that room was a preview of what a badly designed rollout creates across a company. A common root cause sits underneath it: training gets bolted onto a rollout after the tooling decisions are made, instead of designed alongside them.&lt;/p&gt;

&lt;h3&gt;
  
  
  3. Design AI Training Around What Each Role Produces
&lt;/h3&gt;

&lt;p&gt;The instinct behind "role-based training" is to tier by seniority: junior gets basic, senior gets advanced. Tiering by seniority sorts people by years of experience. The axis that predicts what someone needs is what they are accountable for producing.&lt;/p&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Feyo5qm4tl4jeioybi6c5.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Feyo5qm4tl4jeioybi6c5.png" alt="Image - How to Design Role Based AI Training for Employees   " width="800" height="392"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;h3&gt;
  
  
  4. Build AI Training Programs for Employees as Four Tracks
&lt;/h3&gt;

&lt;p&gt;This is why we structure &lt;a href="https://www.improving.com/services/training/ai/" rel="noopener noreferrer"&gt;Improving's corporate AI training&lt;/a&gt; as a four-track AI adoption framework: Essentials, Strategic, Advanced, and Custom.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Essentials:&lt;/strong&gt;For almost everyone in the organization. It covers the baseline fluency: how the tools work well enough to use them competently, how to evaluate an output instead of trusting it blindly, and what the guardrails are. Every population in our own rollout goes through it first, whatever track they specialize into afterward. For most people, the practical skill it builds is framing a request clearly enough that the tool gives you something usable on the first try.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Strategic:&lt;/strong&gt;For people who direct AI-driven work without building it, such as executives, product owners, and department leads. It is compressed and hands-on. It gets someone from "I don't touch these tools" to "I can evaluate this work and ask the right questions."&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Advanced:&lt;/strong&gt;For engineers and technical practitioners who build the agents, workflows, and governance infrastructure that make autonomous AI trustworthy. The literacy-to-construction transition happens here, and it takes far more material than a harder version of the beginner's decks.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Custom:&lt;/strong&gt;For department-specific specialization. Legal's AI use case looks nothing like marketing's, which looks nothing like recruiting's. A program that pretends otherwise recreates the confusion we hit in our own communication plan.&lt;/li&gt;
&lt;/ul&gt;

&lt;h3&gt;
  
  
  5. Measure Adoption Beyond Completion Rates
&lt;/h3&gt;

&lt;p&gt;The gap between people who complete a course and people who use what they learned is where generic training shows its cost.&lt;/p&gt;

&lt;p&gt;Our own internal target was public inside the company: 750 people certified through stage four, with a stretch goal of 1,000. The developer track filled fast enough to keep people on waiting lists almost from the start.&lt;/p&gt;

&lt;p&gt;A completion certificate is easy to hand out. Certification that means something requires tracking whether someone is building workflows and using the tools in a measurable way afterward. That number runs lower than the completion number, and the gap traces back to mismatch: a course at the wrong depth for the person's job, delivered anyway because it was the only curriculum on offer.&lt;/p&gt;

&lt;p&gt;For help sizing this against your own organization, our &lt;a href="https://www.improving.com/thoughts/ai-strategy-and-roadmap-assessment/" rel="noopener noreferrer"&gt;AI strategy and roadmap assessment&lt;/a&gt; is a starting point. If your pilots are already stalling, our post on &lt;a href="https://www.improving.com/thoughts/why-ai-pilots-fail-to-scale/" rel="noopener noreferrer"&gt;why AI pilots fail to scale&lt;/a&gt; covers the nearby failure modes.&lt;/p&gt;

&lt;h2&gt;
  
  
  Is Role-Based AI Training More Expensive?
&lt;/h2&gt;

&lt;p&gt;Yes. Building and staffing four tracks takes more work than building one deck and running it past everyone. But the real alternative to role-based training is not a cheaper curriculum that works. It is one curriculum that reports a high completion number and produces almost no measurable change in how people work, because it was calibrated for nobody's job. Role-based training costs more to build. Generic training costs more to run, for years, in the form of a workforce that completed a course and changed nothing.&lt;/p&gt;

&lt;h2&gt;
  
  
  Run a Quick Check on Your Own Training
&lt;/h2&gt;

&lt;p&gt;An AI adoption strategy often fails at the training layer before it fails at the technology layer. Organizations design one curriculum for a population that needs several skills at several depths, and those depths follow what each person is accountable for producing. An engineer building autonomous workflows and an executive evaluating them are on different journeys from day one.&lt;/p&gt;

&lt;p&gt;Pull the completion numbers from your last AI training push and ask a harder follow-up. Of the people who finished, how many can point to a workflow, prompt, or process they built afterward that they still use today?&lt;/p&gt;

&lt;p&gt;If nobody has the second number, you do not yet know whether your training worked. Attendance is the only thing you have measured.&lt;/p&gt;

&lt;p&gt;If you can name the role that would fail that test, you already know which track to build first. Send us that role and your last AI training completion numbers, and we will map it to Essentials, Strategic, Advanced, or Custom and show you what to measure afterward. &lt;a href="https://www.improving.com/contact/" rel="noopener noreferrer"&gt;Have a conversation with our AI training team.&lt;/a&gt;&lt;/p&gt;

&lt;h2&gt;
  
  
  FAQ about Role Based AI Adoption
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;How many training tracks does an organization need?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Match the number to the distinct accountabilities in your organization, not to a fixed count. We use four tracks because our population falls into four groups: almost everyone, direction-setters, builders, and department specialists.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Does everyone need to learn to build AI workflows?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;No. Construction suits engineers and technical practitioners. Most employees need literacy, and executives need enough hands-on time to direct and evaluate the work.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;How do we measure adoption instead of completion?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Track who is building or using a workflow, prompt, or process afterward, separately from who finished the course. The gap between the two numbers is the one to close.&lt;/p&gt;

</description>
      <category>ai</category>
      <category>machinelearning</category>
    </item>
    <item>
      <title>The Hidden Cost of Shipping GenAI Without Production-Grade MLOps</title>
      <dc:creator>Improving</dc:creator>
      <pubDate>Fri, 13 Nov 2026 05:57:00 +0000</pubDate>
      <link>https://dev.to/improving/the-hidden-cost-of-shipping-genai-without-production-grade-mlops-ej1</link>
      <guid>https://dev.to/improving/the-hidden-cost-of-shipping-genai-without-production-grade-mlops-ej1</guid>
      <description>&lt;p&gt;GenAI has moved from research demos to boardroom priority in a remarkably short time. Companies are racing to integrate LLMs into customer support, search, knowledge management, and internal workflows. But while adoption is accelerating, the engineering practices needed to operate these systems reliably are struggling to keep pace.&lt;/p&gt;

&lt;p&gt;The challenge is that getting a GenAI application to work in a demo is very different from running it reliably in production. A &lt;a href="https://www.improving.com/thoughts/evaluating-rag-systems-with-deepeval/" rel="noopener noreferrer"&gt;retrieval-augmented generation (RAG)&lt;/a&gt; pipeline can quietly return irrelevant context. A prompt change or model update can degrade response quality without triggering a traditional test failure. An application that performs well with a handful of test queries can produce inconsistent answers under real-world conditions, while token consumption and inference costs grow unpredictably with usage. Without systematic evaluation and monitoring, these problems can go undetected until they affect users or business outcomes.&lt;/p&gt;

&lt;p&gt;The missing piece is the engineering discipline required to take a GenAI application from a working prototype to a production-grade system. Making an LLM call is only the starting point. Teams need ways to evaluate output quality, detect regressions, investigate failures, monitor costs, and maintain control as their applications evolve.&lt;/p&gt;

&lt;p&gt;In this blog post, we'll explore the challenges of running GenAI applications in production and the engineering practices that help address them, from evaluating LLM outputs and monitoring system behavior to managing changes and maintaining reliability over time.&lt;/p&gt;

&lt;h2&gt;
  
  
  Why GenAI Systems Fail in Production
&lt;/h2&gt;

&lt;h3&gt;
  
  
  Understanding the AI application stack
&lt;/h3&gt;

&lt;p&gt;An &lt;a href="https://www.improving.com/thoughts/webinars/best-practices-for-implementing-llm-on-modern-data-products/" rel="noopener noreferrer"&gt;LLM&lt;/a&gt; is only one component of a larger application. Production failures can originate anywhere in the stack, from stale retrieval data to orchestration bugs or infrastructure issues. When teams treat the model as the entire application, these problems are often misdiagnosed as model quality issues. A typical GenAI application consists of the following layers:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Application/UX layer:&lt;/strong&gt; How requests enter the system and how responses are rendered to end users&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Orchestration layer:&lt;/strong&gt; The framework sequencing calls across the other layers&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Retrieval layer:&lt;/strong&gt; Search and ranking over the knowledge base that grounds the response&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Embedding layer:&lt;/strong&gt; The vectors representing documents and queries for similarity search&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Vector database:&lt;/strong&gt; Storage and indexing, with its own consistency and freshness behavior&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Tools/external APIs:&lt;/strong&gt; Functions and services the model calls to take action or fetch data&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;LLM layer:&lt;/strong&gt; The model itself, hosted or API-based&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Infrastructure layer:&lt;/strong&gt; Compute, networking, and hosting underneath everything above&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fc85588rt90vh43tuut0c.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fc85588rt90vh43tuut0c.png" alt="Image - The Hidden Cost of Shipping GenAI Without Production-Grade MLOps " width="769" height="678"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;Each layer has its own failure surface, and a failure rarely stays contained:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Retrieval:&lt;/strong&gt; Stale documents can lead to hallucinated answers even when the model itself is working as expected.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Orchestration:&lt;/strong&gt; A routing bug can send a query to the wrong tool or workflow, producing a confident but incorrect response that looks like a model quality issue.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Vector index:&lt;/strong&gt; If the index falls behind, retrieval quality can quietly degrade for hours before anyone notices.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Infrastructure:&lt;/strong&gt; Resource constraints or network failures can increase latency or make services unavailable.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;These failures illustrate why validating the model alone isn't enough. A GenAI application needs to be evaluated and monitored as a complete system, including the components that supply context, coordinate execution, and deliver responses.&lt;/p&gt;

&lt;p&gt;This is where MLOps and LLMOps become important.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;MLOps provides practices for versioning, deploying, monitoring, and managing machine learning systems throughout their lifecycle.&lt;/li&gt;
&lt;li&gt;
&lt;a href="https://www.improving.com/thoughts/complexity-never-goes-away-ai-systems-engineering/" rel="noopener noreferrer"&gt;LLMOps&lt;/a&gt; builds on these practices to address the additional challenges of LLM-powered applications, including prompt versioning, output quality evaluation, RAG pipeline reliability, hallucination detection, and token and inference cost management.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Together, these practices help teams track changes across the stack, detect regressions, investigate failures, and maintain consistent behavior as models, prompts, data, and dependencies evolve. Production readiness is a property of the entire application stack, not just the model.&lt;/p&gt;

&lt;h3&gt;
  
  
  Operational challenges of running GenAI at scale
&lt;/h3&gt;

&lt;p&gt;A GenAI application introduces a challenge traditional software rarely faces - the same input can produce different outputs across calls.&lt;/p&gt;

&lt;p&gt;For example, ask an AI agent to investigate a failed deployment, and it might check logs first on one run and resource usage or configuration changes on another. The outcome may be similar, but the path can vary each time, making testing and troubleshooting harder. That non-determinism compounds with a handful of other failure modes:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;a href="https://www.improving.com/thoughts/designing-ai-systems-for-change/" rel="noopener noreferrer"&gt;&lt;strong&gt;Prompt drift&lt;/strong&gt;&lt;/a&gt;&lt;strong&gt;:&lt;/strong&gt; A small change to a prompt can alter the output in many ways. For example, changing the instructions to make responses shorter might also cause the model to skip information another part of the application depends on.&lt;/li&gt;
&lt;li&gt;
&lt;a href="https://www.improving.com/thoughts/designing-ai-systems-for-change/" rel="noopener noreferrer"&gt;&lt;strong&gt;Model updates&lt;/strong&gt;&lt;/a&gt;&lt;strong&gt;:&lt;/strong&gt; A provider-side model change can affect an application without any code being changed. For example, if an application is built and tuned around Claude Sonnet 4.6 and the provider retires or replaces that version, the newer model may behave differently enough to require retesting and tuning.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Retrieval degradation:&lt;/strong&gt; As the knowledge base changes, retrieval quality can decline if the content or embeddings are no longer aligned. For example, adding large amounts of new documentation without re-indexing it properly can cause the system to surface older or less relevant information.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Data freshness:&lt;/strong&gt; The system can give a confident answer based on information that is no longer current. For example, an internal AI assistant could recommend a deployment process that was changed weeks ago because its knowledge source hasn't been updated.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Latency and cost:&lt;/strong&gt; A single request can trigger several steps, each adding time and cost. For example, a request might involve an embedding call, vector search, reranking, and multiple LLM calls before the user sees a response.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;External dependency failures:&lt;/strong&gt; A failure outside your application can still become a production incident. For example, a model provider outage or vector database timeout can cause an otherwise healthy application to fail.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;These challenges are hard to catch with traditional monitoring because they don't throw errors.&lt;/p&gt;

&lt;blockquote&gt;
&lt;p&gt;A degraded retrieval pipeline doesn't return a 500, it returns a 200 with a worse answer.&lt;/p&gt;
&lt;/blockquote&gt;

&lt;p&gt;Infrastructure monitoring is built to detect availability and performance problems, not quality problems, and quality is exactly where GenAI systems fail. Effective LLM monitoring has to track answer quality, not just uptime.&lt;/p&gt;

&lt;h3&gt;
  
  
  Why traditional DevOps falls short
&lt;/h3&gt;

&lt;p&gt;The reasons &lt;a href="https://www.improving.com/expertise/applications/platform-engineering/" rel="noopener noreferrer"&gt;traditional DevOps&lt;/a&gt; falls short are:&lt;/p&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fccm14ovjwagvmyjxu9hb.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fccm14ovjwagvmyjxu9hb.png" alt="Image - The Hidden Cost of Shipping GenAI Without Production-Grade MLOps" width="800" height="451"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;h2&gt;
  
  
  Hidden Cost of Skipping MLOps
&lt;/h2&gt;

&lt;h3&gt;
  
  
  Reliability and engineering costs
&lt;/h3&gt;

&lt;p&gt;Without MLOps practices such as versioning, continuous evaluation, and monitoring, teams often end up dealing with production problems reactively, spending more engineering time diagnosing and fixing issues.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Production incidents traced back to an unvalidated prompt change, a retrieval pipeline serving stale documents, or an unannounced model regression&lt;/li&gt;
&lt;li&gt;Debugging that becomes a manual, time-consuming guessing game, since there's no reliable way to confirm which layer caused a bad output, or that a fix actually worked&lt;/li&gt;
&lt;li&gt;
&lt;a href="https://www.improving.com/thoughts/data-debt-ai-predictions/" rel="noopener noreferrer"&gt;Technical debt&lt;/a&gt; in the form of prompts nobody remembers the reasoning behind, and retrieval configurations tuned by trial and error rather than measurement&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Each change carries more risk than it should, because there is no reproducible baseline to test against.&lt;/p&gt;

&lt;h3&gt;
  
  
  Business, operational, and financial impact
&lt;/h3&gt;

&lt;p&gt;The engineering costs translate directly into business costs:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;a href="https://www.improving.com/thoughts/own-the-interface-why-enterprise-ai-needs-a-governed-gateway/" rel="noopener noreferrer"&gt;Inference&lt;/a&gt; spend escalates quietly with no visibility into token usage per feature or prompt version, often surfacing only when the monthly bill arrives&lt;/li&gt;
&lt;li&gt;Resource utilization suffers from over-provisioned compute or redundant model calls that go unnoticed&lt;/li&gt;
&lt;li&gt;
&lt;a href="https://www.improving.com/thoughts/maximizing-developer-productivity-security-and-operational-efficiency/" rel="noopener noreferrer"&gt;Developer productivity&lt;/a&gt; drops as teams become reluctant to change prompts or retrieval logic without a fast way to confirm nothing else broke&lt;/li&gt;
&lt;li&gt;Customer trust erodes when an AI feature behaves inconsistently or degrades without warning, and it takes far longer to win back than it took to lose&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;These costs often go unnoticed until they show up in cloud bills, delayed releases, or customer complaints. They stem from running a probabilistic, multi-layer system without the evaluation, monitoring, and &lt;a href="https://www.improving.com/thoughts/agentic-ai-cost-management/" rel="noopener noreferrer"&gt;cost controls&lt;/a&gt; needed to manage it effectively. What starts as a shortcut during development can become an expensive problem in production.&lt;/p&gt;

&lt;h2&gt;
  
  
  Production-Grade MLOps for Reliable GenAI
&lt;/h2&gt;

&lt;h3&gt;
  
  
  Managing the complete AI lifecycle
&lt;/h3&gt;

&lt;p&gt;The starting point for reliability is managing the complete AI lifecycle, from the data and knowledge sources that feed the system to the models, prompts, retrieval configuration, evaluation, and production monitoring.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Data and knowledge preparation:&lt;/strong&gt; Source data needs to be collected, cleaned, validated, and kept current before it becomes part of the system's knowledge base.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Versioning:&lt;/strong&gt; Prompts, datasets, embeddings, evaluation sets, and models all need change history and rollback, just like application code.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Experiment tracking:&lt;/strong&gt; Results need to be tied to the exact combination of artifact versions that produced them, so experiments remain comparable and reproducible.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Deployment pipelines:&lt;/strong&gt; Changes to prompts, models, and retrieval configuration should pass through automated evaluation before reaching production.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;These stages build on the fundamentals of MLOps covered in our earlier post, extended here to account for the additional artifacts and failure modes introduced by GenAI.&lt;/p&gt;

&lt;h3&gt;
  
  
  Continuous evaluation and AI observability
&lt;/h3&gt;

&lt;p&gt;AI lifecycle management gives a team control over what's deployed. Continuous evaluation tells them whether what's deployed is actually good. That means measuring the dimensions that determine whether a system is useful, not just whether it returns a valid response:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Hallucination rate&lt;/li&gt;
&lt;li&gt;Retrieval quality&lt;/li&gt;
&lt;li&gt;Groundedness against retrieved context&lt;/li&gt;
&lt;li&gt;Relevance to the user's query&lt;/li&gt;
&lt;li&gt;Latency and cost per interaction&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;These metrics only become actionable when tied to &lt;a href="https://www.improving.com/thoughts/end-to-end-observability-with-prometheus-grafana-loki-opentelemetry-tempo/" rel="noopener noreferrer"&gt;end-to-end tracing&lt;/a&gt; across the full request path, from prompt through retrieval to model response. Without that trace, a regression can be detected but not diagnosed. With it, a groundedness drop traces back to a specific retrieval change, turning a vague complaint into a fixable defect.&lt;/p&gt;

&lt;h3&gt;
  
  
  Governance, security, and continuous improvement
&lt;/h3&gt;

&lt;p&gt;Guardrails, policy enforcement, and compliance controls need to sit in the request path itself, filtering unsafe inputs and outputs such as prompt injection attempts and sensitive data leakage, rather than being layered on after problems surface. They should also map to the organization's security baseline. At Improving, that means SOC 2 Type II controls, with alignment to frameworks like &lt;a href="https://www.improving.com/thoughts/responsible-ai-governance/" rel="noopener noreferrer"&gt;NIST CSF and CIS Controls&lt;/a&gt;.&lt;/p&gt;

&lt;p&gt;None of this is static. Human feedback and automated evaluation both feed back into the system on an ongoing basis, so flagged responses and low-scoring evaluation runs become inputs to the next round of changes. That closed loop is what turns MLOps from a one-time setup into a continuous improvement cycle.&lt;/p&gt;

&lt;h2&gt;
  
  
  Best Practices for Building Production-Ready GenAI Systems
&lt;/h2&gt;

&lt;p&gt;Moving from a working prototype to a production-ready system is an engineering effort. Before taking on real traffic, treat the AI system like any other production workload:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Make evaluation part of the deployment process:&lt;/strong&gt; Use the evaluation capabilities in Microsoft Foundry (formerly Azure AI Foundry) to measure quality and set clear thresholds before a change reaches production.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Build observability from the start:&lt;/strong&gt; Route traces and telemetry through Azure Monitor and Application Insights so teams can understand what is happening across the application and AI workflow. Designing applications to be observable from day one is covered in our post on &lt;a href="https://www.improving.com/thoughts/observability-driven-development-designing-observable-applications/" rel="noopener noreferrer"&gt;observability-driven development&lt;/a&gt;.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Automate quality gates in CI/CD:&lt;/strong&gt; Extend the delivery process already in place for the rest of the application by running evaluations through GitHub Actions or Azure Pipelines.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Keep governance consistent:&lt;/strong&gt; Use the governance and policy controls already established across the Microsoft 365 and Azure environment instead of creating a separate governance process for GenAI.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Treat these as one workflow:&lt;/strong&gt; Evaluation, observability, governance, and automation work best when they are connected and every change passes through the same production readiness process.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2F0peei8sbmrddfabakxsu.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2F0peei8sbmrddfabakxsu.png" alt="Image - The Hidden Cost of Shipping GenAI Without Production-Grade MLOps " width="799" height="612"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;For a broader view of running AI workloads on cloud infrastructure, see our guide to &lt;a href="https://www.improving.com/thoughts/ai-in-the-cloud-benefits-challenges-and-best-practices/" rel="noopener noreferrer"&gt;AI in the cloud&lt;/a&gt;.&lt;/p&gt;

&lt;h2&gt;
  
  
  MLOps as an Engineering Discipline for Enterprise AI
&lt;/h2&gt;

&lt;p&gt;Production-grade GenAI is achieved by building reliable operational systems around whichever model is in use, so the system's behavior is measured, traceable, and improvable regardless of what sits at its center.&lt;/p&gt;

&lt;p&gt;MLOps is what makes that possible: the discipline that turns GenAI from experimental software, impressive in a demo and fragile in production, into dependable production infrastructure an enterprise can stake a customer-facing process on.&lt;/p&gt;

&lt;p&gt;Organizations that invest early in evaluation, observability, governance, and &lt;a href="https://www.improving.com/thoughts/implementing-an-effective-learning-strategy-for-your-company/" rel="noopener noreferrer"&gt;continuous improvement&lt;/a&gt; tend to move faster and with less risk, because a team that can measure the impact of a change can ship it with confidence instead of caution. That combination, lower risk and higher velocity, is the actual business case for MLOps.&lt;/p&gt;

&lt;p&gt;If you're looking to build more reliable AI systems, explore how Improving can help your team take &lt;a href="https://improving.com/" rel="noopener noreferrer"&gt;GenAI applications&lt;/a&gt; from prototype to production.&lt;/p&gt;

</description>
      <category>ai</category>
      <category>machinelearning</category>
    </item>
    <item>
      <title>How to Write AI Prompts That Work for Business Teams</title>
      <dc:creator>Improving</dc:creator>
      <pubDate>Fri, 13 Nov 2026 05:56:13 +0000</pubDate>
      <link>https://dev.to/improving/how-to-write-ai-prompts-that-work-for-business-teams-4dg0</link>
      <guid>https://dev.to/improving/how-to-write-ai-prompts-that-work-for-business-teams-4dg0</guid>
      <description>&lt;p&gt;Professionals who struggle to get useful answers from AI tools usually get prompting wrong in one of two ways.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;They type a short request into a box and hope the tool reads their mind&lt;/li&gt;
&lt;li&gt;They hunt online for the exact phrasing that unlocks a better answer&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Neither works. This guide shows how to write AI prompts for everyday business tasks, with weak and stronger examples you can copy.&lt;/p&gt;

&lt;p&gt;The better mental model is the assignment you would hand a new hire on their first day. The clearer you are about the job, the situation, and what finished looks like, the better the result.&lt;/p&gt;

&lt;p&gt;People who work from a clear framework get real value from AI tools. That is why prompting belongs at the center of any &lt;a href="https://www.improving.com/services/training/ai/" rel="noopener noreferrer"&gt;AI training for employees&lt;/a&gt; program. It also explains why one-size-fits-all training underdelivers on this skill. A room of people at different starting depths needs different amounts of practice before it clicks, a problem we cover in &lt;a href="https://www.improving.com/thoughts/why-most-ai-training-fails/" rel="noopener noreferrer"&gt;why most AI training fails&lt;/a&gt;.&lt;/p&gt;

&lt;h2&gt;
  
  
  What Prompt Engineering Means for Business Teams
&lt;/h2&gt;

&lt;p&gt;Prompt engineering for business teams is the skill that turns a licensed tool into a useful one. A prompt describes the job, the reader, and the shape of a good answer, and hands that description to a very fast, very literal assistant. The assistant does exactly as well as the description it gets.&lt;/p&gt;

&lt;p&gt;You need only enough understanding of how AI tools respond to state your situation clearly, judge whether the output fits it, and adjust your ask when it does not. If the vocabulary gets in the way, our blog post on &lt;a href="https://www.improving.com/thoughts/5-key-terms-when-talking-about-ai/" rel="noopener noreferrer"&gt;five key terms when talking about AI&lt;/a&gt; covers the essentials.&lt;/p&gt;

&lt;h2&gt;
  
  
  Write Better AI Prompts by Describing the Scene
&lt;/h2&gt;

&lt;p&gt;Most people’s instinct is to give the tool a list of rules, such as “be concise,” “avoid jargon,” “sound professional,” and “do not make anything up.” That approach works, but slowly. Among prompting techniques, a faster one is to describe the situation the output has to live in.&lt;/p&gt;

&lt;p&gt;Compare two requests:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Rules:&lt;/strong&gt; "Summarize this email thread and be concise."&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Scene:&lt;/strong&gt; "Summarize this email thread for my VP, who has three minutes before a meeting and needs to know what decision she's being asked to make."&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;The second request lists no rules. The tool infers them from the scene: shorter, decision-focused, no background.&lt;/p&gt;

&lt;p&gt;The same approach works with a role.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;"You are drafting talking points for a nervous first-time presenter" produces plainer language and more reassurance without the word "reassurance" ever appearing.&lt;/li&gt;
&lt;li&gt;"You are reviewing this for a skeptical finance director" produces tighter numbers and fewer unsupported claims.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;A system prompt, the standing instructions built into an internal AI assistant, applies the same technique once, upstream, for everyone who uses the tool. Our blog post on &lt;a href="https://www.improving.com/thoughts/vibes-arent-a-strategy-engineering-context-in-the-age-of-ai/" rel="noopener noreferrer"&gt;engineering context in the age of AI&lt;/a&gt; goes deeper on how teams build that context.&lt;/p&gt;

&lt;h2&gt;
  
  
  AI Prompt Examples for Four Everyday Work Tasks
&lt;/h2&gt;

&lt;p&gt;Four tasks cover most of what employees do with AI in a normal week: summarizing, drafting, analyzing data, and thinking through a decision.&lt;/p&gt;

&lt;p&gt;All four follow one pattern. A weak prompt leaves the tool guessing. A stronger one supplies what it is missing.&lt;/p&gt;

&lt;h3&gt;
  
  
  Name the reader when summarizing
&lt;/h3&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Weak:&lt;/strong&gt; "Summarize this transcript."&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Strong:&lt;/strong&gt; "Summarize this transcript for someone deciding whether to join the project."&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;The source material is identical, but the output is different. Knowing why the reader needs the summary tells the tool what to keep and what to cut. A summary that briefs an executive who missed the meeting looks nothing like one that captures action items for the people who were in the room. Ask for both in one request and you get a mediocre version of each, so send two requests when you need two different outputs.&lt;/p&gt;

&lt;h3&gt;
  
  
  Describe the shape when drafting
&lt;/h3&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Weak:&lt;/strong&gt; "Write a project status update."&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Strong:&lt;/strong&gt; "Write a weekly status update in three short sections: what shipped, what's blocked, what's coming next. Keep each section under four sentences. This goes to a stakeholder who reads fast and doesn't need background."&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;The weak version returns something generic because the tool has no idea what your team's updates look like or what your reader expects. The stronger version hands it a template to fill instead of a blank page.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Show an example instead of describing one:&lt;/strong&gt; Paste last week’s update and say “match this format and tone, and update the content for this week.” A pasted example shows the pattern, while a paragraph of tone instructions only describes it. Check your company’s data rules before pasting internal material, because depending on where the tool processes data, your prompt can be a &lt;a href="https://www.improving.com/thoughts/your-prompt-is-a-cross-border-data-transfer/" rel="noopener noreferrer"&gt;cross-border data transfer&lt;/a&gt; with compliance consequences.&lt;/p&gt;

&lt;h3&gt;
  
  
  Arrive with a question when analyzing data
&lt;/h3&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Weak:&lt;/strong&gt; "What do you notice in this spreadsheet?"&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Strong:&lt;/strong&gt; "Which three regions had the largest drop in renewal rate this quarter, and is there a pattern in the account size of the accounts that didn't renew?"&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Without a question, the tool returns a scattershot response, most of it padding. Good AI prompts for data analysis name what to look for and what to ignore, so the answer is something you can act on instead of a summary of everything in the sheet.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Treat the first answer as a hypothesis:&lt;/strong&gt; Follow up with “show me the underlying numbers for that claim” or “what would make that pattern wrong?” If the tool cannot point to the specific rows behind a claim, check that claim before it goes into a deck someone else will act on.&lt;/p&gt;

&lt;h3&gt;
  
  
  Bring a half-formed idea as a thinking partner
&lt;/h3&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Weak:&lt;/strong&gt; "What's the best way to restructure a team?"&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Strong:&lt;/strong&gt; "I'm considering three options for restructuring this team. Here's my reasoning for each. Tell me what I'm missing."&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Without anything specific to react to, the tool returns a generic list that could apply to any team anywhere. The stronger version lets it pressure-test your thinking before you commit to a direction.&lt;/p&gt;

&lt;p&gt;Across all four tasks, the tool gets more useful with every piece of real context you bring: your situation, your draft, your numbers.&lt;/p&gt;

&lt;h2&gt;
  
  
  Test This on Your Most Annoying Task
&lt;/h2&gt;

&lt;p&gt;If all of this still feels abstract, make it concrete in four steps:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;Write down your ten most time-consuming recurring work tasks. Rank them by time spent, not by importance, because the two rankings differ more than most people expect.&lt;/li&gt;
&lt;li&gt;Star the ones you dread or find draining.&lt;/li&gt;
&lt;li&gt;Take the task that ranks highest on both time and dread.&lt;/li&gt;
&lt;li&gt;Give yourself thirty minutes to try it with AI. Do not polish the request and do not try to build a reusable process. Attempt the task and see what comes back.&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;Then ask two questions and answer both honestly: did it save time, and did it make you feel better about your job?&lt;/p&gt;

&lt;p&gt;A tool that saves ten minutes but leaves you frustrated by clunky back-and-forth is a marginal win. A tool that takes a task you dread off your plate is worth more than the minutes suggest, because the tedious parts of a job drain energy the interesting parts need.&lt;/p&gt;

&lt;h2&gt;
  
  
  Share What Works With Your Team
&lt;/h2&gt;

&lt;p&gt;Once a prompt works well, share it with a teammate.&lt;/p&gt;

&lt;p&gt;“I asked for a summary aimed at a specific reader instead of a generic one, and it was better” is a thirty-second comment that can save someone else an afternoon.&lt;/p&gt;

&lt;p&gt;The individual technique is useful. The shared technique changes how a team works, because everyone's version of “summarize this,” “draft this,” and “what do you notice” improves at once. We wrote about the next step in &lt;a href="https://www.improving.com/thoughts/from-ai-tools-to-ai-workflows-building-systems-that-scale-knowledge/" rel="noopener noreferrer"&gt;moving from AI tools to AI workflows&lt;/a&gt;.&lt;/p&gt;

&lt;p&gt;None of this takes technical fluency or a course in machine learning. Before your next attempt, look back at your last three prompts to an AI tool and check whether any of them named a reader or a purpose. If they did not, that is the fastest fix available, and it costs nothing to try on the next request. Then ask a colleague for their go-to prompt for the task you both do most. You may find you have both been reinventing the same fix, or that they have found one you have not.&lt;/p&gt;

&lt;p&gt;That kind of shared learning is what we build into AI training for employees at Improving. We start with the tasks each person already does every week, then work on naming the reader, the purpose, and the shape of a good answer until it becomes the way the team works. If your team wants help getting there, &lt;a href="https://www.improving.com/contact/" rel="noopener noreferrer"&gt;reach out and we can set up a conversation&lt;/a&gt;.&lt;/p&gt;

&lt;h2&gt;
  
  
  FAQ
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;Do I need a prompt template to get good results?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;No. Name the job, the reader, and the shape of a good answer. A one-line prompt that names a reader beats a paragraph of generic rules.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Can I trust the answer without checking it?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;No. Ask for the underlying numbers or the specific passages behind any claim you plan to act on.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Should I put company documents into an AI tool?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Only if your company's data policy allows it for that tool. When in doubt, ask your security or IT team before pasting anything internal.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;How do I know whether this is working for me?&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Pick one task, run it with AI for thirty minutes, and ask whether it saved time and whether it made the job feel better. Both answers count.&lt;/p&gt;

</description>
      <category>ai</category>
      <category>machinelearning</category>
    </item>
  </channel>
</rss>
