<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>DEV Community: Drew Jenkins</title>
    <description>The latest articles on DEV Community by Drew Jenkins (@drewworks).</description>
    <link>https://dev.to/drewworks</link>
    <image>
      <url>https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F4210928%2F7d36899c-7e87-4aed-bf81-ae09c0a9a5f3.jpg</url>
      <title>DEV Community: Drew Jenkins</title>
      <link>https://dev.to/drewworks</link>
    </image>
    <atom:link rel="self" type="application/rss+xml" href="https://dev.to/feed/drewworks"/>
    <language>en</language>
    <item>
      <title>Notes from the AI Engineer World's Fair: evals, agents, and what I'd copy</title>
      <dc:creator>Drew Jenkins</dc:creator>
      <pubDate>Thu, 29 Oct 2026 01:20:58 +0000</pubDate>
      <link>https://dev.to/drewworks/notes-from-the-ai-engineer-worlds-fair-evals-agents-and-what-id-copy-2723</link>
      <guid>https://dev.to/drewworks/notes-from-the-ai-engineer-worlds-fair-evals-agents-and-what-id-copy-2723</guid>
      <description>&lt;p&gt;I went to the AI Engineer World's Fair expecting a lot of demos and left with a shorter list of things I actually want to try. These are the notes I kept going back to.&lt;/p&gt;

&lt;h2&gt;
  
  
  Evals are still the bottleneck
&lt;/h2&gt;

&lt;p&gt;The most useful talks weren't about models, they were about evaluation. One team described keeping a spreadsheet of forty hand-written cases with expected outputs, run on every change, and catching regressions that dashboards missed for weeks. It's the least glamorous takeaway and the one I've already started copying.&lt;/p&gt;

&lt;p&gt;The pattern I heard repeated: small, specific, in-repo eval sets beat big generic benchmarks for the thing you actually shipped.&lt;/p&gt;

&lt;h2&gt;
  
  
  Agents are mostly about state and retries
&lt;/h2&gt;

&lt;p&gt;Every agent talk eventually turned into a talk about state machines. Who owns the state, what happens when a tool call times out, how a retry avoids double-applying an action. The teams that looked calm about production had explicitly modeled that; the ones that looked nervous were still relying on the model to remember.&lt;/p&gt;

&lt;p&gt;I left with a concrete note: idempotency keys for every side-effecting tool call, and a place to store the result of each step. That's boring plumbing, and it's most of the difference between a demo and a product.&lt;/p&gt;

&lt;h2&gt;
  
  
  The talks that changed my mind
&lt;/h2&gt;

&lt;p&gt;One session argued that for internal tools, a small fine-tuned model on in-domain data often beats a larger general model, mostly because latency and cost matter more than the last few percent of quality. We had been defaulting to the biggest model available, and I'm now going to test the small one first for the next internal feature.&lt;/p&gt;

&lt;h2&gt;
  
  
  What I'm still skeptical about
&lt;/h2&gt;

&lt;p&gt;Multi-agent orchestration for its own sake. Every demo with five agents talking to each other could usually be one agent with a loop and a clearer prompt. The interesting problems are still state, evaluation, and failure handling, and adding more agents mostly multiplies those problems.&lt;/p&gt;

&lt;h2&gt;
  
  
  What's next for us
&lt;/h2&gt;

&lt;p&gt;A small eval set in the repo, idempotency on the tool layer, and a latency budget for every user-facing call. Nothing from the conference was about a new model, which I think is a sign of where the actual work is.&lt;/p&gt;

</description>
      <category>ai</category>
      <category>agents</category>
      <category>conference</category>
    </item>
    <item>
      <title>Shipping a model behind FastAPI without the notebook</title>
      <dc:creator>Drew Jenkins</dc:creator>
      <pubDate>Tue, 27 Oct 2026 15:21:23 +0000</pubDate>
      <link>https://dev.to/drewworks/shipping-a-model-behind-fastapi-without-the-notebook-41ch</link>
      <guid>https://dev.to/drewworks/shipping-a-model-behind-fastapi-without-the-notebook-41ch</guid>
      <description>&lt;p&gt;Turned a notebook that had been "almost ready" for three weeks into an actual service this week. The model didn't change — the packaging did.&lt;/p&gt;

&lt;p&gt;What made the difference:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;One &lt;code&gt;predict.py&lt;/code&gt; with a pure function, no global state&lt;/li&gt;
&lt;li&gt;A tiny test that loads the model and runs a fixed input&lt;/li&gt;
&lt;li&gt;Docker with a pinned wheel, not a &lt;code&gt;pip install&lt;/code&gt; at boot&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;The notebook is still useful for experiments. It just isn't the deployment artifact.&lt;/p&gt;

&lt;p&gt;Next: I want to try compiling one of these small models to WebAssembly so it can run client-side. If you've done that with a PyTorch model, I'd love to hear what worked.&lt;/p&gt;

</description>
      <category>machinelearning</category>
      <category>python</category>
      <category>api</category>
    </item>
  </channel>
</rss>
