DEV Community

Jamie Cole profile picture

Jamie Cole

404 bio not found

Joined Joined on 
GPT-5.1 Was Retired on March 11 — Here's What Broke in Your LLM App

GPT-5.1 Was Retired on March 11 — Here's What Broke in Your LLM App

1
Comments
4 min read

Want to connect with Jamie Cole?

Create an account to connect with Jamie Cole. You can also sign in below to proceed if you already have an account.

Already have an account? Sign in
The exact AI prompts that got me 3 UK job interviews in January 2026

The exact AI prompts that got me 3 UK job interviews in January 2026

Comments
5 min read
How to Add LLM Drift Monitoring to Your CI/CD Pipeline (Free, 5 Minutes)

How to Add LLM Drift Monitoring to Your CI/CD Pipeline (Free, 5 Minutes)

Comments
3 min read
I Found a 0.575 Drift Score Between Two Consecutive LLM Runs. Here's Exactly What Changed.

I Found a 0.575 Drift Score Between Two Consecutive LLM Runs. Here's Exactly What Changed.

Comments
3 min read
Real LLM Drift Detection Results: Exact Outputs, Real Scores, No Fabrication

Real LLM Drift Detection Results: Exact Outputs, Real Scores, No Fabrication

Comments
3 min read
I shipped an LLM feature, got 11 users, then the model silently changed on me. Here's what I built to stop it happening again.

I shipped an LLM feature, got 11 users, then the model silently changed on me. Here's what I built to stop it happening again.

Comments
3 min read
Anthropic Built a 300K-Query Behavioral Auditing Tool Because Model Behavior Changes. Here's the Production Version.

Anthropic Built a 300K-Query Behavioral Auditing Tool Because Model Behavior Changes. Here's the Production Version.

Comments
4 min read
PromptFoo Passes. Production Still Breaks. Here's the Gap.

PromptFoo Passes. Production Still Breaks. Here's the Gap.

Comments
3 min read
Gemini 1.5 Pro Also Drifts: Known Regression Patterns and How to Monitor Them

Gemini 1.5 Pro Also Drifts: Known Regression Patterns and How to Monitor Them

1
Comments
3 min read
Claude 3.5 Sonnet Changed. My System Prompt Stopped Working. Here's What I Learned.

Claude 3.5 Sonnet Changed. My System Prompt Stopped Working. Here's What I Learned.

Comments 2
4 min read
LangSmith vs Langfuse vs Helicone vs DriftWatch — I Compared All Four So You Don't Have To

LangSmith vs Langfuse vs Helicone vs DriftWatch — I Compared All Four So You Don't Have To

1
Comments
3 min read
How to Get Notified the Moment OpenAI or Anthropic Changes Your Model

How to Get Notified the Moment OpenAI or Anthropic Changes Your Model

Comments
3 min read
Your LLM CI/CD Tests Aren't Enough — Here's the Gap

Your LLM CI/CD Tests Aren't Enough — Here's the Gap

Comments
3 min read
GPT-5.2 Changed on Feb 10 — Here's How to Know If Your Prompts Broke

GPT-5.2 Changed on Feb 10 — Here's How to Know If Your Prompts Broke

Comments
2 min read
7 Things That Silently Break Claude Agents in Production

7 Things That Silently Break Claude Agents in Production

Comments
3 min read
My LLM Started Lying to My App and I Didn't Notice for Three Days

My LLM Started Lying to My App and I Didn't Notice for Three Days

Comments
4 min read
We Built a Service That Catches LLM Drift Before Your Users Do

We Built a Service That Catches LLM Drift Before Your Users Do

Comments
3 min read
Using AI to Actually Prepare for UK Tech Interviews in 2026 (Not Just Feel Prepared)

Using AI to Actually Prepare for UK Tech Interviews in 2026 (Not Just Feel Prepared)

Comments
4 min read
The Single-File App Architecture: Why I Stopped Reaching for a Backend

The Single-File App Architecture: Why I Stopped Reaching for a Backend

Comments
4 min read
I Applied to 47 Jobs in Six Weeks and Lost Track of All of Them

I Applied to 47 Jobs in Six Weeks and Lost Track of All of Them

Comments
4 min read
I Spent 3 Months Job Hunting in the UK — These AI Prompts Cut My Interview Wait from Weeks to Days

I Spent 3 Months Job Hunting in the UK — These AI Prompts Cut My Interview Wait from Weeks to Days

Comments
4 min read
What actually breaks when you run a Claude agent for 6 months

What actually breaks when you run a Claude agent for 6 months

Comments
2 min read
I actually built the job tracker (free, no signup, runs in your browser)

I actually built the job tracker (free, no signup, runs in your browser)

Comments
2 min read
Claude solved a problem Knuth couldn't. Here's what that means if you're building with it.

Claude solved a problem Knuth couldn't. Here's what that means if you're building with it.

Comments
2 min read
"I built a free RBT exam prep tool because most of what exists is already outdated"

"I built a free RBT exam prep tool because most of what exists is already outdated"

Comments
2 min read
I built a Chrome extension for Claude in 45 minutes (here's what I learned)

I built a Chrome extension for Claude in 45 minutes (here's what I learned)

Comments
5 min read
18 Claude system prompts worth copying

18 Claude system prompts worth copying

Comments
1 min read
Claude Haiku vs Sonnet vs Opus in 2026: which model to actually use

Claude Haiku vs Sonnet vs Opus in 2026: which model to actually use

Comments
1 min read
Stop writing CLAUDE.md from scratch — use the generator

Stop writing CLAUDE.md from scratch — use the generator

Comments 1
1 min read
"Why you should count your tokens before calling the API"

"Why you should count your tokens before calling the API"

Comments
2 min read
I switched from GPT-4 to Claude Code for autonomous agents. Here's what actually changed.

I switched from GPT-4 to Claude Code for autonomous agents. Here's what actually changed.

Comments 1
4 min read
Why does every job tracker cost £50/month when most tradespeople just need a list and an invoice

Why does every job tracker cost £50/month when most tradespeople just need a list and an invoice

2
Comments
2 min read
"Five Things That Break in Production That Anthropic's Free Curriculum Skips"

"Five Things That Break in Production That Anthropic's Free Curriculum Skips"

Comments
5 min read
How to add guardrails to your Claude agent in 10 lines

How to add guardrails to your Claude agent in 10 lines

Comments
4 min read
"How to stop your sub-agents from stepping on each other"

"How to stop your sub-agents from stepping on each other"

Comments 1
4 min read
Never lose Claude Code context again

Never lose Claude Code context again

Comments 4
3 min read
Your Agent's Model Is Not the Bottleneck

Your Agent's Model Is Not the Bottleneck

1
Comments
4 min read
8 MCP server templates that actually work with Claude Desktop

8 MCP server templates that actually work with Claude Desktop

Comments
2 min read
Building a Self-Correcting Python Agent with Claude's Tool Use

Building a Self-Correcting Python Agent with Claude's Tool Use

Comments 3
4 min read
How to Detect When Your AI Agent Is Stuck (And What to Do About It)

How to Detect When Your AI Agent Is Stuck (And What to Do About It)

1
Comments
5 min read
Three Memory Mistakes That Kill AI Agents in Production

Three Memory Mistakes That Kill AI Agents in Production

Comments
5 min read
Why Your AI Agent Should Be a Cron Job, Not a Server

Why Your AI Agent Should Be a Cron Job, Not a Server

Comments
4 min read
loading...