<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>DEV Community: Alex @Bickov</title>
    <description>The latest articles on DEV Community by Alex @Bickov (@bickov).</description>
    <link>https://dev.to/bickov</link>
    <image>
      <url>https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F410883%2Fb54ff2f9-8678-4c9a-818a-77f9f5317280.jpg</url>
      <title>DEV Community: Alex @Bickov</title>
      <link>https://dev.to/bickov</link>
    </image>
    <atom:link rel="self" type="application/rss+xml" href="https://dev.to/feed/bickov"/>
    <language>en</language>
    <item>
      <title>I built an MCP connector for my own app. It found two bugs that had been sitting in production</title>
      <dc:creator>Alex @Bickov</dc:creator>
      <pubDate>Fri, 31 Jul 2026 08:10:05 +0000</pubDate>
      <link>https://dev.to/bickov/i-built-an-mcp-connector-for-my-own-app-it-found-two-bugs-that-had-been-sitting-in-production-i4e</link>
      <guid>https://dev.to/bickov/i-built-an-mcp-connector-for-my-own-app-it-found-two-bugs-that-had-been-sitting-in-production-i4e</guid>
      <description>&lt;p&gt;SlimSnap is a screenshot tool for Mac and Windows. Scroll capture, annotation, and it turns a capture into structured JSON instead of a flat image. Last week I shipped an MCP connector for it, a small local server so Claude Code, Claude Desktop, and Cursor can read a capture directly instead of you pasting an image into the chat.&lt;/p&gt;

&lt;p&gt;Building the connector meant actually measuring SlimSnap's own output for the first time in months. That's when I found the two bugs below. Neither came from a bug report. Both were sitting in production since launch.&lt;/p&gt;

&lt;h2&gt;
  
  
  Bug one: measuring distance to the wrong point
&lt;/h2&gt;

&lt;p&gt;SlimSnap links an annotation arrow to the element it's pointing at, so an agent gets "this arrow points at the Continue button" instead of just a pair of coordinates. The first real capture I ran through the connector had an arrow resting on a "Continue with phone" button. It linked to a heading above the button instead.&lt;/p&gt;

&lt;p&gt;The code measured distance from the arrow to each element's center. A short heading close to the arrow can have a center nearer than a wide button's center, even when the arrow tip is sitting right on the button's edge. On a real 1030x1348 capture: center distance gave the heading 192px and the button 251px, heading wins. Edge distance gave the button 74px and the heading 141px, button wins, correctly.&lt;/p&gt;

&lt;p&gt;Fix was switching from center distance to distance-to-rectangle. Three lines of logic, months in production before the connector surfaced it because nobody had looked this closely at the linking before.&lt;/p&gt;

&lt;h2&gt;
  
  
  Bug two: 19 characters to say 5
&lt;/h2&gt;

&lt;p&gt;Coordinates were exported as 64-bit floats when 32-bit was always enough. So a value that should read 0.048 got written as 0.04800000041723251. Same number, one a human would never type and a model has to parse anyway.&lt;/p&gt;

&lt;p&gt;It's not just noise. Every element in every capture carries 3-4 coordinates. On a busy page with 100+ elements that's hundreds of these strings, each one about 4x longer than it needs to be, in every JSON export since the format shipped. Fixed in 0.5.1 by exporting at the precision the data actually needs.&lt;/p&gt;

&lt;p&gt;Neither bug was found by a user complaining. Both were found by pointing my own tool at my own output and actually reading what came back.&lt;/p&gt;

&lt;h2&gt;
  
  
  What the connector is for, and what it isn't
&lt;/h2&gt;

&lt;p&gt;The reason JSON instead of an image matters comes down to how vision models handle a screenshot. They cap the long edge at 1568px. A 2540x18410 scrolling capture arrives at the model as 216x1568, about 8.5% of its original size, and 16px body text renders under 2px tall. Unreadable, not just compressed.&lt;/p&gt;

&lt;p&gt;For a single screen that isn't hitting that cap, JSON is a real win. One capture of an X login screen came out to 377 tokens as JSON versus 1,813 tokens as an image of the same screen, already under the 1568px limit and not even downscaled. About 4.8x smaller, and the text in it is exact, not OCR guesswork off a compressed image.&lt;/p&gt;

&lt;p&gt;For a tall page it's more honest than that. A full 18,410px scroll capture came out to 11,372 tokens as JSON versus 448 tokens for the same page as a downscaled image. The image is cheaper. It's also close to unreadable at that size. So the real trade is token cost against whether the model can actually read what you sent it, not JSON being universally cheaper, because on a tall page it isn't.&lt;/p&gt;

&lt;p&gt;The connector has four tools: get the latest capture, list recent captures, get a specific one, and an opt-in image tool that returns the same 1568px-capped PNG if you want it anyway. Works in Claude Code, Claude Desktop, and Cursor. Doesn't work in Codex right now, its tool result cap is 10KB and it drops images entirely once a response has structured output alongside them, that's an open bug upstream, not something I can fix from SlimSnap's side.&lt;/p&gt;

&lt;p&gt;Install:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;claude mcp add slimsnap &lt;span class="nt"&gt;--&lt;/span&gt; npx &lt;span class="nt"&gt;-y&lt;/span&gt; @slimsnap/mcp
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Or grab the desktop bundle from the &lt;a href="https://github.com/bickov/slimsnap-mcp/releases/tag/v0.1.0" rel="noopener noreferrer"&gt;GitHub release&lt;/a&gt; if you're on Claude Desktop or Cursor. One thing worth knowing before you install: Claude Code gates MCP tools per tool and per directory, so the first few captures trigger a permission prompt each. There's a user-wide allow list in the README if that gets old fast.&lt;/p&gt;

&lt;p&gt;Repo and docs: &lt;a href="https://slimsnap.ai/connector" rel="noopener noreferrer"&gt;slimsnap.ai/connector&lt;/a&gt;&lt;/p&gt;

</description>
      <category>mcp</category>
      <category>ai</category>
      <category>claudecode</category>
      <category>buildinpublic</category>
    </item>
    <item>
      <title>I measured what Claude does to a long screenshot</title>
      <dc:creator>Alex @Bickov</dc:creator>
      <pubDate>Mon, 13 Jul 2026 07:38:05 +0000</pubDate>
      <link>https://dev.to/bickov/i-measured-what-claude-does-to-a-long-screenshot-24ia</link>
      <guid>https://dev.to/bickov/i-measured-what-claude-does-to-a-long-screenshot-24ia</guid>
      <description>&lt;p&gt;I captured a full page on a retina display. The file was 3066 x 28800 pixels.&lt;/p&gt;

&lt;p&gt;I pasted it into Claude and asked what it received.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;276 x 2600.&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Not cropped. Squeezed. Same 1:9.4 shape, 11 times smaller on both axes. About 99% of the pixels never reached the model.&lt;/p&gt;

&lt;h2&gt;
  
  
  Why it happens
&lt;/h2&gt;

&lt;p&gt;Claude's vision docs recommend 1568px on the long edge, and 2000 to 2500px for dense text. Images over 8000x8000 are rejected outright.&lt;/p&gt;

&lt;p&gt;The resize preserves aspect ratio. That is the part that gets people. On a normal screenshot, shrinking the long edge is harmless. On a very tall one, the long edge is the height, so pulling the height down drags the width with it. My page was 9.4 times taller than it was wide, so the width had nowhere to go.&lt;/p&gt;

&lt;h2&gt;
  
  
  What that does to text
&lt;/h2&gt;

&lt;p&gt;Body text at 14pt on a retina display is about 28 pixels tall in the file.&lt;/p&gt;

&lt;p&gt;After an 11x reduction, it is under 3 pixels.&lt;/p&gt;

&lt;p&gt;That is not small text. That is no text. The model gets a gray column with colored stripes and is still expected to answer your question, so it does what anyone would do with no information. It guesses, confidently.&lt;/p&gt;

&lt;p&gt;This is also why the answer feels vague and you cannot tell why.&lt;/p&gt;

&lt;h2&gt;
  
  
  It is not only Claude
&lt;/h2&gt;

&lt;p&gt;The dimension limit shows up as real bugs. There are open issues on claude-code where a single oversized image hard-errors the request instead of auto-resizing, and one where an oversized image in a resumed session poisons every following turn with no way back.&lt;/p&gt;

&lt;p&gt;Every tool that takes image input has a budget. Tall screenshots lose their text in all of them.&lt;/p&gt;

&lt;h2&gt;
  
  
  What to send instead
&lt;/h2&gt;

&lt;p&gt;Two things, and neither is clever.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Cut the capture into frames.&lt;/strong&gt; Each frame small enough to survive the resize. The model reads each one at real size instead of reading one smear.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Send the text separately, as JSON.&lt;/strong&gt; Every element, its content, its position. JSON has no height limit. A 28,000 pixel page arrives whole, in order, and costs a few hundred tokens instead of a few thousand.&lt;/p&gt;

&lt;p&gt;The image is still there when the model needs to see layout. The text is there when it needs to read. You stop asking one tall PNG to do both jobs.&lt;/p&gt;

&lt;p&gt;I build &lt;a href="https://slimsnap.ai" rel="noopener noreferrer"&gt;SlimSnap&lt;/a&gt;, a free Mac screenshot tool that does both: scroll capture splits into readable frames, and one JSON covers the whole page. The schema is MIT.&lt;/p&gt;

&lt;h2&gt;
  
  
  Go measure yours
&lt;/h2&gt;

&lt;p&gt;Take a long screenshot. Paste it into whatever you use. Ask it what dimensions it received.&lt;/p&gt;

&lt;p&gt;I want to build the table. If you have numbers for Figma, ChatGPT or Cursor, post them below.&lt;/p&gt;

</description>
      <category>ai</category>
      <category>claude</category>
      <category>webdev</category>
      <category>productivity</category>
    </item>
    <item>
      <title>AI was supposed to kill WordPress. The trend line disagrees</title>
      <dc:creator>Alex @Bickov</dc:creator>
      <pubDate>Tue, 07 Jul 2026 16:43:04 +0000</pubDate>
      <link>https://dev.to/bickov/ai-was-supposed-to-kill-wordpress-the-trend-line-disagrees-4k5j</link>
      <guid>https://dev.to/bickov/ai-was-supposed-to-kill-wordpress-the-trend-line-disagrees-4k5j</guid>
      <description>&lt;p&gt;Google Trends for WordPress, worldwide, 2004 to today. The shape is familiar: peak in 2014, a decade of decline, a flat floor from 2021. Then 2026, and the line climbs back to levels last seen around 2017.&lt;/p&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/UPLOAD_CHART_HERE" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/UPLOAD_CHART_HERE" alt="WordPress search interest, Google Trends 2004 to present" width="800" height="400"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;That was not the script. AI site builders, vibe coding tools, agents that generate a whole site from one prompt. WordPress was supposed to be the first casualty. It still runs around 43 percent of the web, and this year more people are searching for it, not fewer.&lt;/p&gt;

&lt;h2&gt;
  
  
  Two things I think are going on.
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;First&lt;/strong&gt;, AI creates users for old tools faster than it replaces them. Millions of people who never called themselves technical are shipping things now. When they need a real site with hosting and a domain and a contact form, they don't reach for the newest tool. They reach for the one with 20 years of tutorials, because that's what the search results and the chatbots both point them to.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Second&lt;/strong&gt;, and this is the part that should interest tool builders: LLMs are best at whatever they saw most in training. There is more written about WordPress than about any publishing tool in history. Ask an agent to fix your WordPress site and it performs like a senior. Ask it about a tool launched last year and it guesses. The most documented platform gets the biggest AI boost. Incumbents with deep ecosystems may come out of this wave stronger, not weaker.&lt;/p&gt;

&lt;p&gt;If that holds, the moat in the AI era is not features. It is how much text about your tool exists for the next model to read.&lt;/p&gt;

&lt;p&gt;Curious where this shows up in your stack. Which old tool got better for you since agents arrived?&lt;/p&gt;

</description>
      <category>webdev</category>
      <category>ai</category>
      <category>wordpress</category>
      <category>discuss</category>
    </item>
    <item>
      <title>I gave my agent a skill so it stops asking where my files are</title>
      <dc:creator>Alex @Bickov</dc:creator>
      <pubDate>Tue, 07 Jul 2026 07:24:03 +0000</pubDate>
      <link>https://dev.to/bickov/i-gave-my-agent-a-skill-so-it-stops-asking-where-my-files-are-3lib</link>
      <guid>https://dev.to/bickov/i-gave-my-agent-a-skill-so-it-stops-asking-where-my-files-are-3lib</guid>
      <description>&lt;p&gt;Claude Code skills are easy to write. The hard part nobody documents: how does the skill know where your app's files live on someone else's machine?&lt;/p&gt;

&lt;p&gt;I hit this building a skill for my Mac screenshot app. The skill needs to read the latest capture. On my machine that folder is one path. On yours it's wherever you set it in preferences. Hardcode it and the skill breaks for everyone but me.&lt;/p&gt;

&lt;p&gt;Here is the pattern that fixed it, in three parts.&lt;/p&gt;

&lt;h2&gt;
  
  
  What a skill is, in one paragraph
&lt;/h2&gt;

&lt;p&gt;A skill is a small markdown file in &lt;code&gt;~/.claude/skills/&lt;/code&gt;. It tells Claude how to handle a class of requests. When your prompt matches, Claude reads the instructions and follows them, so you stop re-explaining the rules every session. Mine is a single SKILL.md, about 80 lines. You can read the whole thing in a minute: &lt;a href="https://github.com/bickov/slimsnap-skill" rel="noopener noreferrer"&gt;bickov/slimsnap-skill&lt;/a&gt;.&lt;/p&gt;

&lt;h2&gt;
  
  
  The discovery problem
&lt;/h2&gt;

&lt;p&gt;Integrations between a desktop app and a terminal agent usually fail one of two ways. You hardcode a path, and it breaks the moment the user moves the folder. Or you push config into the agent side, and every install becomes a manual setup step.&lt;/p&gt;

&lt;p&gt;The fix is a config file at a known location that the app owns:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight json"&gt;&lt;code&gt;&lt;span class="err"&gt;~/.slimsnap/config.json&lt;/span&gt;&lt;span class="w"&gt;
&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;The app writes its save folder there on every launch. The skill reads it on every invocation. Change the folder in the app's preferences and the skill picks it up on the next capture. Nothing to update on the agent side.&lt;/p&gt;

&lt;p&gt;Cursor does the same shape with workspace settings. Raycast extensions do it with preferences. It's rare in the app-plus-agent space mostly because apps don't think about agent integration yet.&lt;/p&gt;

&lt;h2&gt;
  
  
  What the skill does with it
&lt;/h2&gt;

&lt;p&gt;Three steps on every invocation:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;Read &lt;code&gt;~/.slimsnap/config.json&lt;/code&gt; to find the captures folder&lt;/li&gt;
&lt;li&gt;Pull the newest capture and parse it. The file is structured JSON, bounding boxes and OCR text and annotations, so Claude reads it directly instead of burning tokens re-interpreting an image&lt;/li&gt;
&lt;li&gt;Treat the user's callout text as the intent. If the arrow points at a gray button and the note says "match the brand blue," that text becomes the instruction. No guessing&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;The capture format is open, MIT licensed: &lt;a href="https://github.com/bickov/slimsnap-schema" rel="noopener noreferrer"&gt;bickov/slimsnap-schema&lt;/a&gt;. If you want a skill for Aider or Codex CLI that consumes the same files, nothing is in your way.&lt;/p&gt;

&lt;h2&gt;
  
  
  Trigger phrasing, the part I got wrong first
&lt;/h2&gt;

&lt;p&gt;[Alex writes this section: 3 or 4 sentences on what description phrasing failed to trigger the skill and what finally worked]&lt;/p&gt;

&lt;h2&gt;
  
  
  Try the pattern
&lt;/h2&gt;

&lt;p&gt;If you're building any tool that an agent should act on: pick a config path under the user's home folder, have the app own it and write it on launch, have the skill read it fresh every time. That's the whole trick.&lt;/p&gt;

&lt;p&gt;The working example end to end: &lt;a href="https://slimsnap.ai" rel="noopener noreferrer"&gt;SlimSnap&lt;/a&gt; (free Mac app) plus the skill:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;git clone https://github.com/bickov/slimsnap-skill ~/.claude/skills/slimsnap
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Capture something broken, drag an arrow at it, type what you want changed, then in Claude Code: &lt;code&gt;fix this from my screenshot&lt;/code&gt;.&lt;/p&gt;

&lt;p&gt;Longer write-up of why the handoff is JSON and what's in the format: &lt;a href="https://slimsnap.ai/blog/claude-code-skill" rel="noopener noreferrer"&gt;on my blog&lt;/a&gt;.&lt;/p&gt;

</description>
      <category>ai</category>
      <category>tutorial</category>
      <category>claude</category>
      <category>macos</category>
    </item>
    <item>
      <title>Do programmers even feel like programmers anymore?</title>
      <dc:creator>Alex @Bickov</dc:creator>
      <pubDate>Thu, 02 Jul 2026 07:19:22 +0000</pubDate>
      <link>https://dev.to/bickov/do-programmers-even-feel-like-programmers-anymore-2fo7</link>
      <guid>https://dev.to/bickov/do-programmers-even-feel-like-programmers-anymore-2fo7</guid>
      <description>&lt;p&gt;Saw a post from an 8-year dev this week. He said any junior with an agent now matches his output, and he feels no pride left in it. It got huge, because a lot of people quietly feel the same.&lt;br&gt;&lt;/p&gt;
&lt;p&gt;I read it from the other side. I'm a designer, not an engineer. For years "can you build this" meant "find someone technical and pray they stay interested." Usually they didn't. AI took the thing that hurt that dev and handed it to me.&lt;br&gt;&lt;/p&gt;
&lt;p&gt;Same shift. Loss from one seat, freedom from another.&lt;br&gt;&lt;/p&gt;
&lt;p&gt;I'm shipping a Mac app solo right now, as someone who can't write a backend from scratch. Two years ago that was a joke.&lt;br&gt;&lt;/p&gt;
&lt;p&gt;So I'm curious about the makers here. If you build for a living, does it still feel like your craft, or like something else now? Loss or relief?&lt;/p&gt;

</description>
      <category>ai</category>
      <category>programming</category>
      <category>development</category>
      <category>discuss</category>
    </item>
    <item>
      <title>The longest prompt you'll ever write is a screenshot</title>
      <dc:creator>Alex @Bickov</dc:creator>
      <pubDate>Mon, 29 Jun 2026 06:49:14 +0000</pubDate>
      <link>https://dev.to/bickov/the-longest-prompt-youll-ever-write-is-a-screenshot-21bc</link>
      <guid>https://dev.to/bickov/the-longest-prompt-youll-ever-write-is-a-screenshot-21bc</guid>
      <description>&lt;p&gt;I pasted a screenshot into Claude Code last week and it changed the wrong button. Not a crash, not a bad idea. It just picked the wrong element on a busy screen and edited that one.&lt;/p&gt;

&lt;p&gt;A screenshot carries a whole screen of intent. To you it is obvious which thing you meant. To the agent it is a flat image it re-reads every turn, and on a dense UI it guesses.&lt;/p&gt;

&lt;p&gt;What fixed it for me was marking the one element and handing over a small structured reference instead of the raw image:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight json"&gt;&lt;code&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"element"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"Save button"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"text"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"Save"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"position"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nl"&gt;"x"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mf"&gt;0.82&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nl"&gt;"y"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mf"&gt;0.12&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;},&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"intent"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"keep it disabled until the form is valid"&lt;/span&gt;&lt;span class="w"&gt;
&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="w"&gt;
&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;That JSON is about 700 tokens. The raw screenshot is around 1,500 on Sonnet and Haiku, up to 4,784 on Opus, and it gets billed again on every turn.&lt;/p&gt;

&lt;p&gt;So the screenshot is the longest prompt you will ever write. The same screenshot, marked and structured, is one of the shortest.&lt;/p&gt;

&lt;p&gt;I built a small free Mac tool around this idea (&lt;a href="https://slimsnap.ai" rel="noopener noreferrer"&gt;SlimSnap&lt;/a&gt;). The tool is not the point though. The point is the agent should not have to guess which element you meant. Mark it, and the guessing goes away.&lt;/p&gt;

</description>
      <category>ai</category>
      <category>claude</category>
      <category>productivity</category>
      <category>webdev</category>
    </item>
    <item>
      <title>Your AI agent is guessing which element you meant</title>
      <dc:creator>Alex @Bickov</dc:creator>
      <pubDate>Thu, 18 Jun 2026 07:48:29 +0000</pubDate>
      <link>https://dev.to/bickov/your-ai-agent-is-guessing-which-element-you-meant-2aof</link>
      <guid>https://dev.to/bickov/your-ai-agent-is-guessing-which-element-you-meant-2aof</guid>
      <description>&lt;p&gt;Coding agents are good at execution and bad at reading a flat image. Give one a screenshot of a busy UI and it has to infer, from pixels alone, which of six similar buttons you were pointing at. Half the time it picks wrong, you re-prompt, and you have burned a round trip plus a few thousand tokens on the image.&lt;/p&gt;

&lt;p&gt;I started handing the agent a structured capture instead. Same screenshot, but the element I care about and what I want done with it are explicit:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight json"&gt;&lt;code&gt;&lt;span class="err"&gt;json&lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"target"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nl"&gt;"label"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"Save draft"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nl"&gt;"region"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="mi"&gt;820&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mi"&gt;140&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mi"&gt;96&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mi"&gt;32&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;},&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"intent"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"disable until the form is valid"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"note"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"this is the secondary button, not the primary Save"&lt;/span&gt;&lt;span class="w"&gt;
&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="w"&gt;
&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;The agent no longer guesses. It acts on the element I named. And the payload is roughly 700 tokens versus the several thousand a raw screenshot costs, so longer sessions stay inside context.&lt;/p&gt;

&lt;p&gt;Structure beats pixels when the next reader is a machine. The picture carries everything at once and signals nothing. A few fields carry the one thing that matters.&lt;/p&gt;

&lt;p&gt;Curious whether anyone here has hit the same wall feeding screenshots to agents, and what you did about it.&lt;/p&gt;

&lt;h2&gt;
  
  
  Flag for voice pass
&lt;/h2&gt;

&lt;ul&gt;
&lt;li&gt;"good at execution and bad at reading a flat image" is a balanced parallel, the exact anti-AI pattern. Rephrase in your voice.&lt;/li&gt;
&lt;li&gt;"The picture carries everything at once and signals nothing" reads clever/templated. Keep only if it is genuinely how you'd say it.&lt;/li&gt;
&lt;li&gt;The closing question is a soft generic CTA. Replace with a sharper, real question if you have one.&lt;/li&gt;
&lt;li&gt;Tags suggestion: #claude #ai #productivity #webdev (same as last republish).&lt;/li&gt;
&lt;li&gt;The JSON is illustrative. Match it to SlimSnap's real schema field names before posting so it is accurate.&lt;/li&gt;
&lt;/ul&gt;

</description>
      <category>claude</category>
      <category>webdev</category>
      <category>ai</category>
      <category>productivity</category>
    </item>
    <item>
      <title>Why I feed my coding agent JSON instead of screenshots</title>
      <dc:creator>Alex @Bickov</dc:creator>
      <pubDate>Tue, 16 Jun 2026 13:00:00 +0000</pubDate>
      <link>https://dev.to/bickov/why-i-feed-my-coding-agent-json-instead-of-screenshots-439i</link>
      <guid>https://dev.to/bickov/why-i-feed-my-coding-agent-json-instead-of-screenshots-439i</guid>
      <description>&lt;p&gt;Claude Code can read images. So can Cursor. So can ChatGPT. I built SlimSnap anyway, and the reason is boring: the image is the wrong shape for the job.&lt;/p&gt;

&lt;p&gt;Here is the boring version. The job is "show the agent what is on my screen and have it act." For that job a retina screenshot pasted into a coding session is somewhere between expensive and lossy, depending on how much you care about your token budget, your context window, and the agent acting on the right thing.&lt;/p&gt;

&lt;h2&gt;
  
  
  The token math
&lt;/h2&gt;

&lt;p&gt;A screenshot pasted to Claude as a vision input is downscaled and billed at the API's per-image cap: about 1,568 tokens on Sonnet and Haiku (the models Claude Code uses by default), up to 4,784 tokens on Opus 4.7 and 4.8. Pasted to Codex CLI (which runs on OpenAI's GPT-4o), a typical 1440x900 screenshot in high detail mode runs about 1,105 tokens. Pasted to Gemini CLI on Gemini 2.5, the same image is about 1,548 tokens. The same screen, turned into a SlimSnap JSON document, runs about 700 tokens. That JSON contains the elements, their normalized bounding boxes, their extracted colors, and the OCR text for each.&lt;/p&gt;

&lt;p&gt;&lt;em&gt;About 55 percent fewer than Sonnet or Gemini, 37 percent fewer than Codex, up to 85 percent fewer than Opus, per turn. And the only representation with structured intent the agent can act on.&lt;/em&gt;&lt;/p&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Representation&lt;/th&gt;
&lt;th&gt;Per-turn tokens&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;Screenshot on Opus 4.7 / 4.8 (max billed)&lt;/td&gt;
&lt;td&gt;~4,784&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Screenshot on Sonnet / Haiku (max billed)&lt;/td&gt;
&lt;td&gt;~1,568&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Screenshot on Gemini 2.5&lt;/td&gt;
&lt;td&gt;~1,548&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Screenshot on Codex CLI / GPT-4o&lt;/td&gt;
&lt;td&gt;~1,105&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Same screen as SlimSnap JSON&lt;/td&gt;
&lt;td&gt;~700&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;p&gt;For a one-shot question that is a curiosity. For the way I actually use a terminal coding agent, which is a long iterative session where I show it the page state every few prompts, it stops being a curiosity. Twenty turns of screenshots on Sonnet burns about 31k tokens of vision before you've said anything. Twenty turns on Codex CLI is about 22k. On Opus 4.7+ it is about 96k. Twenty turns of SlimSnap JSON is 14k. On a 200k context window, that is the difference between finishing the refactor and getting compacted out mid-session.&lt;/p&gt;

&lt;p&gt;If you are running an agent all day, the bill matters. If you are running it on a tough refactor, the context matters more.&lt;/p&gt;

&lt;h2&gt;
  
  
  Structure beats pixels
&lt;/h2&gt;

&lt;p&gt;The token math is the part that wins HN comments. The part that actually matters to whether the agent is helpful is structure.&lt;/p&gt;

&lt;p&gt;When you paste a screenshot, the agent has to look at pixels and infer everything: what is a button, what is text, what color is what, what label belongs to what input, where the user is pointing. It does this every turn, because raw pixels are not persistent reasoning state. If you ask a follow-up six prompts later, the agent goes back to the pixels. (Why it sees rather than reads: &lt;a href="https://slimsnap.ai/blog/claude-doesnt-ocr" rel="noopener noreferrer"&gt;Claude doesn't OCR your screenshot, it interprets it.&lt;/a&gt;)&lt;/p&gt;

&lt;p&gt;When you paste structured JSON, the agent reads facts. Element &lt;code&gt;e4&lt;/code&gt; is a button, bbox &lt;code&gt;[0.34, 0.60, 0.32, 0.07]&lt;/code&gt; normalized, color &lt;code&gt;#3B82F6&lt;/code&gt;, OCR text "Sign up". The next turn it does not re-interpret pixels, it references &lt;code&gt;e4&lt;/code&gt;. The reasoning is grounded in the same primitives the next turn will use.&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight json"&gt;&lt;code&gt;&lt;span class="err"&gt;json&lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"schema_version"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"1.0"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"captured_at"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"2026-05-19T18:17:46Z"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"screen"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nl"&gt;"title"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"Create your account"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nl"&gt;"app"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"Safari"&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;},&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"image"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nl"&gt;"width_px"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mi"&gt;1440&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nl"&gt;"height_px"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mi"&gt;900&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nl"&gt;"file"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"signup.png"&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;},&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"elements"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nl"&gt;"id"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"e1"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nl"&gt;"type"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"label"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nl"&gt;"value"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"Create your account"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
      &lt;/span&gt;&lt;span class="nl"&gt;"bbox"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="mf"&gt;0.34&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mf"&gt;0.18&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mf"&gt;0.32&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mf"&gt;0.06&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;},&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nl"&gt;"id"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"e2"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nl"&gt;"type"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"input"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nl"&gt;"value"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"Email"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
      &lt;/span&gt;&lt;span class="nl"&gt;"bbox"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="mf"&gt;0.34&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mf"&gt;0.34&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mf"&gt;0.32&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mf"&gt;0.07&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;},&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nl"&gt;"id"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"e3"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nl"&gt;"type"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"input"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nl"&gt;"value"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"Password"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
      &lt;/span&gt;&lt;span class="nl"&gt;"bbox"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="mf"&gt;0.34&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mf"&gt;0.46&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mf"&gt;0.32&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mf"&gt;0.07&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;},&lt;/span&gt;&lt;span class="w"&gt;
    &lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nl"&gt;"id"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"e4"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nl"&gt;"type"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"button"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nl"&gt;"value"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"Sign up"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
      &lt;/span&gt;&lt;span class="nl"&gt;"bbox"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="mf"&gt;0.34&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mf"&gt;0.60&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mf"&gt;0.32&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mf"&gt;0.07&lt;/span&gt;&lt;span class="p"&gt;],&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="nl"&gt;"color"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"#3B82F6"&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="p"&gt;],&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"estimated_tokens"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="mi"&gt;712&lt;/span&gt;&lt;span class="w"&gt;
&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="w"&gt;
&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Annotations carry the same property. A red rectangle in a PNG is a red rectangle. A red rectangle in SlimSnap JSON has an &lt;code&gt;intent&lt;/code&gt; field, a &lt;code&gt;target_ref&lt;/code&gt; pointing at the element it overlaps, and an optional callout string. The agent does not have to guess which input I am pointing at. The schema says: this arrow targets &lt;code&gt;e4&lt;/code&gt;, intent is &lt;code&gt;highlight&lt;/code&gt;, callout is "this one is misaligned."&lt;/p&gt;

&lt;p&gt;Pasting the image and saying "fix the misaligned input" makes the agent guess which input. Pasting the JSON makes the agent act, because the guess is already collapsed.&lt;/p&gt;

&lt;h2&gt;
  
  
  Why I built a skill instead of a slash command
&lt;/h2&gt;

&lt;p&gt;Once the capture is structured JSON, the rest is easy. SlimSnap writes a tiny config file at ~/.slimsnap/config.json on every startup and settings change. It contains the default save folder and the filename pattern. Nothing else.&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight json"&gt;&lt;code&gt;&lt;span class="err"&gt;json&lt;/span&gt;&lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"schema_version"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"1.0"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"default_save_folder"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"/Users/alex/Documents/SlimSnap"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;&lt;span class="w"&gt;
  &lt;/span&gt;&lt;span class="nl"&gt;"filename_pattern"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="s2"&gt;"{title}-{timestamp}"&lt;/span&gt;&lt;span class="w"&gt;
&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="w"&gt;
&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;The Claude Code skill (free, MIT, separate repo at &lt;a href="https://github.com/bickov/slimsnap-skill" rel="noopener noreferrer"&gt;github.com/bickov/slimsnap-skill&lt;/a&gt;) reads that config, lists the save folder, loads the latest JSON file, and parses it into the agent's working context. There is no upload step. There is no slash command to remember. There is no "here is a screenshot." I press the global shortcut, annotate, hit Save, type "fix this" in Claude Code, and the agent already has the structured capture loaded.&lt;/p&gt;

&lt;p&gt;I went with a skill instead of a CLI tool or a Claude Code plugin because skills auto-trigger. The user does not invoke them, the agent does, when the prompt looks like the skill's purpose. "What's in my latest SlimSnap capture?" triggers it. So does "fix the misaligned input from my last screenshot." The skill is invisible until it is useful.&lt;/p&gt;

&lt;p&gt;This is the part I want to be obvious to anyone building on top of Claude Code: the contract between the desktop app and the agent is the config file, not a hardcoded path. The skill discovers the save folder. If you move your captures, the skill follows. If you build a different consumer (a CLI, a VS Code extension, a different agent), it reads the same config and works.&lt;/p&gt;

&lt;h2&gt;
  
  
  The open schema is the actual product
&lt;/h2&gt;

&lt;p&gt;SlimSnap is a Mac app and it is free at launch. The thing that will outlast the app is the schema. It is published as a separate MIT repo at &lt;a href="https://github.com/bickov/slimsnap-schema" rel="noopener noreferrer"&gt;github.com/bickov/slimsnap-schema&lt;/a&gt;. JSON Schema 2020-12, two examples, a README that explains every field.&lt;/p&gt;

&lt;p&gt;The reason this matters: the most common reaction to a new desktop tool from a one-person shop is "what if you disappear." If the schema is open and the consumer is a skill anyone can fork, the answer is "your captures still work, your skill still works, build a different annotator if you want." The data is not locked to the app.&lt;/p&gt;

&lt;p&gt;I am not pretending this makes SlimSnap an open-source project. The desktop app is closed. The schema and the skill are open. That is the smallest set of things I can give away and still let people invest in the workflow without trusting me forever.&lt;/p&gt;

&lt;h2&gt;
  
  
  What this is not
&lt;/h2&gt;

&lt;p&gt;It is not a Claude Code replacement. Claude Code still reads images fine. If you paste a screenshot once for a one-off question, do that. The case for converting to JSON is the case for a workflow: you do this many times a day, you want the agent to be cheap and precise, and you want a clean handoff between the capture and the agent.&lt;/p&gt;

&lt;p&gt;It is also not for backend-only work. If you are refactoring a Go service you do not need to show Claude Code your screen. SlimSnap is sharpest for frontend, design-to-code, and bug-reproduction work, where you constantly need to point at something visual and have the agent reason about it.&lt;/p&gt;

&lt;p&gt;If that is your loop, the tool, the skill, and the schema are at &lt;a href="https://slimsnap.ai/" rel="noopener noreferrer"&gt;slimsnap.ai&lt;/a&gt;.&lt;/p&gt;

</description>
      <category>claude</category>
      <category>ai</category>
      <category>webdev</category>
      <category>productivity</category>
    </item>
  </channel>
</rss>
