<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>DEV Community: wontopos</title>
    <description>The latest articles on DEV Community by wontopos (@wontopos).</description>
    <link>https://dev.to/wontopos</link>
    <image>
      <url>https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F3839754%2F6054f7e2-d4ba-47fa-a9b6-7eee34fc813b.png</url>
      <title>DEV Community: wontopos</title>
      <link>https://dev.to/wontopos</link>
    </image>
    <atom:link rel="self" type="application/rss+xml" href="https://dev.to/feed/wontopos"/>
    <language>en</language>
    <item>
      <title>We got tired of stuffing our AI agent's entire chat history into every prompt, so we built an API that doesn't</title>
      <dc:creator>wontopos</dc:creator>
      <pubDate>Tue, 21 Jul 2026 07:07:27 +0000</pubDate>
      <link>https://dev.to/wontopos/we-got-tired-of-stuffing-our-ai-agents-entire-chat-history-into-every-prompt-so-we-built-an-api-122l</link>
      <guid>https://dev.to/wontopos/we-got-tired-of-stuffing-our-ai-agents-entire-chat-history-into-every-prompt-so-we-built-an-api-122l</guid>
      <description>&lt;h2&gt;
  
  
  Why We Built This
&lt;/h2&gt;

&lt;p&gt;We're two people building &lt;strong&gt;WOS&lt;/strong&gt;, a long-term memory API for AI agents. The problem we kept running into: agents either forget everything between sessions, or you fix that by re-sending the full conversation history on every single call. &lt;/p&gt;

&lt;p&gt;That gets expensive fast, and past a certain length, models don't even use all of it well anyway.&lt;/p&gt;

&lt;h2&gt;
  
  
  What It Actually Does
&lt;/h2&gt;

&lt;p&gt;You store a user's memories once. On each query, WOS recalls only the relevant ones and hands you a small, &lt;strong&gt;bounded context&lt;/strong&gt;, no matter how much history is behind it. &lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;  &lt;strong&gt;Semantic Retrieval&lt;/strong&gt;: No keyword matching (BM25), so it works perfectly across English, Korean, Japanese, etc.&lt;/li&gt;
&lt;li&gt;  &lt;strong&gt;Bring Your Own Key&lt;/strong&gt;: Use your own LLM key for generation; we only handle search and storage.&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  The Number That Mattered Most: 45x Cheaper
&lt;/h2&gt;

&lt;p&gt;For a 100K-token history with 1,000 queries a month:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Standard approach&lt;/strong&gt;: ~$250/month in tokens.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;With WOS&lt;/strong&gt;: &lt;strong&gt;~$5.50/month&lt;/strong&gt;.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;The gap only grows as the history expands.&lt;/p&gt;

&lt;h2&gt;
  
  
  Language-Agnostic by Design
&lt;/h2&gt;

&lt;p&gt;We deliberately left out any lexical/keyword matching. This means retrieval quality doesn't quietly degrade depending on what language someone happens to write in. We test this against a single store holding multiple languages at once, and it holds up.&lt;/p&gt;

&lt;h2&gt;
  
  
  Try It Out
&lt;/h2&gt;

&lt;p&gt;You can explore the documentation and start using the API here:&lt;/p&gt;


&lt;div class="crayons-card c-embed text-styles text-styles--secondary"&gt;
    &lt;div class="c-embed__content"&gt;
        &lt;div class="c-embed__cover"&gt;
          &lt;a href="https://www.wontopos.com/" class="c-link align-middle" rel="noopener noreferrer"&gt;
            &lt;img alt="" src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fwontopos.com%2Fog%2Fog-default.png" height="420" class="m-0" width="800"&gt;
          &lt;/a&gt;
        &lt;/div&gt;
      &lt;div class="c-embed__body"&gt;
        &lt;h2 class="fs-xl lh-tight"&gt;
          &lt;a href="https://www.wontopos.com/" rel="noopener noreferrer" class="c-link"&gt;
            Wontopos - Long-term memory for AI agents
          &lt;/a&gt;
        &lt;/h2&gt;
          &lt;p class="truncate-at-3"&gt;
            WOS is a long-term memory API for AI agents. Store and recall what matters across sessions, in any language, billed only for the tokens you use.
          &lt;/p&gt;
        &lt;div class="color-secondary fs-s flex items-center"&gt;
            &lt;img alt="favicon" class="c-embed__favicon m-0 mr-2 radius-0" src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fwww.wontopos.com%2Ffavicon.ico" width="48" height="48"&gt;
          wontopos.com
        &lt;/div&gt;
      &lt;/div&gt;
    &lt;/div&gt;
&lt;/div&gt;





&lt;p&gt;&lt;a href="https://www.wontopos.com/" class="crayons-btn crayons-btn--primary" rel="noopener noreferrer"&gt;Get Started with WOS API&lt;/a&gt;
&lt;/p&gt;

&lt;h3&gt;
  
  
  Would love feedback!
&lt;/h3&gt;

&lt;p&gt;Especially from anyone who's hit memory or context-length walls building their own agents. &lt;strong&gt;How are you handling long-term context today?&lt;/strong&gt;&lt;/p&gt;

</description>
      <category>ai</category>
      <category>showdev</category>
      <category>llm</category>
      <category>performance</category>
    </item>
  </channel>
</rss>
