<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>DEV Community: Aryan Goyal</title>
    <description>The latest articles on DEV Community by Aryan Goyal (@gg_0080).</description>
    <link>https://dev.to/gg_0080</link>
    <image>
      <url>https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F1912901%2Ffa2f6ec0-2d53-42f7-9925-577fea65d941.jpg</url>
      <title>DEV Community: Aryan Goyal</title>
      <link>https://dev.to/gg_0080</link>
    </image>
    <atom:link rel="self" type="application/rss+xml" href="https://dev.to/feed/gg_0080"/>
    <language>en</language>
    <item>
      <title>How I Built AI-Powered Log Triage in Go (and Made It 100x Cheaper with Fingerprinting)</title>
      <dc:creator>Aryan Goyal</dc:creator>
      <pubDate>Tue, 16 Jun 2026 02:42:28 +0000</pubDate>
      <link>https://dev.to/gg_0080/how-i-built-ai-powered-log-triage-in-go-and-made-it-100x-cheaper-with-fingerprinting-2eeb</link>
      <guid>https://dev.to/gg_0080/how-i-built-ai-powered-log-triage-in-go-and-made-it-100x-cheaper-with-fingerprinting-2eeb</guid>
      <description>&lt;h2&gt;
  
  
  I built LogSense to do AI root-cause analysis on production errors without dashboard fatigue or runaway token costs.
&lt;/h2&gt;

&lt;p&gt;Early access is open — join the waitlist at &lt;a href="https://logsense.cloud" rel="noopener noreferrer"&gt;Logsense&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;I got tired of two things:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;Paying premium observability prices for noisy error triage&lt;/li&gt;
&lt;li&gt;“AI analysis” tools that still process duplicate stack traces like they’re unique incidents&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;So I built &lt;strong&gt;LogSense&lt;/strong&gt;.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;LogSense = drop in an API key, get AI root-cause analysis on every error. No dashboards. No rules.&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;The core idea is simple:&lt;/p&gt;

&lt;blockquote&gt;
&lt;p&gt;&lt;strong&gt;Same error 1000 times = 1 LLM call.&lt;/strong&gt;&lt;/p&gt;
&lt;/blockquote&gt;

&lt;p&gt;That one design choice changed the economics completely.&lt;/p&gt;




&lt;h2&gt;
  
  
  The Problem With Naive AI Log Analysis
&lt;/h2&gt;

&lt;p&gt;Most pipelines treat every incoming log line as independent work.&lt;/p&gt;

&lt;p&gt;If one bug explodes during an outage, you might see thousands of near-identical stack traces.&lt;br&gt;&lt;br&gt;
Naive flow:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;ingest logs&lt;/li&gt;
&lt;li&gt;call LLM per event (or per tiny batch)&lt;/li&gt;
&lt;li&gt;pay repeatedly for the same root cause&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;That gets expensive fast, and signal quality drops because you’re summarizing noise, not incidents.&lt;/p&gt;




&lt;h2&gt;
  
  
  The Architecture I Built (Go + Gin + RabbitMQ + K8s)
&lt;/h2&gt;

&lt;p&gt;At a high level:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;
&lt;strong&gt;Ingest&lt;/strong&gt;: app logs arrive via API&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Fingerprint&lt;/strong&gt;: normalize + hash error signatures&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Deduplicate&lt;/strong&gt;: group repeated errors by fingerprint window&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Analyze once&lt;/strong&gt;: one LLM call per unique fingerprint&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Fan out results&lt;/strong&gt;: attach RCA + remediation hints to all grouped events&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;This means volume spikes do not linearly increase AI cost.&lt;/p&gt;




&lt;h2&gt;
  
  
  Fingerprinting: The Cost + Signal Moat
&lt;/h2&gt;

&lt;p&gt;The fingerprinting layer does the heavy lifting.&lt;/p&gt;

&lt;p&gt;For each error event, LogSense normalizes unstable fields:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;timestamps&lt;/li&gt;
&lt;li&gt;UUIDs/request IDs&lt;/li&gt;
&lt;li&gt;dynamic numbers/IDs&lt;/li&gt;
&lt;li&gt;environment-specific noise&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Then it hashes the stable structure (message + stack shape + service context).&lt;/p&gt;

&lt;p&gt;So these:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;&lt;code&gt;panic: nil pointer at user_id=12345&lt;/code&gt;&lt;/li&gt;
&lt;li&gt;&lt;code&gt;panic: nil pointer at user_id=67890&lt;/code&gt;&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;collapse into the same canonical signature if they’re the same underlying defect.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Result:&lt;/strong&gt; one root-cause analysis for one issue, regardless of repetition count.&lt;/p&gt;




&lt;h2&gt;
  
  
  Why This Matters in Production
&lt;/h2&gt;

&lt;p&gt;During incident windows, repeated errors dominate traffic.&lt;br&gt;&lt;br&gt;
Without dedup, your AI bill scales with chaos.&lt;br&gt;&lt;br&gt;
With dedup, your AI bill scales with &lt;strong&gt;unique failures&lt;/strong&gt;.&lt;/p&gt;

&lt;p&gt;That’s the model LogSense is built around:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;faster triage&lt;/li&gt;
&lt;li&gt;better incident grouping&lt;/li&gt;
&lt;li&gt;predictable AI spend&lt;/li&gt;
&lt;/ul&gt;




&lt;h2&gt;
  
  
  Example Flow (Pseudo-Go)
&lt;/h2&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight go"&gt;&lt;code&gt;&lt;span class="k"&gt;func&lt;/span&gt; &lt;span class="n"&gt;process&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;event&lt;/span&gt; &lt;span class="n"&gt;LogEvent&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;
    &lt;span class="n"&gt;normalized&lt;/span&gt; &lt;span class="o"&gt;:=&lt;/span&gt; &lt;span class="n"&gt;normalize&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;event&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
    &lt;span class="n"&gt;fp&lt;/span&gt; &lt;span class="o"&gt;:=&lt;/span&gt; &lt;span class="n"&gt;fingerprint&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;normalized&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;

    &lt;span class="k"&gt;if&lt;/span&gt; &lt;span class="n"&gt;cache&lt;/span&gt;&lt;span class="o"&gt;.&lt;/span&gt;&lt;span class="n"&gt;Exists&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;fp&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;
        &lt;span class="n"&gt;cache&lt;/span&gt;&lt;span class="o"&gt;.&lt;/span&gt;&lt;span class="n"&gt;IncrementCount&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;fp&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
        &lt;span class="k"&gt;return&lt;/span&gt;
    &lt;span class="p"&gt;}&lt;/span&gt;

    &lt;span class="n"&gt;analysis&lt;/span&gt; &lt;span class="o"&gt;:=&lt;/span&gt; &lt;span class="n"&gt;llm&lt;/span&gt;&lt;span class="o"&gt;.&lt;/span&gt;&lt;span class="n"&gt;Analyze&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;buildPrompt&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;normalized&lt;/span&gt;&lt;span class="p"&gt;))&lt;/span&gt;
    &lt;span class="n"&gt;cache&lt;/span&gt;&lt;span class="o"&gt;.&lt;/span&gt;&lt;span class="n"&gt;Store&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;fp&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;analysis&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
    &lt;span class="n"&gt;publish&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;analysis&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;span class="p"&gt;}&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Early access is open — join the waitlist at &lt;a href="https://logsense.cloud" rel="noopener noreferrer"&gt;Logsense&lt;/a&gt;&lt;/p&gt;

</description>
      <category>ai</category>
      <category>go</category>
      <category>devops</category>
      <category>kubernetes</category>
    </item>
  </channel>
</rss>
