<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>DEV Community: Timothy Kelvin</title>
    <description>The latest articles on DEV Community by Timothy Kelvin (@timmkal01).</description>
    <link>https://dev.to/timmkal01</link>
    <image>
      <url>https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F4110897%2F4db131a3-cc29-429d-9ed4-47b61ce0761e.jpg</url>
      <title>DEV Community: Timothy Kelvin</title>
      <link>https://dev.to/timmkal01</link>
    </image>
    <atom:link rel="self" type="application/rss+xml" href="https://dev.to/feed/timmkal01"/>
    <language>en</language>
    <item>
      <title>Fingerprinting a website's tech stack from a single HTTP request (no headless browser)</title>
      <dc:creator>Timothy Kelvin</dc:creator>
      <pubDate>Sat, 05 Sep 2026 08:47:43 +0000</pubDate>
      <link>https://dev.to/timmkal01/fingerprinting-a-websites-tech-stack-from-a-single-http-request-no-headless-browser-18l7</link>
      <guid>https://dev.to/timmkal01/fingerprinting-a-websites-tech-stack-from-a-single-http-request-no-headless-browser-18l7</guid>
      <description>&lt;p&gt;I wanted a fast way to answer "what's this site built with?" — CMS, ecommerce platform, JS framework, analytics tags, CDN, payment/chat widgets — without spinning up a full headless browser per URL.&lt;/p&gt;

&lt;h2&gt;
  
  
  The approach
&lt;/h2&gt;

&lt;p&gt;One plain HTTP fetch of the homepage via &lt;a href="https://crawlee.dev" rel="noopener noreferrer"&gt;Crawlee&lt;/a&gt;'s &lt;code&gt;CheerioCrawler&lt;/code&gt;, then check three things against a signature table:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Response headers (&lt;code&gt;Server&lt;/code&gt;, &lt;code&gt;X-Powered-By&lt;/code&gt;, &lt;code&gt;CF-Ray&lt;/code&gt;, &lt;code&gt;X-Vercel-Id&lt;/code&gt;, etc.)&lt;/li&gt;
&lt;li&gt;The &lt;code&gt;&amp;lt;meta name="generator"&amp;gt;&lt;/code&gt; tag&lt;/li&gt;
&lt;li&gt;
&lt;code&gt;&amp;lt;script src&amp;gt;&lt;/code&gt; domains on the page&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Same general idea as Wappalyzer, just a much smaller, hand-written signature set — about 30 technologies across 7 categories (CMS, ecommerce, JS frameworks, analytics, CDN/hosting, payment, live chat). Each signature is a &lt;code&gt;test(context)&lt;/code&gt; function:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight javascript"&gt;&lt;code&gt;&lt;span class="p"&gt;{&lt;/span&gt;
  &lt;span class="nl"&gt;name&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="dl"&gt;'&lt;/span&gt;&lt;span class="s1"&gt;WordPress&lt;/span&gt;&lt;span class="dl"&gt;'&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
  &lt;span class="nx"&gt;category&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="dl"&gt;'&lt;/span&gt;&lt;span class="s1"&gt;cms&lt;/span&gt;&lt;span class="dl"&gt;'&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
  &lt;span class="nx"&gt;test&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;({&lt;/span&gt; &lt;span class="nx"&gt;generator&lt;/span&gt; &lt;span class="p"&gt;})&lt;/span&gt; &lt;span class="o"&gt;=&amp;gt;&lt;/span&gt; &lt;span class="nx"&gt;generator&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;includes&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="dl"&gt;'&lt;/span&gt;&lt;span class="s1"&gt;wordpress&lt;/span&gt;&lt;span class="dl"&gt;'&lt;/span&gt;&lt;span class="p"&gt;),&lt;/span&gt;
&lt;span class="p"&gt;}&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;&lt;code&gt;context&lt;/code&gt; gives you lowercased &lt;code&gt;headers&lt;/code&gt;, &lt;code&gt;html&lt;/code&gt;, &lt;code&gt;scriptSrcs&lt;/code&gt;, and &lt;code&gt;generator&lt;/code&gt; — cheap to check, no DOM traversal needed for most signatures.&lt;/p&gt;

&lt;h2&gt;
  
  
  What it deliberately doesn't do
&lt;/h2&gt;

&lt;ul&gt;
&lt;li&gt;No headless browser. Everything it reads is already served to any visitor's plain HTTP request — no JS execution, no login, no bypassing any protection.&lt;/li&gt;
&lt;li&gt;No guessing. If nothing in the signature table matches, it returns an empty result for that category rather than a fuzzy best-guess. A smaller-but-honest signature set beats a big one that's confidently wrong.&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  Where it fell short (and stayed that way, on purpose)
&lt;/h2&gt;

&lt;p&gt;Detection accuracy is bounded by however many signatures I've hand-written — it's ~30 technologies, not the hundreds Wappalyzer tracks. Sites using something niche just come back with an empty category instead of a wrong guess. That's a real limitation, not a bug, and the tradeoff I'd make again: adding a signature is one function, so it grows exactly as fast as real usage demands it, not ahead of it.&lt;/p&gt;

&lt;h2&gt;
  
  
  Try it
&lt;/h2&gt;

&lt;ul&gt;
&lt;li&gt;Source: &lt;a href="https://github.com/timmKal01/website-tech-stack-detector" rel="noopener noreferrer"&gt;github.com/timmKal01/website-tech-stack-detector&lt;/a&gt;
&lt;/li&gt;
&lt;li&gt;Hosted version (Apify actor, no setup): &lt;a href="https://apify.com/m_ctim/website-tech-stack-detector" rel="noopener noreferrer"&gt;apify.com/m_ctim/website-tech-stack-detector&lt;/a&gt;
&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;If you've got a signature I'm missing, &lt;code&gt;signatures.js&lt;/code&gt; is a small file — happy to take PRs or just hear about the gap.&lt;/p&gt;

</description>
      <category>webdev</category>
      <category>javascript</category>
      <category>scraping</category>
      <category>node</category>
    </item>
  </channel>
</rss>
