<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>DEV Community: Hafiz Waleed Ahmed</title>
    <description>The latest articles on DEV Community by Hafiz Waleed Ahmed (@hafizwaleedahmed5).</description>
    <link>https://dev.to/hafizwaleedahmed5</link>
    <image>
      <url>https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F4215220%2F92a0b990-f6cb-4986-a044-81f34cf4809c.png</url>
      <title>DEV Community: Hafiz Waleed Ahmed</title>
      <link>https://dev.to/hafizwaleedahmed5</link>
    </image>
    <atom:link rel="self" type="application/rss+xml" href="https://dev.to/feed/hafizwaleedahmed5"/>
    <language>en</language>
    <item>
      <title>SEO Case Study: 640 Clicks and 40.5K Impressions From a Calculator Website (Real Search Console Data)</title>
      <dc:creator>Hafiz Waleed Ahmed</dc:creator>
      <pubDate>Tue, 03 Nov 2026 06:01:56 +0000</pubDate>
      <link>https://dev.to/hafizwaleedahmed5/seo-case-study-640-clicks-and-405k-impressions-from-a-calculator-website-real-search-console-2p6i</link>
      <guid>https://dev.to/hafizwaleedahmed5/seo-case-study-640-clicks-and-405k-impressions-from-a-calculator-website-real-search-console-2p6i</guid>
      <description>&lt;p&gt;archeryprotools.com got its first Google impressions on 18 April 2026. In October 2026 it got 396 clicks and 20,405 impressions in a single month, from a website that is nothing but archery calculators.&lt;/p&gt;

&lt;p&gt;This is a transparent look at the project using its real Google Search Console data: how it grew month by month, where it stands after the last 3 months (1 August to 31 October 2026), what is working, and exactly what I'm fixing next.&lt;/p&gt;

&lt;h2&gt;
  
  
  The project
&lt;/h2&gt;

&lt;p&gt;archeryprotools.com is a set of free archery calculators: FOC (front of center), arrow spine, arrow drop, draw weight, crossbow ballistics and crossbow arrow speed, plus brand-specific versions for Gold Tip and Victory arrows and blog guides that explain them.&lt;/p&gt;

&lt;p&gt;Tool sites like this are a good SEO test. Every calculator targets a clear search ("foc calculator", "arrow spine calculator"), and the page either solves the problem or it doesn't.&lt;/p&gt;

&lt;h2&gt;
  
  
  Timeline
&lt;/h2&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Stage&lt;/th&gt;
&lt;th&gt;Date&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;Development&lt;/td&gt;
&lt;td&gt;approx. early to mid April 2026&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Domain registered&lt;/td&gt;
&lt;td&gt;18 April 2026 (public registry record)&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;First Google impressions and first click&lt;/td&gt;
&lt;td&gt;18 April 2026 (16 impressions, 1 click that day)&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;October 2026&lt;/td&gt;
&lt;td&gt;396 clicks, 20,405 impressions&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Next&lt;/td&gt;
&lt;td&gt;Page 1 for the main calculator terms, higher CTR&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;h2&gt;
  
  
  Growth month by month
&lt;/h2&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Month (2026)&lt;/th&gt;
&lt;th&gt;Clicks&lt;/th&gt;
&lt;th&gt;Impressions&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;April (18 to 30)&lt;/td&gt;
&lt;td&gt;1&lt;/td&gt;
&lt;td&gt;215&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;May&lt;/td&gt;
&lt;td&gt;13&lt;/td&gt;
&lt;td&gt;1,546&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;June&lt;/td&gt;
&lt;td&gt;14&lt;/td&gt;
&lt;td&gt;1,823&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;July&lt;/td&gt;
&lt;td&gt;24&lt;/td&gt;
&lt;td&gt;3,061&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;August&lt;/td&gt;
&lt;td&gt;82&lt;/td&gt;
&lt;td&gt;8,943&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;September&lt;/td&gt;
&lt;td&gt;162&lt;/td&gt;
&lt;td&gt;11,172&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;October&lt;/td&gt;
&lt;td&gt;396&lt;/td&gt;
&lt;td&gt;20,405&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;p&gt;Growth was slow for the first three months, then it sped up from August. October alone brought more clicks (396) than April to September combined (296).&lt;/p&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Ftvyjo32qpiaf7srh9brf.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Ftvyjo32qpiaf7srh9brf.png" alt="archeryprotools.com Search Console 16-month performance" width="800" height="1000"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;h2&gt;
  
  
  Results: last 3 months (1 Aug to 31 Oct 2026)
&lt;/h2&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Metric&lt;/th&gt;
&lt;th&gt;Value&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;Clicks&lt;/td&gt;
&lt;td&gt;640&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Impressions&lt;/td&gt;
&lt;td&gt;40.5K&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Average CTR&lt;/td&gt;
&lt;td&gt;1.6%&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Average position&lt;/td&gt;
&lt;td&gt;12.3&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;h3&gt;
  
  
  Top pages
&lt;/h3&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Page&lt;/th&gt;
&lt;th&gt;Clicks&lt;/th&gt;
&lt;th&gt;Impressions&lt;/th&gt;
&lt;th&gt;Position&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;/calculators/crossbow-ballistic-calculator&lt;/td&gt;
&lt;td&gt;99&lt;/td&gt;
&lt;td&gt;3,274&lt;/td&gt;
&lt;td&gt;5.3&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;/calculators/arrow-spine-calculator&lt;/td&gt;
&lt;td&gt;77&lt;/td&gt;
&lt;td&gt;1,728&lt;/td&gt;
&lt;td&gt;14.1&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;/ (homepage)&lt;/td&gt;
&lt;td&gt;72&lt;/td&gt;
&lt;td&gt;7,033&lt;/td&gt;
&lt;td&gt;14.8&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;/calculators/arrow-drop-calculator&lt;/td&gt;
&lt;td&gt;59&lt;/td&gt;
&lt;td&gt;1,829&lt;/td&gt;
&lt;td&gt;6.9&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;/foc-calculator&lt;/td&gt;
&lt;td&gt;39&lt;/td&gt;
&lt;td&gt;4,674&lt;/td&gt;
&lt;td&gt;10.1&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;/calculators/crossbow-arrow-speed-calculator&lt;/td&gt;
&lt;td&gt;39&lt;/td&gt;
&lt;td&gt;954&lt;/td&gt;
&lt;td&gt;19.0&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;/calculators/draw-weight-calculator&lt;/td&gt;
&lt;td&gt;38&lt;/td&gt;
&lt;td&gt;1,609&lt;/td&gt;
&lt;td&gt;6.0&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;/blog/foc-calculator-gold-tip-guide&lt;/td&gt;
&lt;td&gt;28&lt;/td&gt;
&lt;td&gt;916&lt;/td&gt;
&lt;td&gt;13.4&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;/calculators/gold-tip-foc-calculator&lt;/td&gt;
&lt;td&gt;26&lt;/td&gt;
&lt;td&gt;520&lt;/td&gt;
&lt;td&gt;8.7&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;/calculators/victory-arrow-spine-calculator&lt;/td&gt;
&lt;td&gt;24&lt;/td&gt;
&lt;td&gt;828&lt;/td&gt;
&lt;td&gt;7.0&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;h3&gt;
  
  
  Top queries
&lt;/h3&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Query&lt;/th&gt;
&lt;th&gt;Clicks&lt;/th&gt;
&lt;th&gt;Impressions&lt;/th&gt;
&lt;th&gt;Position&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;arrow spine calculator&lt;/td&gt;
&lt;td&gt;29&lt;/td&gt;
&lt;td&gt;402&lt;/td&gt;
&lt;td&gt;20.8&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;gold tip foc calculator&lt;/td&gt;
&lt;td&gt;26&lt;/td&gt;
&lt;td&gt;425&lt;/td&gt;
&lt;td&gt;5.9&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;foc calculator&lt;/td&gt;
&lt;td&gt;25&lt;/td&gt;
&lt;td&gt;2,435&lt;/td&gt;
&lt;td&gt;13.1&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;arrow drop calculator&lt;/td&gt;
&lt;td&gt;10&lt;/td&gt;
&lt;td&gt;162&lt;/td&gt;
&lt;td&gt;8.1&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;spine calculator&lt;/td&gt;
&lt;td&gt;8&lt;/td&gt;
&lt;td&gt;152&lt;/td&gt;
&lt;td&gt;41.8&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;bow draw weight calculator&lt;/td&gt;
&lt;td&gt;7&lt;/td&gt;
&lt;td&gt;69&lt;/td&gt;
&lt;td&gt;10.2&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;crossbow speed calculator&lt;/td&gt;
&lt;td&gt;7&lt;/td&gt;
&lt;td&gt;46&lt;/td&gt;
&lt;td&gt;8.7&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;podium archery foc calculator&lt;/td&gt;
&lt;td&gt;6&lt;/td&gt;
&lt;td&gt;559&lt;/td&gt;
&lt;td&gt;4.0&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;victory spine calculator&lt;/td&gt;
&lt;td&gt;6&lt;/td&gt;
&lt;td&gt;258&lt;/td&gt;
&lt;td&gt;6.6&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;crossbow bolt speed calculator&lt;/td&gt;
&lt;td&gt;6&lt;/td&gt;
&lt;td&gt;22&lt;/td&gt;
&lt;td&gt;22.9&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;h2&gt;
  
  
  What's working
&lt;/h2&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Pages in the top 10 get the clicks.&lt;/strong&gt; The crossbow ballistic calculator (position 5.3), arrow drop calculator (6.9) and draw weight calculator (6.0) bring in 196 of the 640 clicks between them.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Brand-specific calculators rank well.&lt;/strong&gt; "podium archery foc calculator" sits at 4.0, "gold tip foc calculator" at 5.9 and "victory spine calculator" at 6.6. Specific tools for specific products are easier to rank than the broad term.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;The technical base is clean.&lt;/strong&gt; No manual actions, no security issues, and the HTTPS report shows 37 HTTPS URLs with 0 non-HTTPS URLs.&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  Problems found
&lt;/h2&gt;

&lt;h3&gt;
  
  
  1. High impressions, low CTR
&lt;/h3&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Page&lt;/th&gt;
&lt;th&gt;Impressions&lt;/th&gt;
&lt;th&gt;Clicks&lt;/th&gt;
&lt;th&gt;CTR&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;/foc-calculator&lt;/td&gt;
&lt;td&gt;4,674&lt;/td&gt;
&lt;td&gt;39&lt;/td&gt;
&lt;td&gt;0.8%&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;/ (homepage)&lt;/td&gt;
&lt;td&gt;7,033&lt;/td&gt;
&lt;td&gt;72&lt;/td&gt;
&lt;td&gt;1.0%&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;p&gt;These two pages hold over 11,700 of the 40.5K impressions. Even a small CTR gain here moves the total.&lt;/p&gt;

&lt;h3&gt;
  
  
  2. Page 2 rankings
&lt;/h3&gt;

&lt;p&gt;The average position is 12.3, just past the first page. "foc calculator" (2,435 impressions) is at 13.1, "arrow spine calculator" at 20.8 and "spine calculator" at 41.8.&lt;/p&gt;

&lt;h3&gt;
  
  
  3. Indexing gaps
&lt;/h3&gt;

&lt;p&gt;58 pages are indexed and 26 are not:&lt;/p&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Reason&lt;/th&gt;
&lt;th&gt;Pages&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;Not found (404)&lt;/td&gt;
&lt;td&gt;9&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Discovered, currently not indexed&lt;/td&gt;
&lt;td&gt;14&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Crawled, currently not indexed&lt;/td&gt;
&lt;td&gt;3&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;h3&gt;
  
  
  4. A sitemap Google can't read
&lt;/h3&gt;

&lt;p&gt;&lt;code&gt;/sitemap.xml&lt;/code&gt; reads successfully with 81 pages. &lt;code&gt;/sitemap-index.xml&lt;/code&gt; shows &lt;strong&gt;"Couldn't fetch"&lt;/strong&gt;.&lt;/p&gt;

&lt;h3&gt;
  
  
  5. Core Web Vitals: no data yet
&lt;/h3&gt;

&lt;p&gt;Both mobile and desktop show "Not enough usage data in the last 90 days", so I can't use field data here yet and I'm relying on lab tests.&lt;/p&gt;

&lt;h2&gt;
  
  
  Fixes and next steps
&lt;/h2&gt;

&lt;ol&gt;
&lt;li&gt;
&lt;strong&gt;Rewrite titles and meta descriptions for /foc-calculator and the homepage.&lt;/strong&gt; Put the exact query first ("FOC Calculator"), say what the user gets (instant FOC %, works for any arrow), and test for a few weeks before changing again.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Push page 2 terms to page 1.&lt;/strong&gt; Add internal links from the blog guides and the brand calculators to /foc-calculator and the arrow spine calculator, using descriptive anchor text. Add short how-to and FAQ sections answering what people search for next (for example, what a good FOC % is).&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Decide what to do with the 2 FOC URLs.&lt;/strong&gt; /foc-calculator and /calculators/gold-tip-foc-calculator target related terms. Make sure each has a clear, distinct purpose so they don't compete.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Clean the 404s.&lt;/strong&gt; Redirect the 9 missing URLs to their closest live calculator, or drop them from the sitemap and internal links.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Help the 14 "Discovered" pages.&lt;/strong&gt; Link to them from pages that already rank and make sure each one has enough unique content to be worth crawling.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Fix or remove /sitemap-index.xml&lt;/strong&gt;, then resubmit so only working sitemaps are listed.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Re-check in 4 weeks&lt;/strong&gt; using the same report: CTR on the two pages above, positions for "foc calculator" and "arrow spine calculator", and the not-indexed count.&lt;/li&gt;
&lt;/ol&gt;

&lt;h2&gt;
  
  
  Takeaway
&lt;/h2&gt;

&lt;p&gt;Impressions tell you Google is testing your page. Clicks come when you reach page 1 and your title matches the search. For a tool site, the biggest wins usually sit on the pages that already have impressions.&lt;/p&gt;

&lt;p&gt;How do you decide which pages to optimize first: clicks, impressions or position?&lt;/p&gt;

</description>
      <category>seo</category>
      <category>webdev</category>
      <category>casestudy</category>
      <category>beginners</category>
    </item>
    <item>
      <title>Google Wants Your Share Links Noindexed by Default: A 5-Step Checklist for Devs</title>
      <dc:creator>Hafiz Waleed Ahmed</dc:creator>
      <pubDate>Mon, 02 Nov 2026 15:16:34 +0000</pubDate>
      <link>https://dev.to/hafizwaleedahmed5/google-wants-your-share-links-noindexed-by-default-a-5-step-checklist-for-devs-43ih</link>
      <guid>https://dev.to/hafizwaleedahmed5/google-wants-your-share-links-noindexed-by-default-a-5-step-checklist-for-devs-43ih</guid>
      <description>&lt;p&gt;Your share feature is working.&lt;br&gt;
But Google keeps indexing every link your users create.&lt;/p&gt;

&lt;p&gt;Here are the practical fixes to keep share links, generated reports and AI tool outputs out of Google's index.&lt;/p&gt;
&lt;h2&gt;
  
  
  What changed
&lt;/h2&gt;

&lt;p&gt;On October 26, 2026, Google updated its Search Central guide "Prevent user-generated spam on your site and platform". The guide now covers "hosting platforms and tools that let users publish shared pages, generated content, or web apps", not just comment forms.&lt;/p&gt;

&lt;p&gt;It also adds a new section, "Only index content meant for Search":&lt;/p&gt;

&lt;blockquote&gt;
&lt;p&gt;When pages are created for direct sharing, collaboration, or utility rather than public search discovery, apply the &lt;code&gt;noindex&lt;/code&gt; rule (using a robots &lt;code&gt;meta&lt;/code&gt; tag or &lt;code&gt;X-Robots-Tag&lt;/code&gt; HTTP response header) or block crawling in &lt;code&gt;robots.txt&lt;/code&gt; by default.&lt;/p&gt;
&lt;/blockquote&gt;

&lt;p&gt;Think invoice links, exported reports, AI tool outputs, shared designs, temporary demo pages and public "view-only" boards.&lt;/p&gt;
&lt;h2&gt;
  
  
  Why it matters
&lt;/h2&gt;

&lt;p&gt;Any feature that lets someone publish a URL in seconds is attractive to spammers. They can create thousands of thin or spammy pages that sit under your domain. Keeping those pages out of the index by default removes most of the reason to abuse the feature.&lt;/p&gt;
&lt;h2&gt;
  
  
  A 5-step checklist
&lt;/h2&gt;

&lt;p&gt;&lt;strong&gt;1. Inventory every URL type users can create.&lt;/strong&gt; Share links, reports, generated outputs, profiles, embeds, preview pages.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;2. Decide which ones belong in Search.&lt;/strong&gt; Usually only a few, such as public profiles or curated templates.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;3. Ship &lt;code&gt;noindex&lt;/code&gt; as the default for everything else.&lt;/strong&gt;&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight html"&gt;&lt;code&gt;&lt;span class="nt"&gt;&amp;lt;meta&lt;/span&gt; &lt;span class="na"&gt;name=&lt;/span&gt;&lt;span class="s"&gt;"robots"&lt;/span&gt; &lt;span class="na"&gt;content=&lt;/span&gt;&lt;span class="s"&gt;"noindex"&lt;/span&gt;&lt;span class="nt"&gt;&amp;gt;&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;or as an HTTP header, which also works for PDFs and other non-HTML files:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight http"&gt;&lt;code&gt;&lt;span class="err"&gt;X-Robots-Tag: noindex
&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;&lt;strong&gt;4. Use &lt;code&gt;robots.txt&lt;/code&gt; only when you also want to stop crawling.&lt;/strong&gt; Google has to crawl a page to see its &lt;code&gt;noindex&lt;/code&gt;. If the URL is blocked in &lt;code&gt;robots.txt&lt;/code&gt;, the tag is never read, and Google's robots.txt docs say a blocked URL can still be indexed if other pages link to it. For URLs that are already indexed, use &lt;code&gt;noindex&lt;/code&gt; first and leave them crawlable until they drop out.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;5. Monitor.&lt;/strong&gt; Google's updated guide recommends checking the Page Indexing and Search performance reports in Search Console for unexpected spikes, and setting alerts when a small number of users generate a large share of indexable URLs.&lt;/p&gt;

&lt;h2&gt;
  
  
  One warning
&lt;/h2&gt;

&lt;p&gt;&lt;code&gt;noindex&lt;/code&gt; is not privacy. Anyone with the link can still open the page. If a shared page holds private data, protect it with a login or expiring access.&lt;/p&gt;

&lt;h2&gt;
  
  
  Your turn
&lt;/h2&gt;

&lt;p&gt;How does your app handle indexing for user-generated share links today?&lt;/p&gt;

</description>
      <category>seo</category>
      <category>webdev</category>
      <category>saas</category>
      <category>beginners</category>
    </item>
    <item>
      <title>One robots.txt Rule to Opt Out of AI Training: What Developers Need to Know (2027)</title>
      <dc:creator>Hafiz Waleed Ahmed</dc:creator>
      <pubDate>Sat, 31 Oct 2026 13:09:36 +0000</pubDate>
      <link>https://dev.to/hafizwaleedahmed5/one-robotstxt-rule-to-opt-out-of-ai-training-what-developers-need-to-know-2027-4k22</link>
      <guid>https://dev.to/hafizwaleedahmed5/one-robotstxt-rule-to-opt-out-of-ai-training-what-developers-need-to-know-2027-4k22</guid>
      <description>&lt;p&gt;On October 30, 2026, Google announced plans to support a &lt;strong&gt;shared AI training control in robots.txt&lt;/strong&gt;, based on work from the IETF's AIPREF working group. Coverage the same day reported that Microsoft and OpenAI will honour it too, and that Anthropic has started building support.&lt;/p&gt;

&lt;p&gt;If you build or maintain websites, here's what it means and what to do (all free).&lt;/p&gt;

&lt;h2&gt;
  
  
  The rule
&lt;/h2&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight apache"&gt;&lt;code&gt;&lt;span class="nc"&gt;User&lt;/span&gt;-Agent: __usage_ai-training
Disallow: /
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Instead of a crawler name, the &lt;code&gt;User-Agent&lt;/code&gt; line holds a &lt;strong&gt;policy token&lt;/strong&gt;. Normal robots.txt path matching applies, so you can opt out site-wide and still allow a folder:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight apache"&gt;&lt;code&gt;&lt;span class="nc"&gt;User&lt;/span&gt;-Agent: __usage_ai-training
Disallow: /
&lt;span class="nc"&gt;Allow&lt;/span&gt;: /press-kit/
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;h2&gt;
  
  
  Timeline (it's not live yet)
&lt;/h2&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Microsoft:&lt;/strong&gt; from February 1, 2027&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Google:&lt;/strong&gt; "early 2027" per its crawler documentation note; the blog says 2027&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;OpenAI:&lt;/strong&gt; "in the coming months"&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Anthropic:&lt;/strong&gt; implementation started, no date&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;It's an IETF draft, so the exact token or details could still change.&lt;/p&gt;

&lt;h2&gt;
  
  
  The Google-Extended catch
&lt;/h2&gt;

&lt;p&gt;Google says that if you use the shared token to opt out &lt;strong&gt;and don't explicitly specify Google-Extended&lt;/strong&gt;, it will treat that as if you disallowed Google-Extended. Google also says sites that allow Google-Extended are eligible to appear and receive clicks via grounding in Gemini Apps.&lt;/p&gt;

&lt;p&gt;So if you want to opt out broadly but still be cited in Gemini, you'd add an explicit allow, knowing that it also lets Google use the content for Gemini:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight conf"&gt;&lt;code&gt;&lt;span class="c"&gt;# Opt out of AI training with all participating AI providers
&lt;/span&gt;&lt;span class="n"&gt;User&lt;/span&gt;-&lt;span class="n"&gt;Agent&lt;/span&gt;: &lt;span class="err"&gt;__&lt;/span&gt;&lt;span class="n"&gt;usage_ai&lt;/span&gt;-&lt;span class="n"&gt;training&lt;/span&gt;
&lt;span class="n"&gt;Disallow&lt;/span&gt;: /

&lt;span class="c"&gt;# Optional: still allow Google's Gemini (training + citations in Gemini Apps)
&lt;/span&gt;&lt;span class="n"&gt;User&lt;/span&gt;-&lt;span class="n"&gt;Agent&lt;/span&gt;: &lt;span class="n"&gt;Google&lt;/span&gt;-&lt;span class="n"&gt;Extended&lt;/span&gt;
&lt;span class="n"&gt;Allow&lt;/span&gt;: /
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;h2&gt;
  
  
  Checklist
&lt;/h2&gt;

&lt;ol&gt;
&lt;li&gt;Open &lt;code&gt;yoursite.com/robots.txt&lt;/code&gt; and see what's already there.&lt;/li&gt;
&lt;li&gt;Decide: protect your content from training, or stay visible in AI answers?&lt;/li&gt;
&lt;li&gt;If opting out, add the shared token group.&lt;/li&gt;
&lt;li&gt;Decide on Google-Extended explicitly, so nothing happens by default.&lt;/li&gt;
&lt;li&gt;Google Search rankings aren't affected. Re-check the spec in early 2027.&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;&lt;strong&gt;What would you choose for your projects: block, allow, or a mix by folder?&lt;/strong&gt;&lt;/p&gt;

</description>
      <category>seo</category>
      <category>webdev</category>
      <category>ai</category>
      <category>robots</category>
    </item>
    <item>
      <title>Google's AI Overviews Now Link Out More: A Free, Developer-Friendly Checklist to Get Cited</title>
      <dc:creator>Hafiz Waleed Ahmed</dc:creator>
      <pubDate>Fri, 30 Oct 2026 13:09:33 +0000</pubDate>
      <link>https://dev.to/hafizwaleedahmed5/googles-ai-overviews-now-link-out-more-a-free-developer-friendly-checklist-to-get-cited-l4</link>
      <guid>https://dev.to/hafizwaleedahmed5/googles-ai-overviews-now-link-out-more-a-free-developer-friendly-checklist-to-get-cited-l4</guid>
      <description>&lt;p&gt;If an AI answer quotes your competitor instead of you, the problem is usually the page, not the algorithm.&lt;/p&gt;

&lt;p&gt;On &lt;strong&gt;October 15, 2026&lt;/strong&gt;, Google announced a set of updates to &lt;strong&gt;AI Mode and AI Overviews&lt;/strong&gt;. The short version: Google says it is showing &lt;strong&gt;more inline links, higher up&lt;/strong&gt; in AI responses, testing a &lt;strong&gt;dedicated section for official websites&lt;/strong&gt; on some task-type queries, expanding &lt;strong&gt;timely-article carousels&lt;/strong&gt; to more locations and languages, and making &lt;strong&gt;related-article links&lt;/strong&gt; more prominent with thumbnails.&lt;/p&gt;

&lt;p&gt;At the same time, Search Console's &lt;strong&gt;Generative AI performance report&lt;/strong&gt; has been available to all sites worldwide since &lt;strong&gt;August 31, 2026&lt;/strong&gt;. It shows &lt;strong&gt;impressions&lt;/strong&gt; from AI Overviews and AI Mode. It does &lt;strong&gt;not&lt;/strong&gt; show clicks.&lt;/p&gt;

&lt;p&gt;As someone who builds websites and also handles marketing, I see this as a developer task as much as a content task. Here's a free checklist.&lt;/p&gt;

&lt;h2&gt;
  
  
  What changed
&lt;/h2&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Change (per Google, Oct 15)&lt;/th&gt;
&lt;th&gt;Why devs should care&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;More inline links, shown higher&lt;/td&gt;
&lt;td&gt;Sections that answer clearly are easier to link to&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Test: dedicated section for official sites&lt;/td&gt;
&lt;td&gt;Your pricing, contact, policy and docs pages must be crawlable and clear&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Timely-article carousels in more regions/languages&lt;/td&gt;
&lt;td&gt;Fresh, dated content has more chances to show&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;Related links get thumbnails&lt;/td&gt;
&lt;td&gt;Good images and metadata matter&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;p&gt;Google hasn't published click data for these features, so treat everything below as &lt;strong&gt;good practice, not a guaranteed ranking trick&lt;/strong&gt;.&lt;/p&gt;

&lt;h2&gt;
  
  
  1. Put the answer first
&lt;/h2&gt;

&lt;p&gt;AI answers lift short, self-contained explanations. Start important pages with a 1-2 sentence direct answer, then go into detail.&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight html"&gt;&lt;code&gt;&lt;span class="nt"&gt;&amp;lt;h2&amp;gt;&lt;/span&gt;How long does website migration take?&lt;span class="nt"&gt;&amp;lt;/h2&amp;gt;&lt;/span&gt;
&lt;span class="nt"&gt;&amp;lt;p&amp;gt;&lt;/span&gt;A small site usually takes a few days; larger sites with many URLs need more planning and testing.&lt;span class="nt"&gt;&amp;lt;/p&amp;gt;&lt;/span&gt;
&lt;span class="c"&gt;&amp;lt;!-- details, steps, examples below --&amp;gt;&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;h2&gt;
  
  
  2. Write headings like real questions
&lt;/h2&gt;

&lt;p&gt;Use &lt;code&gt;h2&lt;/code&gt;/&lt;code&gt;h3&lt;/code&gt; that match how users actually search. Keep one topic per section so a link can point to it cleanly. Free ways to find real questions: Google's "People also ask", Google Trends, and your own Search Console queries.&lt;/p&gt;

&lt;h2&gt;
  
  
  3. Make official pages crawlable and indexable
&lt;/h2&gt;

&lt;p&gt;Google's new test highlights official pages for certain tasks. Check:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;No accidental &lt;code&gt;noindex&lt;/code&gt; on pricing/contact/policy/docs pages&lt;/li&gt;
&lt;li&gt;Not blocked in &lt;code&gt;robots.txt&lt;/code&gt;
&lt;/li&gt;
&lt;li&gt;Important content is in rendered HTML, not hidden behind clicks that need user interaction&lt;/li&gt;
&lt;li&gt;One canonical URL per page&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Free checks: Search Console &lt;strong&gt;URL Inspection&lt;/strong&gt;, and &lt;code&gt;curl -I https://example.com/page&lt;/code&gt; to confirm a &lt;code&gt;200&lt;/code&gt; status.&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;curl &lt;span class="nt"&gt;-sI&lt;/span&gt; https://example.com/pricing | &lt;span class="nb"&gt;head&lt;/span&gt; &lt;span class="nt"&gt;-n&lt;/span&gt; 1
curl &lt;span class="nt"&gt;-s&lt;/span&gt; https://example.com/robots.txt
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;h2&gt;
  
  
  4. Show who wrote it and when
&lt;/h2&gt;

&lt;p&gt;Add a visible author and a real "last updated" date, and keep structured data honest:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight html"&gt;&lt;code&gt;&lt;span class="nt"&gt;&amp;lt;script &lt;/span&gt;&lt;span class="na"&gt;type=&lt;/span&gt;&lt;span class="s"&gt;"application/ld+json"&lt;/span&gt;&lt;span class="nt"&gt;&amp;gt;&lt;/span&gt;
&lt;span class="p"&gt;{&lt;/span&gt;
  &lt;span class="dl"&gt;"&lt;/span&gt;&lt;span class="s2"&gt;@context&lt;/span&gt;&lt;span class="dl"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="dl"&gt;"&lt;/span&gt;&lt;span class="s2"&gt;https://schema.org&lt;/span&gt;&lt;span class="dl"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
  &lt;span class="dl"&gt;"&lt;/span&gt;&lt;span class="s2"&gt;@type&lt;/span&gt;&lt;span class="dl"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="dl"&gt;"&lt;/span&gt;&lt;span class="s2"&gt;Article&lt;/span&gt;&lt;span class="dl"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
  &lt;span class="dl"&gt;"&lt;/span&gt;&lt;span class="s2"&gt;headline&lt;/span&gt;&lt;span class="dl"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="dl"&gt;"&lt;/span&gt;&lt;span class="s2"&gt;How long does website migration take?&lt;/span&gt;&lt;span class="dl"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
  &lt;span class="dl"&gt;"&lt;/span&gt;&lt;span class="s2"&gt;author&lt;/span&gt;&lt;span class="dl"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="dl"&gt;"&lt;/span&gt;&lt;span class="s2"&gt;@type&lt;/span&gt;&lt;span class="dl"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="dl"&gt;"&lt;/span&gt;&lt;span class="s2"&gt;Person&lt;/span&gt;&lt;span class="dl"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="dl"&gt;"&lt;/span&gt;&lt;span class="s2"&gt;name&lt;/span&gt;&lt;span class="dl"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="dl"&gt;"&lt;/span&gt;&lt;span class="s2"&gt;Your Name&lt;/span&gt;&lt;span class="dl"&gt;"&lt;/span&gt;&lt;span class="p"&gt;},&lt;/span&gt;
  &lt;span class="dl"&gt;"&lt;/span&gt;&lt;span class="s2"&gt;dateModified&lt;/span&gt;&lt;span class="dl"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="dl"&gt;"&lt;/span&gt;&lt;span class="s2"&gt;2026-10-30&lt;/span&gt;&lt;span class="dl"&gt;"&lt;/span&gt;
&lt;span class="p"&gt;}&lt;/span&gt;
&lt;span class="nt"&gt;&amp;lt;/script&amp;gt;&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Only update &lt;code&gt;dateModified&lt;/code&gt; when you actually change the content.&lt;/p&gt;

&lt;h2&gt;
  
  
  5. Measure with the free Generative AI report
&lt;/h2&gt;

&lt;p&gt;In Search Console, open the &lt;strong&gt;Generative AI performance&lt;/strong&gt; report:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Which pages get AI impressions?&lt;/li&gt;
&lt;li&gt;Which countries and devices?&lt;/li&gt;
&lt;li&gt;Compare those pages with the normal &lt;strong&gt;Performance&lt;/strong&gt; report: did clicks change?&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Because the report shows impressions only, the comparison is the useful part.&lt;/p&gt;

&lt;h2&gt;
  
  
  Quick checklist
&lt;/h2&gt;

&lt;ul&gt;
&lt;li&gt;[ ] Direct answer in the first 2 lines&lt;/li&gt;
&lt;li&gt;[ ] Question-style H2/H3&lt;/li&gt;
&lt;li&gt;[ ] Official pages indexable (no stray &lt;code&gt;noindex&lt;/code&gt;, not blocked)&lt;/li&gt;
&lt;li&gt;[ ] Visible author + honest &lt;code&gt;dateModified&lt;/code&gt;
&lt;/li&gt;
&lt;li&gt;[ ] Monthly look at the Generative AI report vs Performance&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  Wrapping up
&lt;/h2&gt;

&lt;p&gt;The Oct 15 update doesn't change the basics. It rewards them. Pages that are clear, fast, crawlable and honest about who wrote them are easier for any search system, AI or not, to quote.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Which of these five does your current project miss? Tell me in the comments.&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;&lt;em&gt;Sources: &lt;a href="https://blog.google/products-and-platforms/products/search/updates-ai-mode-overviews-explore-web/" rel="noopener noreferrer"&gt;Google Keyword blog (Oct 15, 2026)&lt;/a&gt;, &lt;a href="https://support.google.com/webmasters/answer/16984139" rel="noopener noreferrer"&gt;Search Console Help: Generative AI performance report&lt;/a&gt;.&lt;/em&gt;&lt;/p&gt;

</description>
      <category>seo</category>
      <category>webdev</category>
      <category>ai</category>
      <category>beginners</category>
    </item>
  </channel>
</rss>
