<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>DEV Community: Candy Xie</title>
    <description>The latest articles on DEV Community by Candy Xie (@candpixie).</description>
    <link>https://dev.to/candpixie</link>
    <image>
      <url>https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F4246145%2F0768185e-ab91-40e1-8083-741ea09c8669.png</url>
      <title>DEV Community: Candy Xie</title>
      <link>https://dev.to/candpixie</link>
    </image>
    <atom:link rel="self" type="application/rss+xml" href="https://dev.to/feed/candpixie"/>
    <language>en</language>
    <item>
      <title>We sent real AI shopping agents to websites to see if they could buy.</title>
      <dc:creator>Candy Xie</dc:creator>
      <pubDate>Sun, 15 Nov 2026 15:17:11 +0000</pubDate>
      <link>https://dev.to/candpixie/we-sent-real-ai-shopping-agents-to-websites-to-see-if-they-could-buy-38c1</link>
      <guid>https://dev.to/candpixie/we-sent-real-ai-shopping-agents-to-websites-to-see-if-they-could-buy-38c1</guid>
      <description>&lt;p&gt;People have started telling ChatGPT, Gemini or Claude "find me X under $Y and order it." The agent reads your site, compares you with the others, and decides. If it can't find your price or tell whether something is a subscription, it skips you, and you never learn you lost a customer.&lt;/p&gt;

&lt;p&gt;This isn't a someday problem. Traffic from AI sources to US retail sites rose 393% year over year in Q1 2026, and those visits converted 42% better than other traffic (&lt;a href="https://cmotech.news/story/adobe-says-ai-retail-traffic-surges-as-readability-lags" rel="noopener noreferrer"&gt;Adobe, via CMOtech&lt;/a&gt;). Morgan Stanley expects AI agents to make 10% to 20% of US online shopping spending by 2030 (&lt;a href="https://www.digitalcommerce360.com/2025/12/09/morgan-stanley-ai-agentic-shoppers-385-billion-online-sales/" rel="noopener noreferrer"&gt;Digital Commerce 360&lt;/a&gt;).&lt;/p&gt;

&lt;p&gt;So at HackPrinceton Fall 2026 we built &lt;strong&gt;Will Agents Buy?&lt;/strong&gt;: paste a website, and real AI shopping agents plus AI customers with real preferences open it in a real browser, try to buy, talk about it, and tell the owner what to fix.&lt;/p&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fzrjry9x1hbu4w5hj12hv.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fzrjry9x1hbu4w5hj12hv.png" alt=" " width="800" height="533"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;h2&gt;
  
  
  Two layers, two levels of trust
&lt;/h2&gt;

&lt;p&gt;The sharpest feedback we got at the hackathon was that AI personas aren't people. That's right, and we don't pretend otherwise. So the product has two layers:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;AI shopping agents.&lt;/strong&gt; One each from Gemini, Claude and GPT, sent on the errand a real user would give them. When the shopper &lt;em&gt;is&lt;/em&gt; an AI agent, testing with the actual agents isn't a simulation. It's the measurement.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;AI customers.&lt;/strong&gt; A price-sensitive student, a skeptic, a first-timer, each with a budget, a goal and a share of the customer base. This layer is a fast first pass, and we grade it against real data (more below).&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;On our demo listing (a training mannequin head from the public Amazon Reviews 2023 dataset), the Gemini and GPT agents bought it. The Claude agent refused: &lt;em&gt;"the checkout page showed no shipping, tax, return, or delivery terms, so I couldn't verify the real total."&lt;/em&gt; That's a fix an owner can ship today.&lt;/p&gt;

&lt;h2&gt;
  
  
  How a shopper works
&lt;/h2&gt;

&lt;p&gt;Every shopper is a LangChain agent with its own model and its own Chromium browser (Playwright). Each step it gets a screenshot plus a list of things it can click, thinks in character, and picks one action: click, scroll, back, search, add to cart, or decide. Every step is saved with the screenshot, the thought and the exact prompt, so you can trace any decision.&lt;/p&gt;

&lt;p&gt;When a director agent runs the test (a LangChain Deep Agents &lt;code&gt;create_deep_agent&lt;/code&gt;), each shopper becomes a subagent, several shop at once through the &lt;code&gt;task&lt;/code&gt; tool, and the run pauses for the owner to approve the panel with an interrupt.&lt;/p&gt;

&lt;h2&gt;
  
  
  Bug 1: every site said 0 of 7 would buy
&lt;/h2&gt;

&lt;p&gt;Our first runs said nobody would buy, on every website. It looked like a damning insight. It was our bug.&lt;/p&gt;

&lt;p&gt;Most sites render their nav twice: once for desktop, once hidden for mobile. We handed the model every &lt;code&gt;&amp;lt;a&amp;gt;&lt;/code&gt; on the page. It picked "Shop", Playwright's locator resolved to the hidden mobile copy, the click timed out, and every customer circled the homepage until they gave up.&lt;/p&gt;

&lt;p&gt;The fix: only offer what a person can actually see, screen first.&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight javascript"&gt;&lt;code&gt;&lt;span class="kd"&gt;const&lt;/span&gt; &lt;span class="n"&gt;els&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nb"&gt;document&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;querySelectorAll&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="s1"&gt;'a[href], button, label, summary, [role=button], [role=link], [role=tab], [role=checkbox], input[type=submit]'&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;&lt;span class="p"&gt;;&lt;/span&gt;
&lt;span class="c1"&gt;// what's on screen first, then the rest of the page&lt;/span&gt;
&lt;span class="n"&gt;els&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;sort&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;a&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;b&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt; &lt;span class="o"&gt;=&amp;gt;&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt; &lt;span class="kd"&gt;const&lt;/span&gt; &lt;span class="n"&gt;ra&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;a&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;getBoundingClientRect&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;rb&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;b&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;getBoundingClientRect&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;;&lt;/span&gt;
  &lt;span class="k"&gt;return&lt;/span&gt; &lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;ra&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="n"&gt;top&lt;/span&gt; &lt;span class="o"&gt;&amp;gt;&lt;/span&gt; &lt;span class="n"&gt;innerHeight&lt;/span&gt; &lt;span class="o"&gt;||&lt;/span&gt; &lt;span class="n"&gt;ra&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="n"&gt;bottom&lt;/span&gt; &lt;span class="o"&gt;&amp;lt;&lt;/span&gt; &lt;span class="mi"&gt;0&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt; &lt;span class="o"&gt;-&lt;/span&gt; &lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;rb&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="n"&gt;top&lt;/span&gt; &lt;span class="o"&gt;&amp;gt;&lt;/span&gt; &lt;span class="n"&gt;innerHeight&lt;/span&gt; &lt;span class="o"&gt;||&lt;/span&gt; &lt;span class="n"&gt;rb&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="n"&gt;bottom&lt;/span&gt; &lt;span class="o"&gt;&amp;lt;&lt;/span&gt; &lt;span class="mi"&gt;0&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;;&lt;/span&gt; &lt;span class="p"&gt;}&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;;&lt;/span&gt;
&lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="kd"&gt;const&lt;/span&gt; &lt;span class="n"&gt;e&lt;/span&gt; &lt;span class="k"&gt;of&lt;/span&gt; &lt;span class="n"&gt;els&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;
  &lt;span class="kd"&gt;const&lt;/span&gt; &lt;span class="n"&gt;r&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;e&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;getBoundingClientRect&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;st&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="nf"&gt;getComputedStyle&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;e&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;&lt;span class="p"&gt;;&lt;/span&gt;
  &lt;span class="k"&gt;if&lt;/span&gt; &lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;r&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="n"&gt;width&lt;/span&gt; &lt;span class="o"&gt;&amp;lt;&lt;/span&gt; &lt;span class="mi"&gt;2&lt;/span&gt; &lt;span class="o"&gt;||&lt;/span&gt; &lt;span class="n"&gt;r&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="n"&gt;height&lt;/span&gt; &lt;span class="o"&gt;&amp;lt;&lt;/span&gt; &lt;span class="mi"&gt;2&lt;/span&gt; &lt;span class="o"&gt;||&lt;/span&gt; &lt;span class="n"&gt;st&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="n"&gt;visibility&lt;/span&gt; &lt;span class="o"&gt;===&lt;/span&gt; &lt;span class="s1"&gt;'hidden'&lt;/span&gt; &lt;span class="o"&gt;||&lt;/span&gt; &lt;span class="n"&gt;st&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="n"&gt;display&lt;/span&gt; &lt;span class="o"&gt;===&lt;/span&gt; &lt;span class="s1"&gt;'none'&lt;/span&gt; &lt;span class="o"&gt;||&lt;/span&gt; &lt;span class="n"&gt;st&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="n"&gt;opacity&lt;/span&gt; &lt;span class="o"&gt;===&lt;/span&gt; &lt;span class="s1"&gt;'0'&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt; &lt;span class="k"&gt;continue&lt;/span&gt;&lt;span class="p"&gt;;&lt;/span&gt;
  &lt;span class="c1"&gt;// ...keep its text, and its href so a link goes where it actually points&lt;/span&gt;
&lt;span class="p"&gt;}&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;If the chosen text maps to a real link, we &lt;code&gt;goto&lt;/code&gt; the href instead of clicking. We also follow links that open a new tab, the way a person would.&lt;/p&gt;

&lt;h2&gt;
  
  
  Bug 2: bot walls blamed the business
&lt;/h2&gt;

&lt;p&gt;Plenty of sites show "verify you are human" to automated browsers and quietly empty their carts. Our customers then wrote angry reviews of stores that did nothing wrong. Now we detect bot walls, exclude those steps, and tell the shopper an empty cart is our test setup, not the store.&lt;/p&gt;

&lt;h2&gt;
  
  
  Bug 3: what counts as a sale
&lt;/h2&gt;

&lt;p&gt;Models hedge. One customer picked a size, opened the cart, and then said "maybe later." First we counted any add-to-cart click as a sale. That inflated everything. Now the outcome is strict:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;On a real website our shoppers never pay, so a sale is a final decision of "buy".&lt;/li&gt;
&lt;li&gt;On a store we generate from a product description, checkout needs no payment, so a sale means actually placing the order.&lt;/li&gt;
&lt;li&gt;Cart, then "maybe later", is an abandoned cart, not a sale.&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  Bug 4: Apple's configurator
&lt;/h2&gt;

&lt;p&gt;On apple.com every shopper got stuck clicking "256GB" over and over. Storage is a disabled radio button until you pick a color, so the click just timed out, and the model only heard "it didn't work." Now, when a click fails, we check whether the target is disabled and say why:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="no"&gt;DISABLED_JS&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="s2"&gt;"""t =&amp;gt; { t = t.toLowerCase();
  const hit = [...document.querySelectorAll('label, button, [role=radio], [role=option], a')]
    .filter(e =&amp;gt; (e.innerText || '').toLowerCase().includes(t));
  return hit.some(e =&amp;gt; { const i = e.control || e.querySelector('input') || (e.htmlFor &amp;amp;&amp;amp; document.getElementById(e.htmlFor));
    return e.disabled || e.getAttribute('aria-disabled') === 'true' || (i &amp;amp;&amp;amp; i.disabled); }); }"""&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;The shopper hears: "it's greyed out, it unlocks after an earlier choice, pick the color first." A failed-click message that names the reason beats a generic error in any LLM tool loop.&lt;/p&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fhzuoz8p3xzxraumpq12i.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fhzuoz8p3xzxraumpq12i.png" alt=" " width="800" height="533"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;h2&gt;
  
  
  Checking ourselves against real reviews
&lt;/h2&gt;

&lt;p&gt;We wanted a number we didn't tune to look good. We took that mannequin head (881 reviews), split the reviews by date, rebuilt the listing without any reviews, and let our customers shop it.&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Cold&lt;/strong&gt;, they named 3 of the 6 themes real reviewers wrote about.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;After learning from the older half&lt;/strong&gt;, they named 5 of 6, scored only on the newer reviews they never saw.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Their star ratings stayed 1.4 to 2 stars too harsh.&lt;/strong&gt; We report that instead of hiding it.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;So the honest pitch is "they find what your real buyers will complain about", not "they predict your star rating". Not yet.&lt;/p&gt;

&lt;h2&gt;
  
  
  What spreads
&lt;/h2&gt;

&lt;p&gt;After shopping, customers post about their visit, then reply, repost or scroll past each other's posts. We build the who-reacted-to-whom graph and run PageRank (damping 0.85) to find whose opinion travels furthest. On the mannequin head, the doubt that spread was whether the hair is really human, so the top fix became "state one hair material and add proof."&lt;/p&gt;

&lt;p&gt;&lt;a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2F1ixjkd40ubttrwqnk6ve.png" class="article-body-image-wrapper"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2F1ixjkd40ubttrwqnk6ve.png" alt=" " width="800" height="533"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;Gemini then looks at the exact screenshots where customers got stuck and draws boxes around the part of the page that caused it.&lt;/p&gt;

&lt;h2&gt;
  
  
  Stack
&lt;/h2&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;LangChain + Deep Agents&lt;/strong&gt; for the shoppers, the director and its subagents, with long-term customer memory in a LangGraph store&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Playwright&lt;/strong&gt; for one real browser per shopper&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Gemini, Claude and GPT&lt;/strong&gt; as shoppers, with Gemini also running the screenshot lens&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;MongoDB Atlas&lt;/strong&gt; with Vector Search for memory that carries across businesses&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;NetworkX&lt;/strong&gt; for the word-of-mouth graph&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Photon&lt;/strong&gt; so an owner can run a test over iMessage&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;LangSmith&lt;/strong&gt; tracing, &lt;strong&gt;Vultr&lt;/strong&gt; for deploy, React + TypeScript for the app&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  What we learned
&lt;/h2&gt;

&lt;ul&gt;
&lt;li&gt;Simulated customers are pessimistic by default. Most of the work was removing reasons to say no that a real person would never hit: hidden links, bot walls, dead buttons, configurators.&lt;/li&gt;
&lt;li&gt;What an AI agent needs is different from what a person needs. A page can win people over with photos and still lose the agent because the total isn't written down.&lt;/li&gt;
&lt;li&gt;Measuring accuracy changed our pitch, for the better.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Built at HackPrinceton Fall 2026 with Sarah and Jayden.&lt;br&gt;
Devpost: &lt;a href="https://devpost.com/software/will-agents-buy" rel="noopener noreferrer"&gt;https://devpost.com/software/will-agents-buy&lt;/a&gt;&lt;/p&gt;

</description>
      <category>ai</category>
      <category>webdev</category>
      <category>programming</category>
      <category>opensource</category>
    </item>
  </channel>
</rss>
