<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>DEV Community: Roman</title>
    <description>The latest articles on DEV Community by Roman (@pagewright).</description>
    <link>https://dev.to/pagewright</link>
    <image>
      <url>https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F4090441%2Fcf0e9888-2a60-4388-8578-971e37e49ec3.png</url>
      <title>DEV Community: Roman</title>
      <link>https://dev.to/pagewright</link>
    </image>
    <atom:link rel="self" type="application/rss+xml" href="https://dev.to/feed/pagewright"/>
    <language>en</language>
    <item>
      <title>Your Amazon scraper is returning mixed currencies and won't tell you</title>
      <dc:creator>Roman</dc:creator>
      <pubDate>Sun, 23 Aug 2026 05:31:13 +0000</pubDate>
      <link>https://dev.to/pagewright/your-amazon-scraper-is-returning-mixed-currencies-and-wont-tell-you-ohc</link>
      <guid>https://dev.to/pagewright/your-amazon-scraper-is-returning-mixed-currencies-and-wont-tell-you-ohc</guid>
      <description>&lt;p&gt;If you scrape Amazon through rotating residential proxies, your price column&lt;br&gt;
probably contains dollars, euros and zloty at the same time. Nothing in the&lt;br&gt;
markup says which is which, no error is raised, and the mixture changes from run&lt;br&gt;
to run.&lt;/p&gt;

&lt;p&gt;I spent a week measuring what an Amazon scraper actually gets back. Below are the&lt;br&gt;
numbers I logged, including one measurement I have not seen published anywhere:&lt;br&gt;
how fast a single IP burns out.&lt;/p&gt;
&lt;h2&gt;
  
  
  Currency roulette
&lt;/h2&gt;

&lt;p&gt;Amazon decides your country from the IP address of the request and returns prices&lt;br&gt;
in that country's currency. It does not label the number. Same URL, same product,&lt;br&gt;
same day, two different exits:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight plaintext"&gt;&lt;code&gt;amazon.com from a European IP   -&amp;gt;  8.63
amazon.com from an Asian IP     -&amp;gt;  390037
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Both are correct prices for the same Logitech mouse — €8.63 and ₫390,037. If your&lt;br&gt;
proxy pool rotates across countries and you strip the symbol to get a clean&lt;br&gt;
number, those two land in the same column with nothing to separate them.&lt;/p&gt;

&lt;p&gt;The symbol &lt;em&gt;is&lt;/em&gt; in the markup, in &lt;code&gt;a-offscreen&lt;/code&gt;:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight html"&gt;&lt;code&gt;&lt;span class="nt"&gt;&amp;lt;span&lt;/span&gt; &lt;span class="na"&gt;class=&lt;/span&gt;&lt;span class="s"&gt;"a-offscreen"&lt;/span&gt;&lt;span class="nt"&gt;&amp;gt;&lt;/span&gt;EUR 8.63&lt;span class="nt"&gt;&amp;lt;/span&amp;gt;&lt;/span&gt;
&lt;span class="nt"&gt;&amp;lt;span&lt;/span&gt; &lt;span class="na"&gt;class=&lt;/span&gt;&lt;span class="s"&gt;"a-offscreen"&lt;/span&gt;&lt;span class="nt"&gt;&amp;gt;&lt;/span&gt;$12.99&lt;span class="nt"&gt;&amp;lt;/span&amp;gt;&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Most parsers throw it away, because a currency symbol is inconvenient when you&lt;br&gt;
want a float. That is where the data dies.&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Fix:&lt;/strong&gt; pin the proxy country to the marketplace you asked for, keep the symbol,&lt;br&gt;
resolve it to an ISO code, and check it against what that marketplace should have&lt;br&gt;
returned. Flag mismatches instead of shipping them quietly.&lt;/p&gt;
&lt;h3&gt;
  
  
  "Just set the currency cookie" — I checked, and it lies
&lt;/h3&gt;

&lt;p&gt;The obvious objection is that you do not need proxies at all: Amazon honours an&lt;br&gt;
&lt;code&gt;i18n-prefs&lt;/code&gt; cookie. It does. From a European IP:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight csvs"&gt;&lt;code&gt;&lt;span class="k"&gt;no&lt;/span&gt; &lt;span class="k"&gt;cookie&lt;/span&gt;              &lt;span class="k"&gt;EUR&lt;/span&gt; &lt;span class="mf"&gt;5.13&lt;/span&gt;    &lt;span class="k"&gt;EUR&lt;/span&gt; &lt;span class="mf"&gt;8.56&lt;/span&gt;    &lt;span class="k"&gt;EUR&lt;/span&gt; &lt;span class="mf"&gt;13.69&lt;/span&gt;
&lt;span class="k"&gt;i&lt;/span&gt;&lt;span class="mf"&gt;18&lt;/span&gt;&lt;span class="k"&gt;n&lt;/span&gt;&lt;span class="err"&gt;-&lt;/span&gt;&lt;span class="k"&gt;prefs&lt;/span&gt;&lt;span class="err"&gt;=&lt;/span&gt;&lt;span class="k"&gt;USD&lt;/span&gt;         &lt;span class="nv"&gt;$5.99&lt;/span&gt;       &lt;span class="nv"&gt;$9.99&lt;/span&gt;       &lt;span class="nv"&gt;$15.99&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Dollars, as requested. Now divide:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight mathematica"&gt;&lt;code&gt;&lt;span class="m"&gt;5.99&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="o"&gt;/&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="m"&gt;5.13&lt;/span&gt;&lt;span class="w"&gt;  &lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="m"&gt;1.168&lt;/span&gt;&lt;span class="w"&gt;
&lt;/span&gt;&lt;span class="m"&gt;9.99&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="o"&gt;/&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="m"&gt;8.56&lt;/span&gt;&lt;span class="w"&gt;  &lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="m"&gt;1.167&lt;/span&gt;&lt;span class="w"&gt;
&lt;/span&gt;&lt;span class="m"&gt;15.99&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="o"&gt;/&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="m"&gt;13.69&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="w"&gt; &lt;/span&gt;&lt;span class="m"&gt;1.168&lt;/span&gt;&lt;span class="w"&gt;
&lt;/span&gt;&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Three ratios, identical to three decimals. That is one exchange rate applied to&lt;br&gt;
the European catalogue — not United States pricing. For comparison, the same&lt;br&gt;
search through an actual US exit returned a different product mix entirely, at&lt;br&gt;
$12.99, $27.99, $11.30, $18.99.&lt;/p&gt;

&lt;p&gt;So the cookie gives you converted European prices wearing a dollar sign. If your&lt;br&gt;
question is "what does this cost in the US", the answer it hands you is wrong,&lt;br&gt;
and nothing in the response says so. (The &lt;code&gt;&amp;amp;currency=USD&lt;/code&gt; query parameter, for&lt;br&gt;
what it is worth, is ignored outright — prices stayed in euros.)&lt;/p&gt;
&lt;h2&gt;
  
  
  How fast one IP burns out — measured
&lt;/h2&gt;

&lt;p&gt;This is the part I could not find numbers for anywhere, so I measured it.&lt;/p&gt;

&lt;p&gt;A probe hitting Amazon &lt;strong&gt;hourly&lt;/strong&gt; from one datacenter IP. Two search requests per&lt;br&gt;
check. That is about as gentle as automated access gets.&lt;/p&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;hour&lt;/th&gt;
&lt;th&gt;fetch methods working (of 4)&lt;/th&gt;
&lt;th&gt;records returned (normal: 28)&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;05:02&lt;/td&gt;
&lt;td&gt;2&lt;/td&gt;
&lt;td&gt;28&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;06:04&lt;/td&gt;
&lt;td&gt;2&lt;/td&gt;
&lt;td&gt;28&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;07:01&lt;/td&gt;
&lt;td&gt;2&lt;/td&gt;
&lt;td&gt;14&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;08:00&lt;/td&gt;
&lt;td&gt;2&lt;/td&gt;
&lt;td&gt;28&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;09:03&lt;/td&gt;
&lt;td&gt;2&lt;/td&gt;
&lt;td&gt;14&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;10:00&lt;/td&gt;
&lt;td&gt;0&lt;/td&gt;
&lt;td&gt;14&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;12:04&lt;/td&gt;
&lt;td&gt;2&lt;/td&gt;
&lt;td&gt;28&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;15:04&lt;/td&gt;
&lt;td&gt;2&lt;/td&gt;
&lt;td&gt;14&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;17:05&lt;/td&gt;
&lt;td&gt;0&lt;/td&gt;
&lt;td&gt;14&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;p&gt;Fourteen requests over six hours, two blocked: a &lt;strong&gt;14% block rate at two requests&lt;br&gt;
per hour&lt;/strong&gt;. Individual blocks cleared by themselves within the hour. But the&lt;br&gt;
baseline drifted down across the day — what started as "two of four methods work"&lt;br&gt;
ended at zero.&lt;/p&gt;

&lt;p&gt;Separately: I once ran the probe twice within seven minutes. Both requests were&lt;br&gt;
blocked, and that IP did not recover for hours. Amazon appears to weigh request&lt;br&gt;
&lt;strong&gt;density&lt;/strong&gt; far more heavily than volume.&lt;/p&gt;

&lt;p&gt;The practical consequence: a session per run is the wrong unit. You want a fresh&lt;br&gt;
exit per request, so density per address stays at one.&lt;/p&gt;
&lt;h2&gt;
  
  
  The block that arrives as HTTP 200
&lt;/h2&gt;

&lt;p&gt;Worth restating because my own detector missed it. Amazon's anti-bot interstitial&lt;br&gt;
comes back with &lt;strong&gt;status 200&lt;/strong&gt;, &lt;code&gt;Content-Type: text/html&lt;/code&gt;, and about &lt;strong&gt;2,265&lt;br&gt;
bytes&lt;/strong&gt;:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight javascript"&gt;&lt;code&gt;&lt;span class="kd"&gt;function&lt;/span&gt; &lt;span class="nf"&gt;triggerInterstitialChallenge&lt;/span&gt;&lt;span class="p"&gt;()&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;
  &lt;span class="kd"&gt;var&lt;/span&gt; &lt;span class="nx"&gt;xhr&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="k"&gt;new&lt;/span&gt; &lt;span class="nc"&gt;XMLHttpRequest&lt;/span&gt;&lt;span class="p"&gt;();&lt;/span&gt;
  &lt;span class="nx"&gt;xhr&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;open&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="dl"&gt;"&lt;/span&gt;&lt;span class="s2"&gt;POST&lt;/span&gt;&lt;span class="dl"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="dl"&gt;"&lt;/span&gt;&lt;span class="s2"&gt;/_sec/verify?provider=interstitial&lt;/span&gt;&lt;span class="dl"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="kc"&gt;false&lt;/span&gt;&lt;span class="p"&gt;);&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;None of the classic strings are present — no &lt;code&gt;api-services-support@amazon.com&lt;/code&gt;,&lt;br&gt;
no &lt;code&gt;Enter the characters you see&lt;/code&gt;. On &lt;code&gt;amazon.fr&lt;/code&gt; the same thing arrives under&lt;br&gt;
&lt;strong&gt;HTTP 202&lt;/strong&gt;, which most retry logic does not treat as a failure at all.&lt;/p&gt;

&lt;p&gt;Size is the reliable signal. A real Amazon search page is 300 KB to 1.6 MB.&lt;br&gt;
Anything under ~50 KB is not a page, whatever the status line says.&lt;/p&gt;
&lt;h2&gt;
  
  
  Locale parsing, and two cases that are easy to miss
&lt;/h2&gt;

&lt;p&gt;&lt;code&gt;1,234.56&lt;/code&gt; and &lt;code&gt;1.234,56&lt;/code&gt; are the same amount. Deleting commas handles the first&lt;br&gt;
and destroys the second — &lt;code&gt;8,63&lt;/code&gt; becomes &lt;code&gt;863&lt;/code&gt;, silently, and 863 is a plausible&lt;br&gt;
price for something.&lt;/p&gt;

&lt;p&gt;The decimal separator is whichever of &lt;code&gt;.&lt;/code&gt; and &lt;code&gt;,&lt;/code&gt; comes &lt;strong&gt;last&lt;/strong&gt;, and only when&lt;br&gt;
exactly two digits follow it:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="k"&gt;def&lt;/span&gt; &lt;span class="nf"&gt;to_number&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;raw&lt;/span&gt;&lt;span class="p"&gt;):&lt;/span&gt;
    &lt;span class="n"&gt;s&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;raw&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;replace&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt; &lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="sh"&gt;""&lt;/span&gt;&lt;span class="p"&gt;).&lt;/span&gt;&lt;span class="nf"&gt;replace&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;&amp;nbsp;&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="sh"&gt;""&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
    &lt;span class="n"&gt;dec&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="nf"&gt;max&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;s&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;rfind&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;.&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;),&lt;/span&gt; &lt;span class="n"&gt;s&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;rfind&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;,&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;))&lt;/span&gt;
    &lt;span class="k"&gt;if&lt;/span&gt; &lt;span class="n"&gt;dec&lt;/span&gt; &lt;span class="o"&gt;&amp;gt;=&lt;/span&gt; &lt;span class="mi"&gt;0&lt;/span&gt; &lt;span class="ow"&gt;and&lt;/span&gt; &lt;span class="nf"&gt;len&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;s&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt; &lt;span class="o"&gt;-&lt;/span&gt; &lt;span class="n"&gt;dec&lt;/span&gt; &lt;span class="o"&gt;-&lt;/span&gt; &lt;span class="mi"&gt;1&lt;/span&gt; &lt;span class="o"&gt;==&lt;/span&gt; &lt;span class="mi"&gt;2&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt;
        &lt;span class="k"&gt;return&lt;/span&gt; &lt;span class="nf"&gt;float&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;re&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;sub&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sa"&gt;r&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;[.,]&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="sh"&gt;""&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;s&lt;/span&gt;&lt;span class="p"&gt;[:&lt;/span&gt;&lt;span class="n"&gt;dec&lt;/span&gt;&lt;span class="p"&gt;])&lt;/span&gt; &lt;span class="o"&gt;+&lt;/span&gt; &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;.&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt; &lt;span class="o"&gt;+&lt;/span&gt; &lt;span class="n"&gt;s&lt;/span&gt;&lt;span class="p"&gt;[&lt;/span&gt;&lt;span class="n"&gt;dec&lt;/span&gt;&lt;span class="o"&gt;+&lt;/span&gt;&lt;span class="mi"&gt;1&lt;/span&gt;&lt;span class="p"&gt;:])&lt;/span&gt;
    &lt;span class="k"&gt;return&lt;/span&gt; &lt;span class="nf"&gt;float&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;re&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;sub&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sa"&gt;r&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;[.,]&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="sh"&gt;""&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;s&lt;/span&gt;&lt;span class="p"&gt;))&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Two cases that cost me time while testing all 18 marketplaces:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;The symbol is not always in front.&lt;/strong&gt; Poland writes &lt;code&gt;123,45 zł&lt;/code&gt;, Sweden writes
&lt;code&gt;1 299 kr&lt;/code&gt;. A regex anchored to a leading symbol returns nothing on those
markets. My first pass reported 20 products and 0 prices from &lt;code&gt;amazon.pl&lt;/code&gt;, and
I assumed the parser had broken. It was matching the wrong shape.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Japan uses a different yen sign.&lt;/strong&gt; &lt;code&gt;amazon.co.jp&lt;/code&gt; writes &lt;code&gt;￥&lt;/code&gt; (U+FFE5,
fullwidth), not &lt;code&gt;¥&lt;/code&gt; (U+00A5). A symbol table with the ordinary sign fails to
recognise every price on that marketplace, silently.&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  What ties these together
&lt;/h2&gt;

&lt;p&gt;None of them raise an error. The run succeeds, the dataset fills, the schema&lt;br&gt;
validates. You find out weeks later when someone asks why the German prices look&lt;br&gt;
a hundred times too small.&lt;/p&gt;

&lt;p&gt;So the check that actually caught things was not "did it fail" but "did the shape&lt;br&gt;
change". For each run I store the fraction of records where every required field&lt;br&gt;
is non-empty, and compare against the median of the last thirty runs. A parser&lt;br&gt;
that quietly stops finding prices shows up as &lt;code&gt;price&lt;/code&gt; present in 8% of records&lt;br&gt;
instead of the usual 95%, long before anyone downstream notices.&lt;/p&gt;

&lt;p&gt;One thing I got wrong at first: alert on the &lt;strong&gt;second&lt;/strong&gt; consecutive bad run, not&lt;br&gt;
the first. At a 14% block rate, alerting on every dip produced about ten messages&lt;br&gt;
a day about weather, and I stopped reading them — which defeats the point.&lt;/p&gt;




&lt;p&gt;&lt;em&gt;I build this as an Apify actor —&lt;br&gt;
&lt;a href="https://apify.com/pagewright/amazon-international-scraper" rel="noopener noreferrer"&gt;Amazon International Scraper&lt;/a&gt;,&lt;br&gt;
18 marketplaces with the proxy country pinned and an ISO currency code on every&lt;br&gt;
price. But the traps above apply to whatever you build with; I would rather you&lt;br&gt;
not lose a week to them.&lt;/em&gt;&lt;/p&gt;

</description>
      <category>webscraping</category>
      <category>amazon</category>
      <category>ecommerce</category>
      <category>python</category>
    </item>
  </channel>
</rss>
