<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>DEV Community: Shifter</title>
    <description>The latest articles on DEV Community by Shifter (@shifter_io).</description>
    <link>https://dev.to/shifter_io</link>
    <image>
      <url>https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F4172015%2F99a3f55f-9d30-4335-99c0-00da708ace6f.png</url>
      <title>DEV Community: Shifter</title>
      <link>https://dev.to/shifter_io</link>
    </image>
    <atom:link rel="self" type="application/rss+xml" href="https://dev.to/feed/shifter_io"/>
    <language>en</language>
    <item>
      <title>Rotating vs sticky residential proxy sessions: how to choose, with Python examples</title>
      <dc:creator>Shifter</dc:creator>
      <pubDate>Thu, 08 Oct 2026 21:49:49 +0000</pubDate>
      <link>https://dev.to/shifter_io/rotating-vs-sticky-residential-proxy-sessions-how-to-choose-with-python-examples-6aa</link>
      <guid>https://dev.to/shifter_io/rotating-vs-sticky-residential-proxy-sessions-how-to-choose-with-python-examples-6aa</guid>
      <description>&lt;p&gt;Disclosure: this post comes from the Shifter team. Shifter is a residential proxy provider, and the examples use its gateway, but the ideas apply to any provider that lets you choose how long you keep an exit IP.&lt;/p&gt;

&lt;p&gt;When you send traffic through a residential proxy gateway, you get an exit IP from a large pool. The first decision is simple: should the next request come from a new IP, or from the same one as the last request? That is the difference between a rotating session and a sticky session.&lt;/p&gt;

&lt;h2&gt;
  
  
  When to rotate
&lt;/h2&gt;

&lt;p&gt;Use a fresh IP for every request when requests do not depend on each other. Typical cases:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Fetching many independent pages, such as product pages or search result pages.&lt;/li&gt;
&lt;li&gt;Collecting public data across a long list of URLs.&lt;/li&gt;
&lt;li&gt;Any job where no cookie or login state has to survive between requests.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Spreading independent requests over many IPs keeps the request rate per IP low, which is what most sites look at first.&lt;/p&gt;

&lt;h2&gt;
  
  
  When to stick
&lt;/h2&gt;

&lt;p&gt;Keep the same IP for a while when the site ties state to your connection. Typical cases:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;Logging in, then reading pages that need the login.&lt;/li&gt;
&lt;li&gt;Carts, checkouts and multi-step forms.&lt;/li&gt;
&lt;li&gt;Pagination that depends on a session cookie or token.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;A sticky session holds one IP for a time to live (TTL). Pick a TTL a little longer than the whole flow, so the IP does not change halfway through.&lt;/p&gt;

&lt;h2&gt;
  
  
  How it looks in practice
&lt;/h2&gt;

&lt;p&gt;With the Shifter gateway, the options go into the proxy username. The gateway is &lt;code&gt;p.shifter.io:443&lt;/code&gt;, and the username takes these parameters:&lt;/p&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Parameter&lt;/th&gt;
&lt;th&gt;Example&lt;/th&gt;
&lt;th&gt;Effect&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;country-XX&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;&lt;code&gt;customer-USERNAME-country-de&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Route through Germany&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;region-NAME&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;&lt;code&gt;customer-USERNAME-region-california&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Target a specific region&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;city-NAME&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;&lt;code&gt;customer-USERNAME-city-new_york&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Target a specific city&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;asn-NUMBER&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;&lt;code&gt;customer-USERNAME-asn-7922&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Target a specific ASN&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;sid-ID&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;&lt;code&gt;customer-USERNAME-sid-abc&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Sticky session (same IP for the default TTL of 120 seconds)&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;ttl-SECONDS&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;&lt;code&gt;customer-USERNAME-sid-abc-ttl-600&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Custom TTL in seconds (requires &lt;code&gt;sid&lt;/code&gt;)&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;&lt;code&gt;strict-true&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;&lt;code&gt;customer-USERNAME-country-us-strict-true&lt;/code&gt;&lt;/td&gt;
&lt;td&gt;Fail with 502 instead of falling back to a broader pool&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;p&gt;No &lt;code&gt;sid&lt;/code&gt; means a new IP for each request. Adding a &lt;code&gt;sid&lt;/code&gt; means a sticky session.&lt;/p&gt;

&lt;h3&gt;
  
  
  Rotating: a new IP per request
&lt;/h3&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="kn"&gt;import&lt;/span&gt; &lt;span class="n"&gt;requests&lt;/span&gt;

&lt;span class="n"&gt;proxy&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;customer-USERNAME-country-us:PASSWORD@p.shifter.io:443&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;
&lt;span class="n"&gt;proxies&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;http&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="n"&gt;proxy&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;https&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="n"&gt;proxy&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;

&lt;span class="k"&gt;for&lt;/span&gt; &lt;span class="n"&gt;page&lt;/span&gt; &lt;span class="ow"&gt;in&lt;/span&gt; &lt;span class="nf"&gt;range&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="mi"&gt;1&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="mi"&gt;4&lt;/span&gt;&lt;span class="p"&gt;):&lt;/span&gt;
    &lt;span class="n"&gt;r&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;requests&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;get&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;http://ip-info.com/json&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;proxies&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="n"&gt;proxies&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
    &lt;span class="nf"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;page&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;r&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="n"&gt;text&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;h3&gt;
  
  
  Sticky: one IP for 10 minutes
&lt;/h3&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="kn"&gt;import&lt;/span&gt; &lt;span class="n"&gt;uuid&lt;/span&gt;
&lt;span class="kn"&gt;import&lt;/span&gt; &lt;span class="n"&gt;requests&lt;/span&gt;

&lt;span class="n"&gt;sid&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;uuid&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;uuid4&lt;/span&gt;&lt;span class="p"&gt;().&lt;/span&gt;&lt;span class="nb"&gt;hex&lt;/span&gt;&lt;span class="p"&gt;[:&lt;/span&gt;&lt;span class="mi"&gt;8&lt;/span&gt;&lt;span class="p"&gt;]&lt;/span&gt;  &lt;span class="c1"&gt;# one id per job or per account
&lt;/span&gt;&lt;span class="n"&gt;proxy&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="sa"&gt;f&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;customer-USERNAME-country-us-sid-&lt;/span&gt;&lt;span class="si"&gt;{&lt;/span&gt;&lt;span class="n"&gt;sid&lt;/span&gt;&lt;span class="si"&gt;}&lt;/span&gt;&lt;span class="s"&gt;-ttl-600:PASSWORD@p.shifter.io:443&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;
&lt;span class="n"&gt;proxies&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="p"&gt;{&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;http&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="n"&gt;proxy&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;https&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;:&lt;/span&gt; &lt;span class="n"&gt;proxy&lt;/span&gt;&lt;span class="p"&gt;}&lt;/span&gt;

&lt;span class="n"&gt;session&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;requests&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nc"&gt;Session&lt;/span&gt;&lt;span class="p"&gt;()&lt;/span&gt;
&lt;span class="n"&gt;session&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="n"&gt;proxies&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;update&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;proxies&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;

&lt;span class="c1"&gt;# every request in this session leaves from the same IP until the TTL ends
&lt;/span&gt;&lt;span class="nf"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;session&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;get&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;http://ip-info.com/json&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;).&lt;/span&gt;&lt;span class="n"&gt;text&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;span class="nf"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;session&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;get&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;http://ip-info.com/json&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;).&lt;/span&gt;&lt;span class="n"&gt;text&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;To check it yourself, run the sticky example twice with the same &lt;code&gt;sid&lt;/code&gt; and compare the output, then change the &lt;code&gt;sid&lt;/code&gt; and compare again.&lt;/p&gt;

&lt;h2&gt;
  
  
  A few habits that save time
&lt;/h2&gt;

&lt;ul&gt;
&lt;li&gt;Use one &lt;code&gt;sid&lt;/code&gt; per account or per job, never one shared &lt;code&gt;sid&lt;/code&gt; for everything.&lt;/li&gt;
&lt;li&gt;Set the TTL to cover the whole flow, and start a new &lt;code&gt;sid&lt;/code&gt; when a flow ends or fails.&lt;/li&gt;
&lt;li&gt;Add &lt;code&gt;strict-true&lt;/code&gt; when you must not fall back to a wider geography. You get a clear 502 instead of results from the wrong place.&lt;/li&gt;
&lt;li&gt;Keep concurrency per target site reasonable, and only collect public data in line with the site's terms.&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  Try it
&lt;/h2&gt;

&lt;p&gt;Shifter's &lt;a href="https://shifter.io/services/residential-proxies" rel="noopener noreferrer"&gt;residential proxies&lt;/a&gt; cover 195+ countries, and there is a free trial at &lt;a href="https://shifter.io" rel="noopener noreferrer"&gt;shifter.io&lt;/a&gt; if you want to run the examples above.&lt;/p&gt;

</description>
      <category>webscraping</category>
      <category>python</category>
      <category>tutorial</category>
      <category>networking</category>
    </item>
  </channel>
</rss>
