The latest articles on DEV Community by vhson90 (@vhson90). https://dev.to/vhson90 https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F4205776%2Fefd863ad-3256-43f1-bcfd-9a443c4bd95c.jpg https://dev.to/vhson90 en vhson90 Sun, 25 Oct 2026 04:06:16 +0000 https://dev.to/vhson90/building-resilient-247-ai-agent-pipelines-with-multi-tier-token-routing-1025-1106-5fc3 https://dev.to/vhson90/building-resilient-247-ai-agent-pipelines-with-multi-tier-token-routing-1025-1106-5fc3 <h2> The Challenge of Running 24/7 Autonomous Agents </h2> <p>When running continuous developer automation, relying on a single LLM endpoint introduces both rate-limit bottlenecks and high token costs. By combining a local OpenAI-compatible gateway with tiered model fallbacks, we can achieve near-100% uptime.<br> </p> <div class="highlight js-code-highlight"> <pre class="highlight python"><code><span class="k">async</span> <span class="k">def</span> <span class="nf">resilient_completion</span><span class="p">(</span><span class="n">client</span><span class="p">,</span> <span class="n">models</span><span class="p">:</span> <span class="nb">list</span><span class="p">[</span><span class="nb">str</span><span class="p">],</span> <span class="n">prompt</span><span class="p">:</span> <span class="nb">str</span><span class="p">)</span> <span class="o">-&gt;</span> <span class="nb">str</span><span class="p">:</span> <span class="k">for</span> <span class="n">model</span> <span class="ow">in</span> <span class="n">models</span><span class="p">:</span> <span class="k">try</span><span class="p">:</span> <span class="n">resp</span> <span class="o">=</span> <span class="k">await</span> <span class="n">client</span><span class="p">.</span><span class="n">chat</span><span class="p">.</span><span class="n">completions</span><span class="p">.</span><span class="nf">create</span><span class="p">(</span> <span class="n">model</span><span class="o">=</span><span class="n">model</span><span class="p">,</span> <span class="n">messages</span><span class="o">=</span><span class="p">[{</span><span class="sh">'</span><span class="s">role</span><span class="sh">'</span><span class="p">:</span> <span class="sh">'</span><span class="s">user</span><span class="sh">'</span><span class="p">,</span> <span class="sh">'</span><span class="s">content</span><span class="sh">'</span><span class="p">:</span> <span class="n">prompt</span><span class="p">}]</span> <span class="p">)</span> <span class="k">return</span> <span class="n">resp</span><span class="p">.</span><span class="n">choices</span><span class="p">[</span><span class="mi">0</span><span class="p">].</span><span class="n">message</span><span class="p">.</span><span class="n">content</span> <span class="k">except</span> <span class="nb">Exception</span><span class="p">:</span> <span class="k">continue</span> <span class="k">raise</span> <span class="nc">RuntimeError</span><span class="p">(</span><span class="sh">'</span><span class="s">All tiers exhausted</span><span class="sh">'</span><span class="p">)</span> </code></pre> </div> <h2> Recommended Developer Tools by <a class="mentioned-user" href="https://dev.to/vhson90">@vhson90</a> </h2> <ul> <li><a href="https://github.com/vhson90/autoops-pro-toolkit-1025-1105" rel="noopener noreferrer">Digital Product: AutoOps Pro CLI &amp; AI Cost-Saver (1025-1105)</a></li> </ul> <h3> 🔧 Explore More Tools </h3> <ul> <li><a href="https://github.com/vhson90/autoops-pro-toolkit-1025-1105" rel="noopener noreferrer">Digital Product: AutoOps Pro CLI &amp; AI Cost-Saver (1025-1105)</a></li> </ul> <h3> 💳 Instant Commercial License / Support &amp; Payment Channels </h3> <ul> <li> <strong>PayPal (International USD):</strong> <code>vohoaison@gmail.com</code> </li> <li> <strong>Crypto (USDT TRC20 / BEP20 / ERC20):</strong> <code>0x6445a00DA429E498d1A95ba5EB95AA38023a1c94</code> </li> <li> <strong>Vietnam Bank Transfer (24/7):</strong> <strong>MBBANK - 83993868 - VO HOAI SON</strong> </li> </ul> <p><a href="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fimg.vietqr.io%2Fimage%2FMB-83993868-compact2.png%3FaccountName%3DVO%2520HOAI%2520SON" class="article-body-image-wrapper"><img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fimg.vietqr.io%2Fimage%2FMB-83993868-compact2.png%3FaccountName%3DVO%2520HOAI%2520SON" alt="VietQR Payment - VO HOAI SON" width="540" height="640"></a></p> python ai automation opensource