<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>DEV Community: Lium</title>
    <description>The latest articles on DEV Community by Lium (@lium_io).</description>
    <link>https://dev.to/lium_io</link>
    <image>
      <url>https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F4140131%2F8299c2db-b41d-47c6-b844-2914071f5c65.png</url>
      <title>DEV Community: Lium</title>
      <link>https://dev.to/lium_io</link>
    </image>
    <atom:link rel="self" type="application/rss+xml" href="https://dev.to/feed/lium_io"/>
    <language>en</language>
    <item>
      <title>Let your AI agent rent a GPU: llms.txt, --json and --budget</title>
      <dc:creator>Lium</dc:creator>
      <pubDate>Thu, 24 Sep 2026 02:52:35 +0000</pubDate>
      <link>https://dev.to/lium/let-your-ai-agent-rent-a-gpu-llmstxt-json-and-budget-4f3</link>
      <guid>https://dev.to/lium/let-your-ai-agent-rent-a-gpu-llmstxt-json-and-budget-4f3</guid>
      <description>&lt;p&gt;&lt;em&gt;Posted by the Lium team. Lium is the GPU marketplace used in this post. Every command below is taken from the live CLI help (&lt;code&gt;lium.io&lt;/code&gt; 0.8.0) and &lt;a href="https://lium.io/llms.txt?utm_source=devto&amp;amp;utm_medium=content&amp;amp;utm_campaign=posts-0924-agents" rel="noopener noreferrer"&gt;lium.io/llms.txt&lt;/a&gt;, read on 24 September 2026.&lt;/em&gt;&lt;/p&gt;

&lt;p&gt;&lt;a href="https://huggingface.co/datasets/gpu-rentals/lium-videos/resolve/main/lium-video-02-agents.mp4" rel="noopener noreferrer"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fhuggingface.co%2Fdatasets%2Fgpu-rentals%2Flium-videos%2Fresolve%2Fmain%2Flium-video-02-agents-poster.png" alt="Your agent can find a GPU, rent it and stop it at a budget: play the 26-second video" width="800" height="450"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;&lt;em&gt;Video (26 s, &lt;a href="https://huggingface.co/datasets/gpu-rentals/lium-videos/resolve/main/lium-video-02-agents.mp4" rel="noopener noreferrer"&gt;play the MP4&lt;/a&gt;): the opening chat illustrates the ask. The terminal clip is a real recording of &lt;code&gt;lium.io/llms.txt&lt;/code&gt; and &lt;code&gt;lium up --help&lt;/code&gt;, sped up 1.5x.&lt;/em&gt;&lt;/p&gt;

&lt;p&gt;Most GPU clouds assume a person with a browser: a sign-up form, a dashboard, a console to click through. An AI agent working in a terminal needs something else: prices it can read without an account, a way to sign up without a form, a rent command that returns machine-readable output, and a hard stop so a forgotten pod can't run up a bill. This post walks through those five steps on Lium, in the order an agent takes them.&lt;/p&gt;

&lt;h2&gt;
  
  
  1. Read llms.txt
&lt;/h2&gt;

&lt;p&gt;&lt;a href="https://lium.io/llms.txt?utm_source=devto&amp;amp;utm_medium=content&amp;amp;utm_campaign=posts-0924-agents" rel="noopener noreferrer"&gt;&lt;code&gt;lium.io/llms.txt&lt;/code&gt;&lt;/a&gt; is a short plain-text file written for models. It says when Lium fits a task (a job that needs an NVIDIA GPU for minutes to days, started from a script) and when it doesn't (managed inference endpoints, serverless functions, CPU-only hosting). It then lists the price feeds, the install commands, the headless sign-up call and the reference docs. One fetch gives an agent everything below.&lt;/p&gt;

&lt;h2&gt;
  
  
  2. Check prices with no account
&lt;/h2&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;curl &lt;span class="nt"&gt;-sL&lt;/span&gt; https://lium.io/pricing.json | jq &lt;span class="nt"&gt;-r&lt;/span&gt; &lt;span class="s1"&gt;'.models[]
  | select(.available_gpus &amp;gt; 0)
  | "\(.name)  from $\(.min_price_usd_per_gpu_hour)/GPU-hour  \(.available_gpus) free"'&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;At 02:44 UTC on 24 September 2026 that printed, among others: H100 80GB HBM3 from $1.30 per GPU-hour, H200 from $3.00, B200 from $5.60, B300 from $8.25, RTX 5090 from $0.58 and RTX 4090 from $0.45. Providers set their own prices, so run it again for the current numbers, or see &lt;a href="https://lium.io/pricing?utm_source=devto&amp;amp;utm_medium=content&amp;amp;utm_campaign=posts-0924-agents" rel="noopener noreferrer"&gt;lium.io/pricing&lt;/a&gt;. For one row per rentable node, read the &lt;a href="https://docs.lium.io/developers/public-nodes-feed?utm_source=devto&amp;amp;utm_medium=content&amp;amp;utm_campaign=posts-0924-agents" rel="noopener noreferrer"&gt;public nodes feed&lt;/a&gt;.&lt;/p&gt;

&lt;h2&gt;
  
  
  3. Sign up without a form
&lt;/h2&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;curl &lt;span class="nt"&gt;-f&lt;/span&gt; &lt;span class="nt"&gt;-X&lt;/span&gt; POST https://lium.io/api/auth/signup
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;The response carries a &lt;code&gt;fingerprint&lt;/code&gt; (a 32-character dashboard login, shown once, with no recovery) and an &lt;code&gt;api_key&lt;/code&gt; when minting succeeds. The key can be &lt;code&gt;null&lt;/code&gt;, and sign-up credit depends on the platform setting and on prior use of the IP. The CLI has the same step as &lt;code&gt;lium signup&lt;/code&gt;, which stores the key it mints. Renting needs a funded balance that covers at least 15 minutes of the pod's hourly price (&lt;a href="https://docs.lium.io/pod-users/billing?utm_source=devto&amp;amp;utm_medium=content&amp;amp;utm_campaign=posts-0924-agents" rel="noopener noreferrer"&gt;billing docs&lt;/a&gt;).&lt;/p&gt;

&lt;h2&gt;
  
  
  4. Rent with JSON output and a budget
&lt;/h2&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;lium up &lt;span class="nt"&gt;--gpu&lt;/span&gt; H100 &lt;span class="nt"&gt;-y&lt;/span&gt; &lt;span class="nt"&gt;--json&lt;/span&gt; &lt;span class="nt"&gt;--budget&lt;/span&gt; 12.50 &lt;span class="nt"&gt;--ttl&lt;/span&gt; 3h &lt;span class="nt"&gt;--timeout&lt;/span&gt; 600
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;What each flag does, from &lt;code&gt;lium up --help&lt;/code&gt;:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;code&gt;--gpu H100&lt;/code&gt; picks the lowest-priced H100 node that matches.&lt;/li&gt;
&lt;li&gt;
&lt;code&gt;-y --json&lt;/code&gt; skips the prompt, waits for the pod, and prints it as JSON, with no SSH session to hang the agent's shell.&lt;/li&gt;
&lt;li&gt;
&lt;code&gt;--budget 12.50&lt;/code&gt; ends the pod once $12.50 has been spent. At $1.30 per GPU-hour that is about 9.6 hours of one H100.&lt;/li&gt;
&lt;li&gt;
&lt;code&gt;--ttl 3h&lt;/code&gt; ends it three hours after the rent, whichever comes first.&lt;/li&gt;
&lt;li&gt;
&lt;code&gt;--timeout 600&lt;/code&gt; gives the whole rent 10 minutes, then exits 1 and names the pod, so the agent can clean up rather than wait forever.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Billing is per second at the node's hourly price, from deploy until the pod is removed, with no minimum. Ten minutes of an H100 at $1.30 per GPU-hour costs $0.22.&lt;/p&gt;

&lt;h2&gt;
  
  
  5. Run the job, then stop billing
&lt;/h2&gt;



&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;lium &lt;span class="nb"&gt;exec&lt;/span&gt; &amp;lt;pod&amp;gt; &lt;span class="s2"&gt;"nvidia-smi -L"&lt;/span&gt;
lium spend
lium &lt;span class="nb"&gt;rm&lt;/span&gt; &amp;lt;pod&amp;gt; &lt;span class="nt"&gt;-y&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;&lt;code&gt;lium exec&lt;/code&gt; runs a command in the pod, &lt;code&gt;lium spend&lt;/code&gt; shows the hourly burn and the estimated spend per active pod, and &lt;code&gt;lium rm&lt;/code&gt; removes the pod, which stops the meter.&lt;/p&gt;

&lt;h2&gt;
  
  
  Give your agent the skill
&lt;/h2&gt;

&lt;p&gt;The Lium skill documents this sequence and its failure modes for any agent that supports the Agent Skills standard (Claude Code, Cursor, Codex and others):&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;npx skills add Datura-ai/lium-skill &lt;span class="nt"&gt;--skill&lt;/span&gt; lium
&lt;span class="c"&gt;# without node:&lt;/span&gt;
curl &lt;span class="nt"&gt;-fsSL&lt;/span&gt; https://lium.io/agents/install.sh | bash
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Source: &lt;a href="https://github.com/Datura-ai/lium-skill" rel="noopener noreferrer"&gt;github.com/Datura-ai/lium-skill&lt;/a&gt;. The agent guide on the docs site is &lt;a href="https://docs.lium.io/developers/agents?utm_source=devto&amp;amp;utm_medium=content&amp;amp;utm_campaign=posts-0924-agents" rel="noopener noreferrer"&gt;docs.lium.io/developers/agents&lt;/a&gt;.&lt;/p&gt;

</description>
      <category>ai</category>
      <category>agents</category>
      <category>gpu</category>
      <category>devops</category>
    </item>
    <item>
      <title>Renting an 8x B300 by the hour: what it costs and how to start</title>
      <dc:creator>Lium</dc:creator>
      <pubDate>Thu, 24 Sep 2026 02:52:30 +0000</pubDate>
      <link>https://dev.to/lium/renting-an-8x-b300-by-the-hour-what-it-costs-and-how-to-start-330</link>
      <guid>https://dev.to/lium/renting-an-8x-b300-by-the-hour-what-it-costs-and-how-to-start-330</guid>
      <description>&lt;p&gt;&lt;em&gt;Posted by the Lium team. Lium is the GPU marketplace used in this post. Every number links to a public source you can check yourself.&lt;/em&gt;&lt;/p&gt;

&lt;p&gt;&lt;a href="https://huggingface.co/datasets/gpu-rentals/lium-videos/resolve/main/lium-video-01-b300.mp4" rel="noopener noreferrer"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fhuggingface.co%2Fdatasets%2Fgpu-rentals%2Flium-videos%2Fresolve%2Fmain%2Flium-video-01-b300-poster.png" alt="8x NVIDIA B300 for $68 an hour: play the 24-second video" width="800" height="450"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;&lt;em&gt;Video (24 s, &lt;a href="https://huggingface.co/datasets/gpu-rentals/lium-videos/resolve/main/lium-video-01-b300.mp4" rel="noopener noreferrer"&gt;play the MP4&lt;/a&gt;): one command for 8x B300. The prices on screen were live on lium.io at 02:29 UTC on 24 September 2026.&lt;/em&gt;&lt;/p&gt;

&lt;p&gt;An 8x B300 node has 2,304 GB of GPU memory (288 GB per card, per &lt;a href="https://lium.io/pricing.json?utm_source=devto&amp;amp;utm_medium=content&amp;amp;utm_campaign=posts-0924-b300" rel="noopener noreferrer"&gt;Lium's price feed&lt;/a&gt;). That is enough to hold very large models on one machine. This post covers three things: what is on the market right now, what an hour costs to the cent, and the commands that take you from nothing to a running 8-GPU pod.&lt;/p&gt;

&lt;h2&gt;
  
  
  What is free right now
&lt;/h2&gt;

&lt;p&gt;Lium publishes two unauthenticated feeds: &lt;a href="https://lium.io/pricing.json?utm_source=devto&amp;amp;utm_medium=content&amp;amp;utm_campaign=posts-0924-b300" rel="noopener noreferrer"&gt;&lt;code&gt;pricing.json&lt;/code&gt;&lt;/a&gt;, one row per GPU model, and the &lt;a href="https://lium.io/api/public/v1/nodes?utm_source=devto&amp;amp;utm_medium=content&amp;amp;utm_campaign=posts-0924-b300" rel="noopener noreferrer"&gt;public nodes feed&lt;/a&gt;, one row per rentable node. I read both at &lt;strong&gt;02:44 UTC on 24 September 2026&lt;/strong&gt; (nodes feed &lt;code&gt;generated_at&lt;/code&gt; 02:44:13Z). These are the whole 8-GPU hosts that were free at that minute:&lt;/p&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;GPU&lt;/th&gt;
&lt;th&gt;Free 8x hosts&lt;/th&gt;
&lt;th&gt;Price per GPU-hour&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;B300&lt;/td&gt;
&lt;td&gt;5&lt;/td&gt;
&lt;td&gt;$8.50–$9.50&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;B200&lt;/td&gt;
&lt;td&gt;0&lt;/td&gt;
&lt;td&gt;–&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;H200&lt;/td&gt;
&lt;td&gt;1&lt;/td&gt;
&lt;td&gt;$4.00&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;H100 80GB HBM3&lt;/td&gt;
&lt;td&gt;1&lt;/td&gt;
&lt;td&gt;$2.75&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;A100-SXM4-80GB&lt;/td&gt;
&lt;td&gt;4&lt;/td&gt;
&lt;td&gt;$1.13–$1.23&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;p&gt;On the same read, single GPUs were free too: 43 B300 at $8.25–$9.50, 2 B200 at $5.60, 19 H200 at $3.00–$4.22, 27 H100 at $1.30–$2.75 and 33 A100 80GB at $0.999–$1.23.&lt;/p&gt;

&lt;p&gt;&lt;a href="https://huggingface.co/datasets/gpu-rentals/lium-videos/resolve/main/lium-video-03-gpu-prices.mp4" rel="noopener noreferrer"&gt;&lt;img src="https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fhuggingface.co%2Fdatasets%2Fgpu-rentals%2Flium-videos%2Fresolve%2Fmain%2Flium-video-03-gpu-prices-poster.png" alt="What a GPU costs right now: play the 23-second price video" width="800" height="450"&gt;&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;&lt;em&gt;Video (23 s, &lt;a href="https://huggingface.co/datasets/gpu-rentals/lium-videos/resolve/main/lium-video-03-gpu-prices.mp4" rel="noopener noreferrer"&gt;play the MP4&lt;/a&gt;): the lowest live ask for ten GPU models, from one curl. Its prices are from 02:29 UTC; the table above is the 02:44 UTC read.&lt;/em&gt;&lt;/p&gt;

&lt;p&gt;Providers set their own prices, so these numbers move. The feed is rebuilt at most once a minute (&lt;a href="https://docs.lium.io/developers/public-nodes-feed?utm_source=devto&amp;amp;utm_medium=content&amp;amp;utm_campaign=posts-0924-b300" rel="noopener noreferrer"&gt;docs&lt;/a&gt;). This one-liner prints every free 8-GPU host of these five models when you read this:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;curl &lt;span class="nt"&gt;-sS&lt;/span&gt; https://lium.io/api/public/v1/nodes | jq &lt;span class="nt"&gt;-c&lt;/span&gt; &lt;span class="s1"&gt;'.nodes[]
  | select((.gpu_model | test("B300|B200|H200|H100|A100")) and .available_gpu_count &amp;gt;= 8)
  | {gpu_model, available_gpu_count, price_per_gpu_hour, reliability_score, country_code}'&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;h2&gt;
  
  
  What it costs
&lt;/h2&gt;

&lt;p&gt;Lium bills per second at the listed hourly price: a pod costs &lt;code&gt;hourly price × seconds / 3600&lt;/code&gt; for the exact seconds it exists, with no minimum (&lt;a href="https://docs.lium.io/pod-users/billing?utm_source=devto&amp;amp;utm_medium=content&amp;amp;utm_campaign=posts-0924-b300" rel="noopener noreferrer"&gt;billing docs&lt;/a&gt;). At $8.50 per GPU-hour, the lowest 8x B300 ask on this read, an 8x B300 pod costs $68.00 per hour:&lt;/p&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;Pod lifetime&lt;/th&gt;
&lt;th&gt;Cost for 8x B300 at $8.50/GPU-hour&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;20 seconds (a smoke test that fails fast)&lt;/td&gt;
&lt;td&gt;$0.38&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;1 minute&lt;/td&gt;
&lt;td&gt;$1.13&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;10 minutes&lt;/td&gt;
&lt;td&gt;$11.33&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;1 hour&lt;/td&gt;
&lt;td&gt;$68.00&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;p&gt;Three billing details are worth knowing before you start:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Balance floor.&lt;/strong&gt; A rent needs a balance that covers at least 15 minutes of the pod's hourly price. For $68.00/hour that is $17.00.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;When money moves.&lt;/strong&gt; Running pods are charged every 5 minutes, and the remainder is settled the moment the pod is removed.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;The clock starts at deploy.&lt;/strong&gt; The short provisioning window before the pod reads RUNNING is billed, so a pod that takes 60 seconds to boot costs $1.13 before your code runs.&lt;/li&gt;
&lt;/ul&gt;

&lt;h2&gt;
  
  
  Start from the CLI
&lt;/h2&gt;

&lt;p&gt;The CLI and the Python SDK come in one package (&lt;a href="https://github.com/Datura-ai/lium" rel="noopener noreferrer"&gt;README&lt;/a&gt;). Install and sign in:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;curl &lt;span class="nt"&gt;-fsSL&lt;/span&gt; https://lium.io/install.sh | bash   &lt;span class="c"&gt;# or: pip install lium.io&lt;/span&gt;
lium init                                     &lt;span class="c"&gt;# opens the browser to approve; --no-browser prints the URL&lt;/span&gt;
lium balance
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Top up in the dashboard (card or crypto). Then list the B300 nodes. &lt;code&gt;--gpu B300&lt;/code&gt; matches both B300 SXM6 model names on Lium (&lt;code&gt;AC&lt;/code&gt; and &lt;code&gt;PC&lt;/code&gt;), which are the same card (&lt;a href="https://docs.lium.io/developers/cli/quickstart?utm_source=devto&amp;amp;utm_medium=content&amp;amp;utm_campaign=posts-0924-b300" rel="noopener noreferrer"&gt;CLI quickstart&lt;/a&gt;):&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;lium &lt;span class="nb"&gt;ls&lt;/span&gt; &lt;span class="nt"&gt;--gpu&lt;/span&gt; B300
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Rent eight GPUs with a hard stop, and have the CLI prove the pod has the GPUs you pay for:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;lium up &lt;span class="nt"&gt;--gpu&lt;/span&gt; B300 &lt;span class="nt"&gt;--count&lt;/span&gt; 8 &lt;span class="nt"&gt;--name&lt;/span&gt; b300 &lt;span class="nt"&gt;--ttl&lt;/span&gt; 2h &lt;span class="nt"&gt;--verify-gpus&lt;/span&gt; &lt;span class="nt"&gt;--strict-gpus&lt;/span&gt; &lt;span class="nt"&gt;--yes&lt;/span&gt; &lt;span class="nt"&gt;--no-ssh&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;ul&gt;
&lt;li&gt;
&lt;code&gt;--gpu&lt;/code&gt; with &lt;code&gt;--count 8&lt;/code&gt; takes the lowest-priced matching node. &lt;code&gt;--ttl 2h&lt;/code&gt; removes the pod after two hours, so a forgotten pod stops billing on its own. &lt;code&gt;--budget 150&lt;/code&gt; stops it once $150 has been spent.&lt;/li&gt;
&lt;li&gt;
&lt;code&gt;--verify-gpus&lt;/code&gt; counts the GPUs &lt;code&gt;nvidia-smi -L&lt;/code&gt; sees inside the pod and compares that with the billed count. &lt;code&gt;--strict-gpus&lt;/code&gt; removes the pod on a mismatch (&lt;a href="https://docs.lium.io/developers/cli/reference/up?utm_source=devto&amp;amp;utm_medium=content&amp;amp;utm_campaign=posts-0924-b300" rel="noopener noreferrer"&gt;&lt;code&gt;lium up&lt;/code&gt; reference&lt;/a&gt;).&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;Run, copy results back, and stop billing:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;lium &lt;span class="nb"&gt;exec &lt;/span&gt;b300 &lt;span class="s2"&gt;"nvidia-smi -L"&lt;/span&gt;
lium scp b300 /workspace/out.tar ./ &lt;span class="nt"&gt;-d&lt;/span&gt;
lium &lt;span class="nb"&gt;rm &lt;/span&gt;b300 &lt;span class="nt"&gt;-y&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;h2&gt;
  
  
  Start from Python
&lt;/h2&gt;

&lt;p&gt;The SDK's &lt;code&gt;rent()&lt;/code&gt; picks a node that fits a spec. &lt;code&gt;dry_run=True&lt;/code&gt; shows the node and the price without renting (&lt;a href="https://docs.lium.io/developers/sdk/reference/client/lium?utm_source=devto&amp;amp;utm_medium=content&amp;amp;utm_campaign=posts-0924-b300" rel="noopener noreferrer"&gt;SDK reference&lt;/a&gt;):&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight python"&gt;&lt;code&gt;&lt;span class="kn"&gt;from&lt;/span&gt; &lt;span class="n"&gt;lium.sdk&lt;/span&gt; &lt;span class="kn"&gt;import&lt;/span&gt; &lt;span class="n"&gt;Lium&lt;/span&gt;

&lt;span class="n"&gt;lium&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="nc"&gt;Lium&lt;/span&gt;&lt;span class="p"&gt;()&lt;/span&gt;
&lt;span class="n"&gt;quote&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;lium&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;rent&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;gpu_type&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;B300&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;gpu_count&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="mi"&gt;8&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;max_price_per_gpu_hour&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="mf"&gt;9.50&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt;
                  &lt;span class="n"&gt;name&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;b300&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;dry_run&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="bp"&gt;True&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;span class="nf"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;quote&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="n"&gt;executor&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="n"&gt;huid&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;quote&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="n"&gt;gpu_count&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;quote&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="n"&gt;price_per_hour&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;

&lt;span class="n"&gt;rented&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;lium&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;rent&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;gpu_type&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;B300&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;gpu_count&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="mi"&gt;8&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;max_price_per_gpu_hour&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="mf"&gt;9.50&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;name&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;b300&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;span class="n"&gt;pod&lt;/span&gt; &lt;span class="o"&gt;=&lt;/span&gt; &lt;span class="n"&gt;lium&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;wait_ready&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;rented&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="n"&gt;pod&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;timeout&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="mi"&gt;900&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;span class="nf"&gt;print&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;lium&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;exec&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;pod&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;command&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;nvidia-smi -L&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;,&lt;/span&gt; &lt;span class="n"&gt;timeout&lt;/span&gt;&lt;span class="o"&gt;=&lt;/span&gt;&lt;span class="mi"&gt;60&lt;/span&gt;&lt;span class="p"&gt;)[&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="s"&gt;stdout&lt;/span&gt;&lt;span class="sh"&gt;"&lt;/span&gt;&lt;span class="p"&gt;])&lt;/span&gt;
&lt;span class="n"&gt;lium&lt;/span&gt;&lt;span class="p"&gt;.&lt;/span&gt;&lt;span class="nf"&gt;down&lt;/span&gt;&lt;span class="p"&gt;(&lt;/span&gt;&lt;span class="n"&gt;pod&lt;/span&gt;&lt;span class="p"&gt;)&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;h2&gt;
  
  
  Two minutes of checks before a big job
&lt;/h2&gt;

&lt;p&gt;On any 8-GPU pod, the first two commands decide whether a tensor-parallel job will run well (&lt;a href="https://docs.lium.io/pod-users/multi-gpu-checks?utm_source=devto&amp;amp;utm_medium=content&amp;amp;utm_campaign=posts-0924-b300" rel="noopener noreferrer"&gt;Before you rent 8 GPUs&lt;/a&gt;):&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;lium &lt;span class="nb"&gt;exec &lt;/span&gt;b300 &lt;span class="s2"&gt;"nvidia-smi topo -m &amp;amp;&amp;amp; nvidia-smi topo -p2p r"&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Every off-diagonal GPU cell of &lt;code&gt;topo -m&lt;/code&gt; should read &lt;code&gt;NV#&lt;/code&gt;, and every cell of &lt;code&gt;-p2p r&lt;/code&gt; should read &lt;code&gt;OK&lt;/code&gt;. Then time a real download to the disk you will use, since checkpoint pulls vary widely between nodes:&lt;br&gt;
&lt;/p&gt;

&lt;div class="highlight js-code-highlight"&gt;
&lt;pre class="highlight shell"&gt;&lt;code&gt;lium &lt;span class="nb"&gt;exec &lt;/span&gt;b300 &lt;span class="s2"&gt;"cd /workspace &amp;amp;&amp;amp; time hf download openai-community/gpt2 model.safetensors --local-dir /workspace/probe"&lt;/span&gt;
&lt;/code&gt;&lt;/pre&gt;

&lt;/div&gt;



&lt;p&gt;Two notes for Blackwell from the &lt;a href="https://github.com/Datura-ai/lium" rel="noopener noreferrer"&gt;README&lt;/a&gt;: use a cu128 or newer PyTorch build (&lt;code&gt;pip install torch --index-url https://download.pytorch.org/whl/cu130&lt;/code&gt;), and use FlashAttention-4 or cuDNN attention, since FlashAttention-3 is Hopper-only.&lt;/p&gt;

&lt;h2&gt;
  
  
  When no 8x B300 is free
&lt;/h2&gt;

&lt;p&gt;File a machine request: dashboard → &lt;strong&gt;Machine Requests&lt;/strong&gt; → &lt;strong&gt;ADD NEW&lt;/strong&gt;, then pick the GPU model and a GPU count of 8. Providers subscribed to that GPU type are emailed your request. Lium checks the marketplace every 5 minutes for 30 days and emails you, at most once a day, when a node that fits is listed (&lt;a href="https://docs.lium.io/pod-users/machine-requests?utm_source=devto&amp;amp;utm_medium=content&amp;amp;utm_campaign=posts-0924-b300" rel="noopener noreferrer"&gt;docs&lt;/a&gt;). New 8x B300 hosts go fast: on 22 September, Lium's rental records show two new hosts rented within 22 and 41 minutes of listing, so rent from the link when the email arrives.&lt;/p&gt;

&lt;p&gt;Current prices per model are on &lt;a href="https://lium.io/pricing?utm_source=devto&amp;amp;utm_medium=content&amp;amp;utm_campaign=posts-0924-b300" rel="noopener noreferrer"&gt;lium.io/pricing&lt;/a&gt;, and the B300 page is &lt;a href="https://lium.io/gpu/b300-sxm6-ac?utm_source=devto&amp;amp;utm_medium=content&amp;amp;utm_campaign=posts-0924-b300" rel="noopener noreferrer"&gt;lium.io/gpu/b300-sxm6-ac&lt;/a&gt;.&lt;/p&gt;

</description>
      <category>gpu</category>
      <category>machinelearning</category>
      <category>cloud</category>
      <category>tutorial</category>
    </item>
  </channel>
</rss>
