The latest articles on DEV Community by Vitalii Yulieff (@yulieff). https://dev.to/yulieff https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F1759757%2Fd02af7fe-6847-489c-9a5a-f2d98bd79024.jpg https://dev.to/yulieff en Vitalii Yulieff Thu, 11 Jul 2024 11:54:12 +0000 https://dev.to/yulieff/fixing-ollama-installation-on-manjaro-nvidia-2hdk https://dev.to/yulieff/fixing-ollama-installation-on-manjaro-nvidia-2hdk <p>The current Ollama version in Arch is outdated (<code>0.1.44</code> vs <code>0.2.1</code> latest). The official install script doesn't support some Manjaro configurations, but don't worry—I've got the fix!</p> <h2> The Problem 🤔 </h2> <p>When I tried running the install script, I got hit with this:<br> </p> <div class="highlight js-code-highlight"> <pre class="highlight shell"><code>curl <span class="nt">-fsSL</span> https://ollama.com/install.sh | sh <span class="c"># sh: line 252: VERSION_ID: unbound variable</span> </code></pre> </div> <p>This cryptic error just means you're missing those NVIDIA drivers, and Ollama can't sort that out for you.</p> <h2> Step-by-Step Fix 🏌️ </h2> <p><strong>step 1</strong>: find your linux kernel verion:<br> </p> <div class="highlight js-code-highlight"> <pre class="highlight shell"><code><span class="nb">uname</span> <span class="nt">-r</span> <span class="c"># 6.9.5-1-MANJARO</span> pamac search <span class="s2">"linux.*header"</span> <span class="c"># linux69-headers 6.9.5-1 [Installed]</span> </code></pre> </div> <p><strong>step 2</strong> install everything you need<br> </p> <div class="highlight js-code-highlight"> <pre class="highlight shell"><code>pamac <span class="nb">install </span>nvidia nvidia-utils cuda linux69-headers </code></pre> </div> <p><strong>step 3</strong> you might want to restart your Linux just to be on the safe side</p> <p><strong>step 4</strong> Now, run the install script again:<br> </p> <div class="highlight js-code-highlight"> <pre class="highlight shell"><code>curl <span class="nt">-fsSL</span> https://ollama.com/install.sh | sh <span class="c"># ollama successfully installs on your Manjaro system!</span> </code></pre> </div> <p>🏆 Boom! Done!</p> <h2> Troubleshooting 🕵️‍♂️ </h2> <p>Here's how you can check the successful installation:</p> <p>1) Run <code>nvidia-smi</code> and your video card should show up.<br> 2) Make sure that your video card and its device ID are in the OLLAMA's logs<br> </p> <div class="highlight js-code-highlight"> <pre class="highlight shell"><code>journalctl <span class="nt">-u</span> ollama | <span class="nb">grep</span> <span class="s2">"id=.*NVIDIA"</span> <span class="c"># ollama[2174]: [...] id=GPU-3a31a7cb-e46b-458c-9a92-ea9708b0c7fa library=cuda compute=8.9 driver=12.4 name="NVIDIA GeForce RTX 4090 Laptop GPU" total="15.7 GiB" available="15.5 GiB"</span> </code></pre> </div> <h2> Quick Note for Wayland + GNOME Users </h2> <p>Even after I installed drivers, my Wayland still uses integrated video graphics.</p> ollama manjaro nvidia