DEV Community: RunC.AI

Deploying DeepSeekR1-32B on RunC.AI

RunC.AI Offical — Fri, 04 Jul 2025 10:24:21 +0000

Welcome everybody, to another RunC.AI tutorial. This time we will still be playing with DeepSeek, except we are going to use the Ubuntu system image. Now let us start this tutorial.

First and foremost

Login to your account as always and click deploy. Scroll down to Image and click System image, this time we will be using Ubuntu.

Then you will click the login button on the right

You will then see a page where you need to enter the password

You can find your password here

Deploy Ollama

Once you get in the Ubuntu terminal, type in the following command to install ollama.

curl -fsSL https://ollama.com/install.sh | sh

By default, after the installation is completed, there will be an ollama.service file. In order to enable the local host and Docker containers to communicate with each other, the Environment variable needs to be modified to "OLLAMA_HOST=0.0.0.0:11434"

sudo vim /etc/systemd/system/ollama.service

Now we need to restart Ollama

sudo systemctl daemon-reload
sudo systemctl restart ollama

Now we can pull the DeepSeek-R1 Model

ollama run deepseek-r1:32b

Open-WebUI

Now we need to pull the Open-WebUI Image

First, follow the Nvidia official website to download and config Nvidia CUDA container toolkit.

https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html

Then type in the following command

sudo docker pull ghcr.io/open-webui/open-webui:cuda

In order to enable webui within the container to communicate with Ollama on the external host, it is necessary to allow the Docker container to directly use the host network

docker run -d --network=host \
-v open-webui:/app/backend/data \
-e OLLAMA_BASE_URL=http://127.0.0.1:11434 \
--name open-webui --restart always \
ghcr.io/open-webui/open-webui:cuda

To get access to Open WebUI, visit http://IP:8080 where "IP" is your IP address which you can find in the following picture

Now, you can ask deepseek any question you want.

About RunC.AI

Rent smart, run fast. RunC.AI allows users to gain access to a wide selection of scalable, high-performance GPU instances and clusters at competitive prices compared to major cloud providers like Amazon Web Services (AWS), Google Cloud, and Microsoft Azure.

How to deploy ComfyUI on RunC.AI

RunC.AI Offical — Fri, 30 May 2025 06:13:50 +0000

Welcome to our first deployment tutorial! This tutorial is designed to give you an idea of how to deploy ComfyUI with RunC. The steps are simple, don't worry! I'm sure even a pure novice can handle it! Let's goooo!!

1. Deploy ComfyUI on RunC

First of all, sign in/up RunC.AI | Run clever cloud computing for AI (New customers before 6th, June 2025 get $5 in free credits, about 12h of 4090 usage time)

Secondly, enter the console. Go to "Instance" and click "Deploy" to start creating the image.

On this page, choose the GPU model and select the image you want to deploy or click system image to switch from different system.

Here I chose ComfyUI. Select billing cycle you want and deployment phase is done.

NOTE: You can see the status of your instance on the dashboard. If the status is 'running', even if you are not using it, the renting fee is still counting. Also, stopping the instance will still incur renting fees. If you would like to avoid fees, please delete the instance.

2. How to create a text-to-image workflow in the comfyUI

Next, I take you step by step to build the workflow of the text-to-image. You do not need to take notes to remember these functions when you first get started. The key here is to practice and master it through actual operation with deep understanding of each function.

First, if you are the first time initiating the ComfyUI interface, then there should be a default text-to-image workflow.

The next workflow we're going to build is this default text-to-image diagram, the purpose of which is to let you build the workflow yourself.

Then we click 'New' in the top left ribbon to create a new interface.

Step 1: Add "K Sampler"

In the blank space of the workspace, single right mouse button to bring up the node ribbon, select Sampling - K Sampler, then we will add a sampler node in the workspace.

First, let's introduce a few parameter settings in the "K Sampler":

The first parameter "seed": corresponds to the seed value in the webUI, will display the value of the image every time it is generated, the default is 0.

The second parameter "control_after_generate": includes four options - fixed, increasing, decreasing, and random.

These two parameters are used together, "fixed" represents the value of the fixed image, and the increasing/decreasing is +1 or -1 value. "random" represents a random value. Generally we use fixed or random.

Step 2: Add "Large Models"

As shown in the figure, you can drag the model connection point and add the "Load Checkpoint".

Step 3: Add "Positive & Negative Prompt Words"

Add a positive prompt word input node in the same way as above, as shown in the figure:

The negative CLIPTextEncode can be added in the same way, i.e. by dragging the 'negative' connection point.

Step 4: Add "Image Size/Batch"

Drag the "latent_image" connection point and select "Empty Latent Image" to add the "Image Size/Batch" node, which has width, height and batch size parameters.

Step 5: Add "VAE Decoder"

Drag the "Latent" connection point and select "VAEDecode" to add VAE.

Step 6: Add "Image Generation Area"

Drag the "Image" connection point and select "Preview Image" to successfully add the image generation area.

At this point, all the nodes needed for the entire text-generated graph have been successfully added, and we've entered a prompt in the forward prompts (e.g. a border collie).

If at this point you do what I did and click Queue, then you will get this error report, look at the red box in the figure for the prompt and the red markings on the nodes. The reason this is happening is because we have these red labeled nodes that are not connected.

Then next we need to fix these error nodes and connect them all together. Pay attention to the color on the connection point. If it is a yellow connection point you need to connect to the corresponding yellow connection point (name correspondence), as shown in the figure (I mark them with green arrows) :

Then click "Generate" again. Congratulations! This text-to-image workflow has been successfully built.

Below to add a little more:

The image generation area selected above are preview images and needs to be manually saved. Right-click on the image, and select "Save Image" to download the image.

Comments
The whole process of building ComfyUI text-to-image workflow on RunC.AI platform is less than half an hour from registration to the completion of the workflow, which is very easy to understand and convenient. Unlike the complexity and high cost of local deployment, RunC.AI solves these problems perfectly.

RunC.AI's interface is simple and intuitive so even first-time AI users can get started easily. When generating images, the response speed is very fast with almost no lag. And there were no failures or errors reported during the entire process.

Whether you are a novice or an experienced user, you can find the right tools and resources for you on RunC.AI. In the future, I'll post more features and try to build different types of workflows. Stay tuned!

About RunC.AI

Written by:
Ashley Morgan
Product Manager from RunC.AI
More information:RunC.AI Blog
Join our Discord:Run.AI Community

Why 8 RTX 4090 Delivers Superior Performance/Cost Over 8 A6000 Ada: A Deep Dive

RunC.AI Offical — Mon, 26 May 2025 10:01:25 +0000

In the realm of AI model training, rendering, and high-performance computing (HPC), selecting the right GPU is critical—not just for performance but also for budget efficiency. For years, professionals have gravitated toward NVIDIA’s professional GPUs such as the A6000 Ada, known for its robust memory, ECC support, and driver certification. However, the emergence of the RTX 4090—a gaming-class GPU—has disrupted that norm by offering comparable or superior performance in many real-world scenarios at a fraction of the price.

This article explores why deploying an 8× RTX 4090 configuration on RunC.AI can be significantly more cost-effective than 8× A6000 Ada GPUs, based on performance, practical deployment considerations, and real-world use cases.

1. Architecture and Specification Comparison

Although both GPUs use the Ada Lovelace architecture, the RTX 4090 is tuned for peak performance in consumer workloads, whereas the A6000 Ada targets reliability and long-duration professional use. Here's how they stack up:

Key Insight: While the A6000 Ada has more VRAM and slightly more cores, the RTX 4090 offers faster memory (GDDR6X), higher clocks, and stronger out-of-box performance in many mixed-precision workloads like FP16 and BF16, which dominate modern AI training.

2. Real-World Performance Benchmarks

AI Training and Inference
Although RunC.AI currently focuses on providing access to RTX 4090 GPUs, its user-reported and internal benchmarks offer strong insight into how the 4090 compares to enterprise-class GPUs like the A6000 Ada. For typical AI workloads—such as fine-tuning transformer models (e.g., LLaMA, GPT-2), training diffusion models, and running large-scale inference—RTX 4090 consistently delivers performance that rivals or even exceeds that of the A6000 Ada.
This is due to:
●Higher clock speeds and newer memory (GDDR6X) on the 4090
●Superior FP16/BF16 throughput, which many modern AI frameworks now rely on
●Efficient multi-GPU scaling using frameworks like DeepSpeed and ZeRO-Offload

Users on RunC.AI report that training times using RTX 4090 instances are highly competitive, often 5–10% faster than what was previously achieved on A6000 Ada hardware, especially in tasks that do not demand over 24GB of VRAM per GPU.

By offering RTX 4090s at a significantly lower cost than A6000 Ada-based cloud services, RunC.AI enables researchers and developers to complete training workloads faster and at dramatically better cost-efficiency.

Rendering and Simulation
In rendering tasks, third-party benchmarks show the RTX 4090 outperforming the A6000 Ada by 15–20% in tools like Blender, thanks to its higher boost clocks and aggressive thermal design. While RunC.AI focuses primarily on compute workloads, users performing GPU-based rendering (e.g., using Stable Diffusion or 3D model preprocessing) benefit from the 4090’s fast throughput and high memory bandwidth.

Combined with RunC.AI’s pay-per-use pricing model and scalable infrastructure, the 4090 becomes an extremely attractive option—even for professional workflows typically reserved for workstation GPUs.

3. Performance/Cost Ratio: The Game-Changer

The single biggest advantage of using RTX 4090 lies in cost efficiency. Here's a direct system-level comparison for a machine with 8 GPUs:

That’s a massive savings with virtually no performance penalty in many workloads. For startups, universities, or individual researchers, this efficiency can drastically reduce infrastructure budgets or multiply compute resources for the same cost.

4. Potential Limitations and Considerations

Of course, the 4090 isn’t a perfect drop-in replacement for professional-class GPUs. There are trade-offs:
Driver and Certification:

The A6000 Ada is designed with enterprise-grade drivers and is certified for many professional applications (CAD, DCC, etc.).
The 4090 lacks such certification, though it's rarely a problem in open-source AI/ML workflows.

VRAM and ECC:

48GB of ECC VRAM on the A6000 Ada is advantageous for large-scale datasets or simulation.
However, modern training frameworks now allow model partitioning, gradient offloading, and checkpointing—making 24GB sufficient in most setups.

Form Factor, Cooling, and Power:

The 4090 is larger, consumes more power (450W vs 300W), and requires careful thermal management.
8× 4090 setups may need water-cooling, riser cables, and custom chassis (e.g., 4U high-density GPU servers).
Yet, platforms like RunC.AI have already proven stable multi-4090 deployments at scale.

5. Ecosystem & Deployment

Cloud GPU providers like RunC.AI are standardizing on RTX 4090s because of their strong value proposition. For those building clusters or lab environments, system integrators are optimizing for these GPUs by balancing airflow, power delivery, and PCIe bandwidth.

The emergence of server-grade boards with consumer GPU support (e.g., Supermicro’s 8-GPU platforms) makes 4090-based HPC more accessible than ever.

Conclusion: 4090 Makes High-End Compute Affordable

The data is clear: an 8× RTX 4090 setup not only competes with but often surpasses the 8× A6000 Ada configuration in practical performance—all while costing less than one-third as much.

Unless your use case absolutely requires ECC memory, driver certification, or ultra-large VRAM per GPU, the RTX 4090 is the best bang for the buck in AI research, rendering, and heavy computation in 2025.

For AI startups, university labs, and independent researchers, this performance-per-dollar advantage is a rare opportunity to do more with less—without compromising compute power.

About RunC.AI
Rent smart, run fast. Headquartered in Singapore, RunC.AI allows users to gain access to a wide selection of scalable, high-performance GPU instances and clusters at competitive prices compared to major cloud providers like Amazon Web Services (AWS), Google Cloud, and Microsoft Azure.

Free credits are still available. Sign up now!
(Due 6th, June 2025)
Start your journey here:RunC.AI Official
Share your user story in RunC.AI's discord server, chance to win secret prize! RunC.AI Community

Why Should You Choose Renting Cloud GPU?

RunC.AI Offical — Thu, 15 May 2025 05:57:18 +0000

Think about the times when you have an urgent deadline about an AI project or application development, no time for debugging and scalability is the key. What's next?

Nowadays, companies, universities, researchers, and individual developers have started to rent a GPU or entire GPU servers instead of buying or local deployment.

The truth is, without the long-term commitment or expenses needed, renting cloud GPUs is the most flexible and affordable solution when dealing with heavy processing power.

Benefits include:

Cost-effectiveness
Renting GPUs provides flexible on demand model and do not require one-time huge hardware investment such as high-performance GPUs, supporting servers, and cooling equipment, etc.

Resource flexibility
GPU rental platform usually supports a variety of GPU models and users can adjust resource configuration any time. No limitations by hardware specifications.

Maintenance and technical support
24/7 technical support, rich model images and one-click deployment are supported in GPU rental platform to ensure service quality and ease of use which allows users to quickly get started with their applications.

Data security and privacy
GPU rental platform can ensure user data security through professional security measures and compliance management.

Scalability and Ecosystem
Select from either container or virtual machine modes, together with rich platform image resources, GPU rental platform can easily expand and customize workflows. No need to build and maintain a complex environment by yourself anymore.

About RunC.AI
Rent smart, run fast. RunC.AI | Run clever cloud computing for AI allows users to gain access to a wide selection of scalable, high-performance GPU instances and clusters at competitive prices compared to major cloud providers like Amazon Web Services (AWS), Google Cloud, and Microsoft Azure.

Register now and get $5 free credits for your applications!
The free credits will be recharged into your account automatically within few days.
(Due 6th, June 2025)
Start your journey here:RunC.AI Official