DEV Community

Cover image for Scalable Load Balancing Having Cloud GPU Service Salad Tutorial With Whisper Transcriber Gradio APP
Furkan Gözükara
Furkan Gözükara

Posted on

1 1 1 1 1

Scalable Load Balancing Having Cloud GPU Service Salad Tutorial With Whisper Transcriber Gradio APP

In this tutorial I am introducing a new cloud GPU provider Salad. They have a very unique system that allows you to both make money by renting your GPU and use their GPU orchestrator system to deploy your own docker image or their pre-configured docker images to do AI tasks such as Stable Diffusion image generation, using LLMs or transcribing audio with Whisper. Since they utilize such orchestrator GPU management system, they are able to provide fully scalable, loading balancing have and with almost 100% uptime cloud GPU inference service.

https://youtu.be/AJV_9pqSgng

The GitHub Readme File ⤵️

https://github.com/FurkanGozukara/Stable-Diffusion/blob/main/Tutorials/Cheap-Cloud-GPU-Inference-Service-Salad-Tutorial.md

Join me on Salad and use code Y3MEDP for a 2x earning rate bonus! https://salad.com

The Self Developed Free Whisper Transcriber Gradio APP ⤵️

https://github.com/FurkanGozukara/Stable-Diffusion/blob/main/CustomPythonScripts/whisper_transcribe_salad.py

Salad Main Site : https://salad.com/

Salad Portal : https://portal.salad.com

Your Salad API Key : https://portal.salad.com/api-key

Salad Documentation : https://docs.salad.com/

Rent Your GPU To Salad To Eearn Revenue : https://salad.com/download

Salad Blog : https://blog.salad.com/

0:00 Introduction to the Salad tutorial

0:30 How Salad provides cheap GPU and scalability and load balancing

1:17 Rent your GPU to Salad to earn revenue

2:14 How to start using Salad cloud GPUs

3:05 How to deploy containers / docker images on Salad

3:15 How to use pre-configured docker images / containers / recipes on Salad

3:46 How to deploy Whisper container / recipe on Salad

4:03 What replica count does and what it means : do automated load balancing and scalability

5:04 How to check status of your deployed containers

5:35 How to deploy very best and most powerful Whisper version to get best and most accurate transcription

5:58 Where to find explanations of pre-configured docker images / recipes / containers

6:34 The free Gradio video and audio transcription software that I have prepared

7:41 How to use the Gradio transcriber app

10:13 The time Whisper Distil takes to transcribe 26 minutes audio speaking file

11:15 How to use Whisper Large V3 on Salad

AWS Security LIVE!

Join us for AWS Security LIVE!

Discover the future of cloud security. Tune in live for trends, tips, and solutions from AWS and AWS Partners.

Learn More

Top comments (0)

nextjs tutorial video

Youtube Tutorial Series 📺

So you built a Next.js app, but you need a clear view of the entire operation flow to be able to identify performance bottlenecks before you launch. But how do you get started? Get the essentials on tracing for Next.js from @nikolovlazar in this video series 👀

Watch the Youtube series

👋 Kindness is contagious

Please leave a ❤️ or a friendly comment on this post if you found it helpful!

Okay