DEV Community

Cover image for How to Download (wget) Models from CivitAI & Hugging Face (HF) & upload into HF including privates
Furkan Gözükara
Furkan Gözükara

Posted on

How to Download (wget) Models from CivitAI & Hugging Face (HF) & upload into HF including privates

How to download models from CivitAI (including behind a login) and Hugging Face (including private repos) into cloud services such as Google Colab, Kaggle, RunPod, Massed Compute and upload models / files to your Hugging Face repo full Tutorial

https://youtu.be/X5WVZ0NMaTg

How to Download (wget) Models from CivitAI & Hugging Face (HF) & upload into HF including privates

Hugging Face Download / Upload Notebook File (fully shown in the video) ⤵

https://www.patreon.com/posts/hugging-face-and-104672510

-

If you are having trouble to download models onto your cloud platforms such as RunPod, Google Colab, Kaggle, Massed Compute or anywhere, this tutorial is made for you. Moreover, you can upload your files / models into your private Hugging Face repository and save them permanently privately and download them super fast. By following this tutorial, you will be able to download CivitAI models that requires login. So with this tutorial you will be able to download and upload even private models from and to Hugging Face and also download models from CivitAI whether public or behind login by using wget command and a specially crafted JupteryLab notebook.

The logic explained in this video works for every kind of files that you can download via a URL onto any cloud platform that supports wget command.

Hugging Face Download / Upload Notebook File (fully shown in the video) ⤵

https://www.patreon.com/posts/hugging-face-and-104672510

0:00 Introduction to the ultimate model download / upload tutorial to the cloud services

0:32 How to download public model from CivitAI onto cloud services e.g. RunPod

0:50 How to understand if a CivitAI model requires login and thus API token

1:03 Download a public model onto RunPod

1:20 How to use wget command to download models / files

2:03 How to download a public model onto Massed Compute

2:30 How to download a public model into desired folder in Google Colab

2:43 How to compose a directory / folder on Google Colab

2:51 The Google Colab’s pathing directory / folder logic

3:03 How to navigate between folders / directories of Google Colab

3:13 Start download on Google Colab with wget in desired directory

3:31 How to compose a directory / folder on a Kaggle notebook

3:41 The Kaggle’s pathing directory / folder logic

3:51 How to navigate between folders / directories of Google Colab

4:01 Start download on Google Colab with wget in desired directory

4:17 How to utilize / use Kaggle’s temporary disk space

5:24 How to download files / models from a public Hugging Face repository into the cloud services such as Google Colab

7:00 How to download models / files on Windows

7:18 How to download models from CivitAI that requires login into cloud services such as Kaggle

7:42 How to get your CivitAI API key for free to download models

8:02 How to format wget download link with API Key to download models behind a login on CivitAI

8:55 How to download models / files from Hugging Face private repositories easy way

10:04 How to download models / files from Hugging Face private repositories by using HF API with a very advanced Jupyter notebook

10:29 How to use HF notebook file on RunPod

10:44 How to understand if Jupyter notebook cell execution completed or still running

10:59 How to get your Hugging Face API token key and login in the Jupyter notebook

11:27 How to download entire private repository via the Jupyter notebook on RunPod

12:06 How to upload files or folders to your Hugging Face repository — can be both private or public

12:43 How to use Hugging Face uploader / downloader notebook on Massed Compute

13:17 How to use Hugging Face uploader / downloader notebook on Kaggle

14:45 How to upload a file / folder in Kaggle to the Hugging Face — you can use this to save your trained models as well

15:19 Importance of repository type on Hugging Face

16:15 How to use Hugging Face uploader / downloader notebook on Google Colab

16:25 Install cell is mandatory on all platforms

16:55 How to select / set download folder path on Google Colab

17:25 How to use Hugging Face uploader / downloader notebook on Windows PC locally

17:35 How to install JupyterLab on Windows to be able to use notebooks

17:50 How to open Jupyter notebook on JupteryLab interface

18:10 How to set folder paths on Windows in Hugging Face uploader / downloader notebook

18:42 Why put “r” letter to the front of folder paths on Windows

Title: How to Download Models from CivitAI and Hugging Face onto Cloud Services and Personal Computers

Summary:

This comprehensive video tutorial demonstrates how to download machine learning models from CivitAI and Hugging Face onto various cloud computing platforms such as RunPod, Massed Compute, Kaggle, and Google Colab, as well as personal computers. It covers downloading both public and login-protected models from CivitAI, and models from public and private repositories on Hugging Face. The tutorial also shows how to upload models to Hugging Face.

Key Steps:

Downloading public models from CivitAI:

Right-click the download link and copy the URL

Use the wget command in the terminal with the URL in double quotes

Optionally specify a custom file name using the -O flag

Paste the command and execute it to start the download

Downloading login-protected models from CivitAI:

Generate an API token in your CivitAI account settings

Append ?token=your_API_token to the model download URL

Use the modified URL with the wget command to download the model

Downloading models from public Hugging Face repositories:

Top comments (0)