DEV Community

Cover image for Use ChatGPT locally!
I-dodo
I-dodo

Posted on

Use ChatGPT locally!

If you ever want a local chatgpt like a chatbot that is not affected by the capacity problem that the chatgpt has or you want to ask him something that he is unwilling to answer, you need to hire about this.

Chat Example

There is an open source project called CatAI, it uses the open source model of meta called llama to create a local AI assistant with cool chat UI.

It can answer everything without a second thought.

Usage

It is very simple, first let's install the model:

npm i -g catai
Enter fullscreen mode Exit fullscreen mode

Then we choose the model to download, for this example let's install the 7B model.

catai install 7B
Enter fullscreen mode Exit fullscreen mode

Then let's start using it with the simple command:

catai serve
Enter fullscreen mode Exit fullscreen mode

Good luck!

Top comments (0)