If you ever want a local chatgpt like a chatbot that is not affected by the capacity problem that the chatgpt has or you want to ask him something that he is unwilling to answer, you need to hire about this.
There is an open source project called CatAI, it uses the open source model of meta called llama to create a local AI assistant with cool chat UI.
It can answer everything without a second thought.
Usage
It is very simple, first let's install the model:
npm i -g catai
Then we choose the model to download, for this example let's install the 7B model.
catai install 7B
Then let's start using it with the simple command:
catai serve
Good luck!
Top comments (0)