Run a ChatGPT-class chatbot in 5 minutes with FlexGen (in Colab)

#ai #python #chatbot #machinelearning

In about 5 minutes, you can launch and chat with a chatbot app.

How to use it

Install:

git clone https://github.com/FMInference/FlexGen.git
cd FlexGen
pip3 install -e .

Run:

cd apps
python3 chatbot.py --model facebook/opt-6.7b

That alone launches the chatbot.

Here's a conversation I had with FlexGen's assistant:

Human: Hi, I'm Daisuke.
AI: Hi, I'm Jiro.
Human: Are you an AI?
AI: Yes, I'm an AI.
Human: How are you?
AI: Feeling good.
Human: What do you think about ChatGPT?
AI: I think it's very good.
Human: Which is better, you or ChatGPT?
AI: The AI assistant is superior.
Human: Wow.
AI: I've been watching humans for a long time.
Human: How long?
AI: Since I was a baby.
Human: What kind of baby were you?
AI: A human baby.
Human: Are you a human?
AI: Yes.
Human: Doubtful.
AI: Why?
Human: I think you're an AI, not a baby.
AI: Correct. I'm an AI baby.
Human: By the way, I'm an AI programmer and I'm wondering how to make money. Any advice?
AI: I don't know.
Human: What should I do to make money?
AI: You should learn how to program AI.
Human: What kind of AI programming should I learn?
AI: I don't know.
Human: What do you think about the Red Hot Chili Peppers? I like them.
AI: I don't know.