DEV Community: Jait Ramadandi Jeke

Transforming an Old Laptop into a Local AI Chatbot with LLAMA3 and Open WebUI

Jait Ramadandi Jeke — Sun, 22 Dec 2024 20:21:54 +0000

In this post, I'll show you how I turned my old laptop, which I hadn't used in a while, into a local ChatGPT clone with just a few simple steps. Setting this up is straightforward and doesn’t require much effort.

Why Use a Local AI Chatbot?

Privacy: Your data stays local.
Customization: Fine-tune the model to fit your needs.
Flexibility: Use the AI as you see fit.

Steps to Set Up a Local AI Chatbot

1. Run Open WebUI via Docker

To make the installation easy, I'll use Docker to set up Open WebUI with bundled Ollama support.

Run the following command on your computer:

docker run -d -p 3000:8080 -v ollama:/root/.ollama -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:ollama

This command will start Open WebUI. Once it's running, visit http://localhost:3000 in your browser and set up an admin user.

2. Install LLAMA3.2:1b

For this example, I’m using the llama3.2:1b model, but you can choose any other large language model (LLM) available on the Ollama site, depending on your needs.

In the top-left corner of Open WebUI, type the name of the model you want to install.
In my case, it’s llama3.2:1b.
Click Pull "llama3.2:1b" from Ollama.com.
Here’s an example of how it looks during the installation:

That's it! You can access your LLM (Large Language Model) from another device with the same network, using a local IP address like this example:

Once the model is installed, you can start using your local AI chatbot. Open WebUI supports multiple LLMs, so you can experiment with different models to find what works best for your needs.

What's next?

I'm planned to fine-tune LLAMA on my own dataset. So, wish me luck ;v

References

2 Things That I Started to Think in Reverse

Jait Ramadandi Jeke — Wed, 08 May 2024 05:09:52 +0000

A year ago, I bought a book written by Paul Arden titled "Whatever You Think, Think the Opposite". It's a simple book that teaches you that sometimes you need to think the opposite of other people or common ideas. As time went by, I came up with three things that I started to think about in reverse, which I'm going to write about in this article.

1. Set Goals That are Intended to Fail

Like many other folks, many times I set up a goal and it just didn't work out. Whether it's learning new things, building something, or my personal life, I started to wonder what was wrong with myself and began blaming myself for it. But now, I don't think the same way anymore.

So, here is what I do. What if you set up a goal but intended it to fail? I know it sounds cliché, but that's what I do now. The idea is, you have a goal, and when it fails, you have to find out why it failed and quickly learn from it. If the goal works, I will be happy. But if it fails, that is okay too, since I intended that goal to fail. So I don't blame myself anymore and don't feel down about it.

2. Being Productive is not all about adding something, but it's about removing something

I used to think that being productive means I can deliver more in terms of work. And that is true. But there is one thing that I forget about. The key to becoming productive is about removing something from your life. Being able to say no to things that are not your main priority or not really important. Removing distractions such as social media and some bad habits that can waste your time.

Being productive is not all about adding something to your life, but it's about removing things from your life. You can only do things that are right when you remove things that are wrong.

Conclusion

In wrapping up, let's take a look at what I've learned from these two ideas.

First off, we found out that setting goals with the expectation that they might fail isn't such a bad idea after all. Instead of seeing failure as a total disaster, we learned to see it as a chance to learn and grow. By embracing this mindset, we can shake off the fear of messing up and actually learn a ton from our mistakes.

And secondly, being productive isn't just about cramming more stuff into our schedules. It's also about clearing out the distractions and things that aren't important, which are holding us back. By cutting out distractions and focusing on what really matters, we can make room for the things that truly light us up.

So, in a nutshell, reverse thinking is all about flipping the script and trying out new ways of doing things. It's about embracing the unexpected and being open to unconventional ideas. And who knows? Maybe by thinking a little differently, we'll stumble upon some pretty cool solutions to life's challenges.

Why do we get frustrated when learning something?

Jait Ramadandi Jeke — Sat, 16 Sep 2023 07:35:57 +0000

When learning a new skill, we often reach a frustrating point, especially if you are a beginner, feeling that it's beyond our capabilities. We unconsciously give up before we actually quit. Boredom, panic, frustration, and insecurity are normal emotions in the process.

If you don’t feel frustrated while learning something, maybe you’re not learning. So, when you’re practicing some skills and you feel frustrated, that’s your weakness. So congratulations! You just know what your weakness is. In that moment, you started working on what you weren’t good at.

Learning is a painful process.

Pain is good for you. I know your tendency is to try to make it easy for yourself. Because at the end of the day, we are just human beings. We don’t like pain. So at some point, when you learn something and you feel it’s really easy to do and so much fun, you’re probably not learning. You’re trying to avoid your weaknesses.

The frustration is a sign of progress.

Frustration is a signal that your mind is processing complexity and requires more practice. Trusting this will all happen, you will allow the natural learning process to move forward, and everything else will fall into place.

So when you’re frustrated while learning, you don’t really know what you need to do. And that’s a signal on the way to a breakthrough. That moment you’re about to give up is where the magic happens. On the next day, all of the perfect solutions came to you. So, you only need to rest and chill a bit. Not quit.

Adopt the right mindset.

If you go that far, you will know that pain and frustration are good things. Once you know that, you are able to wait for the breakthrough that will come because you don’t give up.

You cannot change the topics that you’re learning to make them easier for you. But you can change your point of view. "Hmm, okay. This is my weakness; I need to work on it!". Adopting the right mindset is so important.

So remember, when you have that frustration, you are on the right path. Don’t give up!

Cara Membuat Output dari Query MongoDB Shell Menjadi Berwarna

Jait Ramadandi Jeke — Sat, 28 Aug 2021 15:12:17 +0000

Halo guys! Kali ini saya akan sharing tentang bagaimana cara merubah output dari query MongoDB Shell menjadi berwarna agar lebih nyaman untuk dibaca. Untuk melakukan itu kita akan menggunakan sebuah shell extension yang bernama Mongo-Hacker.

Untuk menginstallnya, kita hanya butuh 4 langkah berikut:

Step 1: Clone repository dari Mongo-Hacker

git clone https://github.com/TylerBrock/mongo-hacker

Step 2: Masuk kedalam folder mongo-hacker

cd mongo-hacker

Step 3: Install package

make install

Step 4: Bersikan folder

cd ..
rm -rdf mongo-hacker/

Selesai!