DEV Community

Cover image for I fine-tuned my model on a new programming language. You can do it too! 🚀

I fine-tuned my model on a new programming language. You can do it too! 🚀

Nevo David on April 25, 2024

I have been using OpenAI ChatGPT-4 for a while now. I don't have a lot of bad stuff to say about it. But sometimes, it's not enough. In Winglang, ...
Collapse
 
shaiber profile image
Shai Ber

Nice! Is there a way to access the LLM you trained?

Collapse
 
bmicklea profile image
Brad Micklea

Very soon KitOps will have a Dev mode command that will make it easy to run the LLM locally and interact with it via prompts or chats as well as experiment with various parameters. You can star our repo or, better yet, join our discord: discord.gg/Tapeh8agYy

Collapse
 
samcurran12 profile image
SamCurran12

Can't wait 🤞

Thread Thread
 
bmicklea profile image
Brad Micklea

Good news - KitOps dev mode is here! Now you can run and interact with an LLM locally (no internet or GPUs required) with a single Kit CLI command.
dev.to/kitops/kitops-release-v02-i...

Collapse
 
nevodavid profile image
Nevo David

Awesome!

Thread Thread
 
bmicklea profile image
Brad Micklea

Good news - KitOps dev mode is here! Now you can run and interact with an LLM locally (no internet or GPUs required) with a single Kit CLI command.
dev.to/kitops/kitops-release-v02-i...

Collapse
 
bmicklea profile image
Brad Micklea

Good news - KitOps dev mode is here! Now you can run and interact with an LLM locally (no internet or GPUs required) with a single Kit CLI command.
dev.to/kitops/kitops-release-v02-i...

Collapse
 
nevodavid profile image
Nevo David

I will dm you :)

Collapse
 
bmicklea profile image
Brad Micklea

You can, KitOps dev mode lets you run and interact with an LLM locally (no internet or GPUs required) with a single Kit CLI command.
dev.to/kitops/kitops-release-v02-i...

Collapse
 
nathan_tarbert profile image
Nathan Tarbert

Looks like I need to check out KitOps!

Collapse
 
nevodavid profile image
Nevo David

You do!

Collapse
 
morgan-123 profile image
Morgan

I'll check Kitops out!

Collapse
 
jwilliamsr profile image
Jesse Williams

Check out our discord, we have a lot coming down the pipeline in the next few weeks. discord.gg/Tapeh8agYy

Collapse
 
nevodavid profile image
Nevo David

🚀

Collapse
 
andrew0123 profile image
Andrew

Intresting, almost no python code :)

Collapse
 
nevodavid profile image
Nevo David

A little bit :)

Collapse
 
ayush2390 profile image
Ayush Thakur

Very informative blog, Nevo

Collapse
 
nevodavid profile image
Nevo David

Thank you so much!

Collapse
 
mathew00112 profile image
Mathew

I love it!

Collapse
 
nevodavid profile image
Nevo David

🙏🏻

Collapse
 
johny0012 profile image
Johny

Awesome!

Collapse
 
nevodavid profile image
Nevo David

🚀

Collapse
 
benjamin00112 profile image
Benjamin

Autotrain really simplifies everything.

Collapse
 
nevodavid profile image
Nevo David

It is!

Collapse
 
markfriedman profile image
mark-friedman

So what were your results? How did your small, but fine-tuned, model do with questions and code generation tasks with your new language compared to your RAG-based approach with GPT-4?

Collapse
 
henrywills22 profile image
henrywills22

Awesome!

Collapse
 
pablocabrol profile image
Pablo E. Cabrol • Edited

Have you tried Gen app Builder from Google?, let you use a set of data and no code to have a natural language access to your documentation. I'm doing my homework to test it my self. 😊

Collapse
 
aruntemme profile image
Arun

What about the size of data and the time it took to train in your MacBook?

Collapse
 
matijasos profile image
Matija Sosic

Thanks for sharing - we've actually been thinking about doing something similar for Wasp, our full-stack framework for React & Node.js! (github.com/wasp-lang/wasp)