DEV Community

Arman khan
Arman khan

Posted on

Llama-3.2 & Tacos: A Hackathon Love Story

WLH Challenge: Beyond the Code Submission

🌮 Llama-3.2 & Tacos: A Hackathon Love Story

Submission for the Beyond the Code track

🧩 How three strangers became “Team Taco-LLaMA”
Bolt.new’s auto-match dropped us in a voice channel at 11:47 pm PST.
Mira’s first words:
“If we ship before the salsa runs out, the tacos are on me.”
We pinned that quote to the top of our README.
🎙️ The 2 a.m. mentor miracle
At 02:14 the global audio lounge lit up. @osanseviero (Hugging Face staff) hopped in, screenshared our repo, and live-refactored:

before (OOM crash)

model = AutoModelForCausalLM.from_pretrained("Llama-3.2-3B")

after (fits 8 GB free tier)

bnb_config = BitsAndBytesConfig(
load_in_4bit=True,
bnb_4bit_compute_dtype=torch.bfloat16
)
model = AutoModelForCausalLM.from_pretrained(
"Llama-3.2-3B",
quantization_config=bnb_config,
device_map="auto"
)
He ended with:
“Cache to /data, not /tmp—Spaces wipes /tmp on restart.”
We immortalized that line in our commit history as feat: salsa-proof cache.
🌐 IRL pop-up that almost broke the internet
Sunday noon, @dev_dan asked Twitter:
“Any Austin hackers want to co-work for the final sprint?”
Within an hour, eight devs showed up at Bennu Coffee. We dragged two picnic tables together, shared extension cords like spaghetti, and projected our live Space build logs onto the brick wall. Every green checkmark earned a communal cheer; every red X earned a taco.
💌 Shout-outs & thank-yous
@osanseviero – for the 4-bit quantisation life-hack
@bolt-moderator-luna – who restarted our stuck Docker builder at 3 a.m.
@taco_truck_carlos – the IRL chef who gave us free al pastor at 4 a.m. when he heard we were “building AI tacos”

bolt-lounge – the 200-person Discord thread that collectively debugged CUDA version mismatches while sharing cat GIFs

🧡 Take-away
Code is ephemeral; people & tacos are forever.
We shipped the demo, but the real artifact is a group-chat still popping with memes, PR reviews, and plans to meet at PyCon 2025—tacos included.
Catch the demo → huggingface.co/spaces/taco-llama-hack/llama-chat-summarizer
Catch us IRL → probably the nearest taco truck.

Top comments (0)