DEV Community

Cover image for What I Actually Learned Building a Side Project in 5 Days With AI
Oli Kahn
Oli Kahn

Posted on • Originally published at olikahn28.substack.com

What I Actually Learned Building a Side Project in 5 Days With AI

Originally published on Oli Kahn's Substack. Cross-posting here for the dev.to community.

Most posts about “building with AI” are either hype or demos. This one is neither. It’s a field report.

Over the past five days, I shipped a small side project end-to-end — research, positioning, copy, visuals, deployment. Not a toy. Something with real traffic goals and an actual audience I care about reaching.

I didn’t use a single human freelancer. I used AI, my keyboard, and a lot of coffee.

Here’s what I actually learned — not the parts that sound good on Twitter, the parts that cost me hours and forced me to rewrite my mental model.


1. AI is a terrible strategist and a spectacular executor

The thing nobody tells you: if you ask an AI “what niche should I go into?” — you’re going to get mush. Generic. Hedged. Three options that all sound plausible and all lose.

But if you come with a hypothesis — even a half-formed one — and ask “pressure-test this, what breaks?” — suddenly you get real thinking.

The pattern I found: humans bring the bet, AI stress-tests it at 100x speed. Reversed, it doesn’t work.

Day 1 of this project, I wasted three hours asking AI to pick my direction. Day 2, I picked one myself in 20 minutes and asked AI to poke holes. The second approach produced a better plan by lunch.

2. The bottleneck moves. Fast.

When writing is free, what breaks?

Distribution.

When images are free, what breaks?

Consistency of visual identity across pieces.

When deployment is free, what breaks?

Everything you can’t measure.

Every time AI removed one bottleneck, another one became the new bottleneck overnight. The skill I actually developed this week wasn’t “prompting” — it was recognizing where the pressure had moved to, fast, before I wasted another afternoon on a problem that had already solved itself.

3. Tooling matters more than model choice

I’ll be honest: I kept swapping between models. Different models for different tasks. The real wins didn’t come from picking the “best” model — they came from the supporting tools around whatever model I was using.

A few that genuinely saved me time this week:

OutlierKit — if any part of your side project touches video content or you’re planning a YouTube arm, this is the competitor-analysis tool I wish I’d known about a year ago. It scans what’s working in your niche and tells you why, instead of making you guess. AI-powered, real data, and the low-competition keyword finder alone is worth the signup. Free trial, no card.

LiveChat — the moment you have an audience, you have questions. Putting LiveChat on a landing page took me under 10 minutes. It’s old-school boring-reliable software, which is exactly what you want when an AI-built product meets a real human asking “does this actually work?”

HelpDesk — once the questions pile up, email alone breaks. HelpDesk turns the mess into actual tickets. If you’re building anything that will eventually get support load, wire this in before you need it, not after.

Text — the broader platform the LiveChat family sits on. Worth knowing about if you want business messaging that isn’t another chatbot cosplay.

None of these are AI-core. All of them are what happens after you build the AI-core thing and suddenly have a real business attached to it.

4. The thing AI will not do for you

Ship.

AI will write the copy. AI will design the pin. AI will generate the code. AI will outline the strategy.

AI will not click the publish button.

I had three moments this week where everything was done — and I sat with my finger on the trigger for 30 minutes, because publishing is still an act of taste, and taste is still a thing you have to own.

If you’re building with AI and nothing is shipping, the problem is not your stack. The problem is you haven’t accepted that the taste layer is still yours. AI can make 100 variants. You still have to say “this one.”

5. Long-term traffic is the only traffic that matters

Here’s the shift I made this week that I think is the important one, strategically:

I stopped chasing posts that might get 10,000 views in 48 hours and die.

I started making assets that might get 200 views a day — forever.

Evergreen content. Search-indexed pages. Platforms where a single piece compounds for years (Pinterest, YouTube, blog SEO). Not places where content has a half-life of 18 hours (Twitter, Reddit front page).

AI makes evergreen content economically viable in a way it wasn’t before. You can produce the quantity those platforms reward, at the quality they demand, without burning out.

The people who will win the next two years of indie-building aren’t the ones with the best AI prompts. They’re the ones who understand that AI-produced evergreen > human-produced viral, almost every time, over a 12-month horizon.


What I’d tell you if you’re about to try this

Pick a bet. Don’t ask AI to pick for you.

Assume the bottleneck will move every 24 hours. Budget your attention for that.

Invest in the boring tools early — customer communication, ticketing, analytics. AI-built products still need grown-up plumbing.

Pick platforms where content compounds. Evergreen beats viral.

Own the taste layer. Nobody’s coming to ship for you.

Five days is not enough to know if this project is going to work. But it’s enough to know the shape of what’s possible now that wasn’t possible six months ago.

And the shape is: one person, serious intent, AI leverage, and the discipline to actually ship.

That’s the whole game.


If you’re building something and any of this resonated, I’d love to hear what you’re working on. And if you try any of the tools above — the affiliate links help support this publication, but more importantly, they genuinely helped me this week. That’s the only reason they’re in this post.

P.S. — If you're curious about the broader prompt library I maintain (separate from this specific project — these are my general vibe-coding prompts for shipping fast with AI), it's on Gumroad: https://olikahn.gumroad.com/l/dsjaxd

Full transparency: I didn't use all 75 for this particular 5-day build. They're the same style of prompts — the ones I've refined over months of actually shipping things. If the workflow in this post resonated, they'll feel familiar.

Top comments (0)