DEV Community

Cover image for Building MaxOS #4: I Think Context Is the Hardest Problem in AI
Max Paardekam
Max Paardekam

Posted on

Building MaxOS #4: I Think Context Is the Hardest Problem in AI

When people talk about AI, the conversation is usually about models.

GPT-5.

Claude.

Gemini.

Open-source models.

But while designing MaxOS over the last few days, I've become convinced that the model isn't the hardest part.

Context is.

AI Is Only as Smart as Its Context

Imagine asking your AI assistant:

"Continue working on the authentication system."

A chatbot has no idea what that means.

Which project?

Which repository?

Which authentication system?

What changed since yesterday?

Now imagine your workspace already knows:

which project is open
which files you're editing
your current Git branch
your terminal history
recent conversations
project documentation
your notes

Suddenly, that same prompt becomes incredibly powerful.

The model didn't become smarter.

The context did.

Designing the Context Engine

Instead of treating context as something that's generated for each prompt, I'm designing MaxOS around a dedicated Context Engine.

Its job is to continuously understand what's happening inside the workspace.

Not just when you ask a question.

All the time.

Eventually, it should be aware of things like:

Active projects
Open files
Git repositories
Running terminals
Selected text
Recent conversations
User preferences
Workspace history
Installed plugins

Instead of rebuilding context for every request, the AI should already know what's going on.

Why This Is Hard

The challenge isn't collecting information.

The challenge is deciding what's actually relevant.

Giving an AI everything is usually worse than giving it the right things.

So the Context Engine has to answer questions like:

What's changed recently?
What matters for this task?
What can be ignored?
How much information fits inside the model's context window?

That feels like one of the most interesting engineering problems in the entire project.

Looking Ahead

I've now finished designing:

✅ Vision
✅ High-level Architecture
✅ Monorepo Structure
✅ Core Modules
✅ Event Bus
✅ Context Engine

Next up is something I've been looking forward to since day one:

The Agent Framework.

That's where MaxOS starts becoming more than an AI chat window.

It's where specialized AI workers begin collaborating to complete real tasks.

I'm excited to start designing it.

As always, if you've built context-aware applications or AI tooling, I'd love to hear how you approach context management.

Top comments (0)