DEV Community

Cover image for The Second Half of AI: Memory Engines Matter as Much as Large Models
Michael Deng
Michael Deng

Posted on

The Second Half of AI: Memory Engines Matter as Much as Large Models

The second half of AI: dual-wheel drive


Everyone Talks About LLMs — But AI Is Not Just LLMs

There's a funny phenomenon in the AI world of 2026: when people talk about AI, they're actually talking about large language models. And when they talk about large language models, they're actually talking about OpenAI, Kimi, DeepSeek — as if the history of AI were nothing more than the product release notes of a handful of companies.

Frankly, that framing is far too narrow.

AI is not equal to LLMs, and certainly not equal to OpenAI, Kimi, or DeepSeek. A large language model is one pillar of the AI edifice — an important one, but neither the only one nor the foundation. Treating "LLM" as a synonym for "AI" is like treating an engine as the whole car, a GPU as the whole computer, or the heart as the whole human body. This cognitive bias is inflicting enormous industry costs: legions of teams try to deliver AI Agents with "model selection + prompt engineering + tool-chain tuning," only to discover that what they deliver —

  • Can't remember who the user is
  • Can't remember where the last conversation left off
  • Can't remember the preferences the user stated
  • Treats every turn like a first meeting

AI is not just LLMs

This is not because the model isn't big enough. GPT-5 wouldn't fix it either. Because this is not a model problem — it's an architecture problem.


The Real Bottleneck of AGI: Not Reasoning, but Long-Term Memory

Let's look at a simple comparison.

Today's strongest reasoning models — Claude, GPT-5, DeepSeek-V3 — already outperform most humans at math competitions, code generation, and logical reasoning. Judged on "reasoning" alone, large models have touched the threshold of AGI.

But have you noticed something odd? These models behave like geniuses in a chat box, yet the moment you place them in a real-world scenario that requires sustained interaction — customer service, personal assistants, tutoring, medical follow-ups — they immediately degrade into a forgetful intern.

Where's the gap?

Long-term memory.

Human intelligence has never been an "island of reasoning." You wake up remembering yesterday's conversation with a colleague, the conclusion of last Friday's meeting, that your child is allergic to peanuts, that one client of yours prefers phone calls after 3 p.m. These memories aren't temporarily "retrieved" from a hard drive each time they're needed — they stay continuously active in the background, automatically building associations, automatically weighting their salience, automatically surfacing when you need them.

Large models have no such layer. Every round of LLM reasoning is the dawn of a brand-new epoch. The context window is its only temporary sticky note — and when the conversation closes, the note is torn up.

So the true path to AGI is not blocked by reasoning — we're already very good at reasoning. It's blocked by how to make AI remember like humans do:

  1. Memory needs structure — not a loose pile of text blocks, but a network with strands, graphs, and associations.
  2. Memory needs evolution — not "write once, never change," but decaying with time, weighted by emotion, promoted by frequency.
  3. Memory needs resonance — not one-sided retrieval by query, but automatic surfacing triggered by context.
  4. Memory needs forgetting — not remembering everything, but forgetting what should be forgotten, letting the important float up.

Of these, the LLM itself can do exactly none.


The Dividing Line of the Second Half: Memory Engines Will Decide Which AI Applications Live or Die

First half vs. second half

I'll make a prediction: before the end of 2026, the entire industry will collectively realize this problem.

Why now? Because the low-hanging fruit of the first half has been picked.

What was the first half? It was the paradigm of "give me a prompt, I'll give you an answer." Chatbots, AI search, code completion, document summarization — none of these scenarios need memory. Every interaction is independent, stateless, and parallelizable. Large models thrive in this paradigm, because their capability boundary happens to cover exactly these scenarios.

But the second half is Agents. The defining feature of an Agent is not stronger reasoning — it's continuity and personalization: it can remember you, accumulate experience, and grow through repeated interaction. After an Agent has worked with you for a week, a month, a year, it should understand you better than on day one — not be dumber than on day one (because the context window is stuffed with stale garbage).

The dividing line of this second half is the memory engine. Whoever builds the memory layer first will see their Agents actually ship. Whoever keeps their Agents at "in-session reasoning" will keep watching their deliveries blow up.

By the end of this year, when the first wave of Agent products propped up by memory engines begins to deliver — while the vast majority of teams are still grinding on prompt tuning — this conclusion will be brutally validated by the market.


NylonME: We're Building the Infrastructure for AI's Second Half

NylonME infrastructure

That is NylonME's positioning.

We don't build large models. We don't build chatbots. We don't build prompt-optimization tools.

What we build is a memory engine — the memory-layer infrastructure for AI Agents.

Specifically, NylonME provides a complete implementation of a human-like memory system:

  • The Six-Silk Memory Model: every memory is woven from six silks — fact, emotion, temporal, relation, confidence, frequency. Not a text block, not a vector — a structured information unit.
  • Contextual Resonance Retrieval: retrieval is not "query -> embedding -> Top-K." It's multi-hop diffusion from seed nodes along the relation graph, ranked by tension decay. Tension is jointly determined by the Ebbinghaus forgetting curve, emotional intensity, and mention frequency — mimicking the brain's associative circuits.
  • Automatic weaving and evolution: LLM reasoning results are automatically decomposed into six-silk fields and written into the memory network. Decay, index updates, and conflict detection run continuously in the background. Memory is growing — not merely being queried.
  • Open source + protocol first: the Rust engine is open-sourced under Apache-2.0, the proto3 interface contract is public, and the evaluation pipeline is fully open.

So far, we have completed:

  • CSR graph engine + self-built HNSW vector index; a single node holds a million nodes in under 300 MB of memory
  • WAL group commit: write TPS from 452 to 12,494 (27.6x)
  • Embedded semantic channel (bge-m3): LoCoMo semantic recall@10 = 60.2% (lexical baseline 47.1%)
  • Relation-silk inverted index: edge weaving dropped from O(N) full-graph scans to index-based candidate lookup

All code is at github.com/nylon-memory/NylonME.


Final Words

In the second half of AI, memory engines matter as much as large models. That statement may sound a bit ahead of the curve today, but I believe it will be common consensus by year-end.

AGI is not a bigger LLM. AGI is a system that understands you, remembers you, and happens to recall exactly what you need when you need it. The large model handles "reasoning"; the memory engine handles "remembering." Both wheels must turn together for the car to move.

We chose to start with the memory wheel.

Come take a look: github.com/nylon-memory/NylonME.


This is Part 3 of the NylonME technical blog series. Part 1, "Building a 'Nylon' for AI Agents: Memory System Phase 1 Complete, with Real Benchmarks," and Part 2, "Why Your AI Agent Can't Deliver — The Architecture Was Wrong from Day One," are in the same directory.

Top comments (0)