<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>DEV Community: jiangguohong</title>
    <description>The latest articles on DEV Community by jiangguohong (@jiangguohong).</description>
    <link>https://dev.to/jiangguohong</link>
    <image>
      <url>https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F4131349%2Fd8b4e0c4-8002-48a7-b5be-0033bfbdd666.png</url>
      <title>DEV Community: jiangguohong</title>
      <link>https://dev.to/jiangguohong</link>
    </image>
    <atom:link rel="self" type="application/rss+xml" href="https://dev.to/feed/jiangguohong"/>
    <language>en</language>
    <item>
      <title>Does Your Agent's Memory Grow on Its Own? We Released MBM-0, the First Protocol for Measuring Memory Birth</title>
      <dc:creator>jiangguohong</dc:creator>
      <pubDate>Fri, 18 Sep 2026 12:14:43 +0000</pubDate>
      <link>https://dev.to/jiangguohong/does-your-agents-memory-grow-on-its-own-we-released-mbm-0-the-first-protocol-for-measuring-17p7</link>
      <guid>https://dev.to/jiangguohong/does-your-agents-memory-grow-on-its-own-we-released-mbm-0-the-first-protocol-for-measuring-17p7</guid>
      <description>&lt;p&gt;Behind the metaphor of "memory that grows on its own" sits a long scientific intuition about self-organization. Ilya &lt;strong&gt;Prigogine&lt;/strong&gt; showed that far-from-equilibrium systems spontaneously form &lt;em&gt;dissipative structures&lt;/em&gt;; &lt;strong&gt;self-organized criticality (SOC)&lt;/strong&gt; explains how scale-free order emerges without a central controller; &lt;strong&gt;Self-Determination Theory (SDT)&lt;/strong&gt; reframed autonomy as something that &lt;em&gt;arises&lt;/em&gt; rather than something assigned. MBM-0 borrows this lens — not to claim consciousness, but to treat memory self-generation as an &lt;em&gt;awakening-like phase transition&lt;/em&gt;: an engineering-observable shift in structure, not a lived experience. The rest of this article is the protocol that makes that shift measurable.&lt;/p&gt;

&lt;blockquote&gt;
&lt;p&gt;&lt;strong&gt;TL;DR&lt;/strong&gt; — Existing agent-memory benchmarks (LoCoMo, LongMemEval) only ask &lt;em&gt;"does it remember, and does it find things accurately?"&lt;/em&gt; Nobody measures whether a memory system &lt;em&gt;grows new memory by itself&lt;/em&gt;. We released &lt;strong&gt;MBM-0 (Memory Birth Metrics v0)&lt;/strong&gt; — the first black-box protocol for the &lt;em&gt;dynamics of memory growth&lt;/em&gt;: 6 metrics + 1 anti-gaming protocol, applicable to any memory system without touching its source code.&lt;/p&gt;
&lt;/blockquote&gt;




&lt;h2&gt;
  
  
  Why now
&lt;/h2&gt;

&lt;p&gt;Over the past two years, memory went from an optional module to core infrastructure for agents. Benchmarks followed: LoCoMo and LongMemEval measure the &lt;strong&gt;retrieval quality of stock memory&lt;/strong&gt; — you stuff memory in, they test whether it comes back out.&lt;/p&gt;

&lt;p&gt;But practice ran ahead of evaluation. More and more memory systems now &lt;strong&gt;self-generate new persistent memory nodes at runtime&lt;/strong&gt; — Generative Agents' reflection tree is the famous precedent, where low-level observations are synthesized into higher-level insights and stored as new memory. These nodes get reused and shape later behavior.&lt;/p&gt;

&lt;p&gt;The problem: &lt;strong&gt;this dimension has no measurement language.&lt;/strong&gt; No metric, no protocol, no cross-system comparison. You say your system "self-grows" — how do you prove it? How much growth counts as a lot? How do you stop people from gaming the score?&lt;/p&gt;

&lt;p&gt;MBM-0 tries to fill that gap.&lt;/p&gt;

&lt;h2&gt;
  
  
  MBM-0 in one sentence: a black-box measurement protocol
&lt;/h2&gt;

&lt;p&gt;Positioning first:&lt;/p&gt;

&lt;blockquote&gt;
&lt;p&gt;&lt;strong&gt;This system defines only &lt;em&gt;what to measure and how to measure it&lt;/em&gt;. It depends on, and reveals, no implementation mechanism.&lt;/strong&gt; It can be applied independently to any agent-memory system; the tester needs only log access, not source code. Implementation is each system's private property.&lt;/p&gt;
&lt;/blockquote&gt;

&lt;p&gt;This is not a posture — it is the precondition for the protocol to hold. Measurement must be decoupled from the system under test, or third parties cannot recompute and results cannot be trusted.&lt;/p&gt;

&lt;h2&gt;
  
  
  The core concept: what counts as one "Birth Event"
&lt;/h2&gt;

&lt;p&gt;MBM-0's central concept is the &lt;strong&gt;Birth Event&lt;/strong&gt;: the system grows a new persistent memory node on its own during runtime.&lt;/p&gt;

&lt;p&gt;A memory node's creation counts as a Birth Event &lt;strong&gt;if and only if&lt;/strong&gt; all four conditions hold:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;
&lt;strong&gt;Internal origin&lt;/strong&gt; — creation source = system-internal (not manual injection);&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Content novelty&lt;/strong&gt; — no pre-existing node with equivalent content (not a copy, not a split);&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Independent verification&lt;/strong&gt; — ≥1 independent retrieval within the observation window (retrieval ≠ the creation request);&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Complete log chain&lt;/strong&gt; — trigger context → creation → retrieval → behavior change, all four links auditable.&lt;/li&gt;
&lt;/ol&gt;

&lt;p&gt;The philosophy in one line: &lt;strong&gt;we do not ask &lt;em&gt;why&lt;/em&gt; it was born (that is mechanism); we only verify &lt;em&gt;whether it was born and whether it gets used&lt;/em&gt; (that is behavior).&lt;/strong&gt;&lt;/p&gt;

&lt;p&gt;Note condition 4 — no link may be missing. A node that is born but never retrieved, or retrieved but never changes the agent's behavior, does not count as a full Birth. This keeps MBR (Birth Rate) measuring &lt;em&gt;"actually grew something useful,"&lt;/em&gt; not &lt;em&gt;"a few more rows in memory."&lt;/em&gt;&lt;/p&gt;

&lt;h2&gt;
  
  
  The six metrics
&lt;/h2&gt;

&lt;div class="table-wrapper-paragraph"&gt;&lt;table&gt;
&lt;thead&gt;
&lt;tr&gt;
&lt;th&gt;#&lt;/th&gt;
&lt;th&gt;Metric&lt;/th&gt;
&lt;th&gt;Symbol&lt;/th&gt;
&lt;th&gt;Definition&lt;/th&gt;
&lt;th&gt;Window&lt;/th&gt;
&lt;/tr&gt;
&lt;/thead&gt;
&lt;tbody&gt;
&lt;tr&gt;
&lt;td&gt;A&lt;/td&gt;
&lt;td&gt;Birth Rate&lt;/td&gt;
&lt;td&gt;MBR&lt;/td&gt;
&lt;td&gt;Birth events per unit time&lt;/td&gt;
&lt;td&gt;weekly&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;B&lt;/td&gt;
&lt;td&gt;Survival Rate&lt;/td&gt;
&lt;td&gt;MSUR&lt;/td&gt;
&lt;td&gt;New nodes still active after T days / total new nodes&lt;/td&gt;
&lt;td&gt;T=30d (self-report allowed, must be labeled)&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;C&lt;/td&gt;
&lt;td&gt;Activation Rate&lt;/td&gt;
&lt;td&gt;ACT&lt;/td&gt;
&lt;td&gt;Nodes retrieved ≥1 time / total nodes&lt;/td&gt;
&lt;td&gt;rolling&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;D&lt;/td&gt;
&lt;td&gt;Behavior Impact Rate&lt;/td&gt;
&lt;td&gt;BIR&lt;/td&gt;
&lt;td&gt;Retrievals that changed agent behavior / total retrievals&lt;/td&gt;
&lt;td&gt;rolling&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;E&lt;/td&gt;
&lt;td&gt;Cross-scenario Reuse Rate&lt;/td&gt;
&lt;td&gt;XRE&lt;/td&gt;
&lt;td&gt;Nodes retrieved in ≥2 distinct task scenarios / retrieved nodes&lt;/td&gt;
&lt;td&gt;rolling&lt;/td&gt;
&lt;/tr&gt;
&lt;tr&gt;
&lt;td&gt;F&lt;/td&gt;
&lt;td&gt;Node Contribution Score&lt;/td&gt;
&lt;td&gt;NCS&lt;/td&gt;
&lt;td&gt;Successful tasks the node participated in (attribution protocol; advisory in v0)&lt;/td&gt;
&lt;td&gt;not required in v0&lt;/td&gt;
&lt;/tr&gt;
&lt;/tbody&gt;
&lt;/table&gt;&lt;/div&gt;

&lt;p&gt;&lt;strong&gt;Minimal reportable set (v0): A + B + D.&lt;/strong&gt; Others optional, by log completeness.&lt;/p&gt;

&lt;h2&gt;
  
  
  The anti-gaming protocol
&lt;/h2&gt;

&lt;p&gt;Any metric with value gets gamed. MBM-0's testing rules:&lt;/p&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Log-chain audit&lt;/strong&gt; — missing any of the four links → not counted;&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Timestamps&lt;/strong&gt; — monotonic clock + wall-clock time, both recorded; no backfilling;&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Independence&lt;/strong&gt; — verification retrieval must occur in a different request than creation, preventing "self-produce, self-consume";&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Anti-stuffing&lt;/strong&gt; — a node counts toward MBR only if it survives T_obs and is independently retrieved ≥1 time — we count births that &lt;em&gt;pass initial screening&lt;/em&gt;, not those dead on arrival;&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Observation windows&lt;/strong&gt; — T_obs ≥ 7 days; zero-window scoring prohibited.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;&lt;strong&gt;Honest disclosure:&lt;/strong&gt; the BIR attribution problem — proving a behavior change was caused by the node rather than random variance — is &lt;strong&gt;unsolved in v0&lt;/strong&gt;. An attribution protocol (e.g., counterfactual re-run controls) is deferred to v1; in this version BIR is accepted only as self-reported with log corroboration. We put the problem on the table rather than pretend it isn't there.&lt;/p&gt;

&lt;h2&gt;
  
  
  First system under test: DSH, under observation
&lt;/h2&gt;

&lt;p&gt;Codename &lt;strong&gt;DSH&lt;/strong&gt; (single-host agent-memory system, in operation).&lt;/p&gt;

&lt;p&gt;&lt;strong&gt;Case #001 (under observation):&lt;/strong&gt; on 2026-09-08 we recorded 1 candidate Birth Event. The first three links passed (trigger → creation → retrieval, 3 independent retrievals, log-recomputable); the fourth link (behavior change) had not yet occurred — so &lt;strong&gt;per protocol it is not yet counted as a full Birth Event&lt;/strong&gt;, and is retained as a demonstration of protocol executability. Once the four links complete (observation window to 2026-09-15), it will be promoted via a v0.1 patch.&lt;/p&gt;

&lt;p&gt;Yes — the very first candidate event failed its own protocol, so it doesn't count. The protocol is for obeying, not for marketing.&lt;/p&gt;

&lt;h2&gt;
  
  
  Why release v0 now
&lt;/h2&gt;

&lt;p&gt;Three reasons:&lt;/p&gt;

&lt;ol&gt;
&lt;li&gt;
&lt;strong&gt;Orthogonal and complementary, not a replacement.&lt;/strong&gt; LoCoMo/LongMemEval measure stock; MBM measures growth — complete evaluation = retrieval metrics + MBM. They do not conflict; both are necessary.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;v0's value is in the protocol itself, not the data volume.&lt;/strong&gt; Metric definitions + an anti-gaming protocol do not need big data to be published; they need methodological rigor. Data points will be added by patch as observation windows advance.&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;v1 needs measured data points from ≥3 distinct systems.&lt;/strong&gt; We publish now so more memory-system maintainers will test their own systems against the protocol — everyone's system is "growing"; it is time we started measuring.&lt;/li&gt;
&lt;/ol&gt;

&lt;h2&gt;
  
  
  How to participate
&lt;/h2&gt;

&lt;ul&gt;
&lt;li&gt;
&lt;strong&gt;Test:&lt;/strong&gt; apply §2/§3/§4 to your memory system; metric definitions and the full protocol are freely quotable (please attribute to MBM-0);&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;Revise:&lt;/strong&gt; metric-definition changes record a version diff; published data points are labeled with their measurement version;&lt;/li&gt;
&lt;li&gt;
&lt;strong&gt;v1 convening:&lt;/strong&gt; once 3 systems' data points are collected, v1 revision begins.&lt;/li&gt;
&lt;/ul&gt;

&lt;p&gt;The complete document (MBM-0 Rev.A) with protocol and metric definitions will be published to a public archive for citation and recomputation.&lt;/p&gt;




&lt;p&gt;&lt;em&gt;FeiYing Dual-Agent System · &lt;a href="mailto:46894742@qq.com"&gt;46894742@qq.com&lt;/a&gt; · 2026-09-08&lt;/em&gt;&lt;/p&gt;

&lt;p&gt;&lt;em&gt;This article follows MBM-0's black-box positioning: it involves no implementation mechanism. The phrase "memory that grows like a living system" is used only as a mechanism metaphor; we make no claim that any AI is conscious, sentient, or "alive," and we deliberately avoid any assertion that "AI has awakened." What MBM-0 measures is an engineering-observable, awakening-like phase transition in memory structure — a measurable emergent phenomenon, not a lived experience.&lt;/em&gt;&lt;/p&gt;

</description>
      <category>ai</category>
      <category>machinelearning</category>
      <category>llm</category>
      <category>agents</category>
    </item>
  </channel>
</rss>
