DEV Community

Orders Of Magnitudes LLC
Orders Of Magnitudes LLC

Posted on AI-assisted

The Type 1 Civilization Toolkit - 23 performance libraries, 208x KV Cache compression, and a lot more.

Hi Dev.to,

We made what we now call the Type 1 Civilization Toolkit as a way for the bottom 6 billion people on earth to have access to the same level of technology & compute that usually people with resources have. The toolkit has 6 components in total ranging from compute, to physics, to governance, the ones we want to talk about today are mostly compute and a bit of physics. The rest (simulation, protection, & governance) can be read on our website.

We used a principle called Negative Space to produce the NS Suite, 23 libraries, each benchmarked against the current category leader.
-NSSort is 182,000x faster than IPS4o on zero distributions.
-NSFix processes 8.5M FIX messages per second versus QuickFIX's 452K.
-NSComp decompresses 29x faster than zstd on schema-aware structured data.
-NSHash is 11.76x faster than absl on timestamp lookups. Every single product documents where it loses.
Everything has a make function and benchmark files on Github.

NS AI - built from the same principles as NS Suite. NSKVCache compresses the KV cache 208x at 1M context, 168MB instead of 36GB raw FP16 on Qwen2.5-3B. Existing methods evict tokens by attention mass, filler words are attention sinks, so every existing method keeps them. We evict by information content instead. We also store K vectors before RoPE is applied, which eliminates the distance suppression that kills long-context retrieval. We buried a needle in a 9K-token adversarial prompt and it came back correctly.
-NSAttend is 28.7x faster at seq_len 8192.
-NSInfer cuts 62% of bytes loaded at 3x MLP throughput.
-NSRun is our inference engine, an ik_llama fork with the full NS AI stack integrated. Clone it on our GitHub. CUDA support is in progress - CPU-only for now, it's slower on cloud hardware than a local machine.

Finally, there's the physics. We derived all 20 Standard Model parameters from a single pressure equation. 86 theorems, zero free parameters. We genuinely don't know if we're right. We think the math checks out. We would love it if physicists go through it and tell us if we found something useful.

As this is a first release, this toolkit will still be worked on in the future. Your feedback would be greatly appreciated, we are always trying to improve. Please note that we ran most of these tests on a single laptop without a GPU as part of a constraint - we wanted anyone on earth to be able to work on any idea they had and not let funding and compute stand in the way. Your benchmark numbers might vary. Please tell us what you think, thank you.

All numbers are on our website https://ofmagnitude.com/

Github:
https://github.com/OrdersOfMagnitudeLLC/type1-toolkit/

Top comments (0)