🚀 GQLSA v1.0.0 — Officially Released!

Fardin Sabid — Thu, 10 Sep 2026 21:57:10 +0000

Grouped-Query Latent Sparse Attention

A hardware-native attention mechanism built on one principle:

"All tokens don't need compute. Compute only where it matters."

━━━━━━━━━━━━━━━━━━

📊 Performance:

⚡ 3.8× faster than Multi-Head Attention
💾 2.2× less memory at T=4096
📦 16× smaller KV cache (2 KB vs 32 KB)
🎯 Quality on par with dense attention
🔒 Verified causal correctness — 11/11 tests passed

━━━━━━━━━━━━━━━━━━

🔬 The Three Techniques:

1️⃣ Latent Compression
→ Reduces KV from 4096 to 512 dims

2️⃣ Grouped-Query Sharing
→ 4 KV groups across 32 query heads

3️⃣ Block-Sparse Selection
→ 192 tokens per query instead of all T

━━━━━━━━━━━━━━━━━━

💡 Key Innovation:

Unlike previous sparse attention methods that use slow Python loops, GQLSA formulates everything as a single batched matrix multiplication — fully utilizing GPU tensor cores.

This is why theoretical O(T) complexity translates to real 3.8× speedup.

━━━━━━━━━━━━━━━━━━

📜 License: CC BY-NC-SA 4.0

✅ Academic research
✅ Education
✅ Personal use
❌ Commercial — requires permission

━━━━━━━━━━━━━━━━━━
📄 Research Paper: https://doi.org/10.5281/zenodo.22658037

💻 GitHub: https://github.com/fardinsabid/gqlsa

🏷️ Release v1.0.0: https://github.com/fardinsabid/gqlsa/releases/tag/v1.0.0

🎲 Aleam — A True Random Number Generator built for AI.

Fardin Sabid — Wed, 01 Apr 2026 12:04:37 +0000

Here's the truth:

Python's random is actually pseudo-random.

Aleam delivers real randomness — straight from your system, hashed with BLAKE2s.

No tricks. No fakes. Just like nature intended.

✨ What it can do:

• 15+ statistical distributions

• Works with PyTorch, TensorFlow, JAX, CuPy

• GPU acceleration with CUDA

• 81 tests passing — 100% production ready

📦 Install it:

pip install aleam

🇧🇩 Built in Bangladesh. Open source. For everyone.

🚀 Want true randomness in your project? Start today.

Github:https://github.com/fardinsabid/aleam
PYPI:https://pypi.org/project/aleam/

DEV Community: Fardin Sabid

🚀 GQLSA v1.0.0 — Officially Released!

🎲 Aleam — A True Random Number Generator built for AI.