DEV Community

Vignesh Reddy
Vignesh Reddy

Posted on

I built Python and Node.js SDKs for my open-source LLM observability gateway — and I need a hosting sponsor

261 developers cloned Ajah in the
first two weeks.

Zero of them should need to understand
Docker to get value from it.

Today I shipped two SDKs that change that.

━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
PYTHON SDK
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━

pip install ajah-sdk

from ajah import AjahClient

client = AjahClient(
gateway_url="http://localhost:8080",
api_key="your-groq-key",
feature_name="my-app",
)

response = client.chat(
model="llama-3.3-70b-versatile",
messages=[{"role": "user",
"content": "Hello"}],
)

Every call automatically gets:
→ Cost attribution per feature
→ Hallucination risk scoring
→ PII masking before storage
→ Full trace in the dashboard

Session tracking for multi-turn agents:

with client.session() as session:
r1 = session.chat(
model="llama-3.3-70b-versatile",
messages=[...],
step_name="step-1-planner",
)
r2 = session.chat(
model="llama-3.3-70b-versatile",
messages=[...],
step_name="step-2-researcher",
)
print(session.dashboard_url)

━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
NODE.JS SDK (TYPESCRIPT)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━

npm install ajah-sdk

import { AjahClient } from 'ajah-sdk';

const client = new AjahClient({
gatewayUrl: 'http://localhost:8080',
apiKey: 'your-groq-key',
featureName: 'my-app',
userId: 'user-123',
});

const response = await client.chat({
model: 'llama-3.3-70b-versatile',
messages: [{ role: 'user',
content: 'Hello' }],
});

Full TypeScript types included.
Session tracking built in.

━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
THE HONEST ASK
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━

Ajah is self-hosted today.
You run it on your own infrastructure.

The next step is managed cloud hosting —
so developers can use the SDK without
running Docker at all.

I'm looking for a sponsor or infrastructure
partner to make that happen.

If you're a cloud provider, accelerator,
or investor who believes in open-source
AI infrastructure — let's talk.

vigneshreddy181200@gmail.com

→ github.com/VigneshReddy-afk/ajah
→ useajah.com

buildinpublic #llm #opensource

python #nodejs #devtools #aiinfrastructure

Top comments (0)