DEV Community

Rahul singh Shekhawat
Rahul singh Shekhawat

Posted on

Keeping 100% of LLM trace data in your VPC (GDPR / HIPAA Compliant Observability)

Most LLM monitoring tools use an API proxy—meaning every raw user prompt and system prompt goes through their servers. For banking, healthcare, and enterprise startups, this is a security blocker.

We solved this by building a two-layer privacy system.

  1. Direct Routing Bypass (enableProxyRedirect: false) Bypasses the SaaS proxy gateway completely. Traffic goes straight from your server to OpenAI/Anthropic.

  2. Local SDK-side PII Scrubbing (enablePiiRedaction: true) Evaluates the prompt in-memory on your VPC and redacts emails, SSNs, credit cards, and API keys before the telemetry log is sent asynchronously.

Code snippet to set it up:

typescript
import { Observyze } from '@observyze/sdk';
const obs = new Observyze({
apiKey: process.env.OBSERVYZE_API_KEY,
enableProxyRedirect: false, // direct model calls
enablePiiRedaction: true, // local VPC sanitization
});
Read the complete architectural overview: https://observyze.com/blog/zero-data-leak-compliance-mode

Top comments (0)