gauravdagde

Building Preto.ai — LLM cost optimization for engineering teams. Writing about AI infrastructure, LLM proxies, and keeping your OpenAI bill under control.

Pune, India Joined on Apr 20, 2020 https://preto.ai

Education

University of Pune

Work

Founder / CTO at Preto.ai

gauravdagde

Apr 20

Streaming SSE Proxying for LLM APIs: The Hard Parts

#go #llm #backend #ai

5 min read

Want to connect with gauravdagde?

Create an account to connect with gauravdagde. You can also sign in below to proceed if you already have an account.

Create Account

Already have an account? Sign in

gauravdagde

Apr 16

Prompt Hashing for Duplicate Detection: Cutting LLM Waste With SHA-256

#go #llm #ai #backend

4 min read

gauravdagde

Apr 12

LLM Gateway vs LLM Proxy vs LLM Router: What's the Difference?

#llm #ai #backend #go

4 min read

gauravdagde

Apr 5

LLM Semantic Caching: The 95% Hit Rate Myth (and What Production Data Actually Shows)

#llm #ai #redis #backend

7 min read

gauravdagde

Apr 4

We built an LLM proxy that adds 47ms of latency. Here's every millisecond accounted for.

#ai #llm #architecture #backend

8 min read

gauravdagde

Apr 3

We evaluated Go, Rust, and Python for our LLM proxy. Go won - and not for the reason you'd expect.

#ai #webdev #go #rust

6 min read

gauravdagde

Aug 23 '22

How to integrate coroot-pg-agent with prometheus

#postgres #prometheusexporter #corootpgagent #postgresmonitoring

4 min read

DEV Community

gauravdagde

Six Year Club

Five Year Club

Four Year Club

Writing Debut

Three Year Club

Two Year Club

One Year Club

Skills/Languages

Currently learning

Currently hacking on

Available for

Streaming SSE Proxying for LLM APIs: The Hard Parts

Want to connect with gauravdagde?

Prompt Hashing for Duplicate Detection: Cutting LLM Waste With SHA-256

LLM Gateway vs LLM Proxy vs LLM Router: What's the Difference?

LLM Semantic Caching: The 95% Hit Rate Myth (and What Production Data Actually Shows)

We built an LLM proxy that adds 47ms of latency. Here's every millisecond accounted for.

We evaluated Go, Rust, and Python for our LLM proxy. Go won - and not for the reason you'd expect.

How to integrate coroot-pg-agent with prometheus