DEV Community

אייל מוזס
אייל מוזס

Posted on

Herdr is joining Y Combinator. The runtime stays open

YC Validates Products. Production Validates Control Planes.

Herdr is joining Y Combinator.

Good outcome for the team. But the more interesting takeaway for builders is this: the runtime stays open.

That matters because model infrastructure changes fast. Providers change APIs. Teams add agents, tools, and routing logic. Traffic spreads across products faster than governance catches up.

The mistake is treating model access like a direct SDK integration forever.

The Operational Shift Happens Earlier Than Most Teams Expect

Most products start simple:

  • one provider
  • one API key
  • one service making model calls

Then the product ships.

A second model gets added for cost or latency. Someone experiments with agents. Another service starts making calls. Logs live in different places. Keys spread across environments. Nobody can answer which agents are actually in production without manually tracing requests.

That transition happens long before a company thinks of itself as “enterprise.”

Waiting until later usually means retrofitting governance after the traffic graph is already fragmented.

A Control Plane Becomes Infrastructure Fast

If your product talks to models, a gateway layer becomes as normal as auth, logging, or a CDN.

The important part is not replacing your models. It is centralizing the operational layer around them:

  • identity attached to model calls
  • governed requests through one path
  • routing and provider abstraction
  • gateway-verified audit logs
  • a kill switch at the gateway for routed traffic

You keep your providers and your infrastructure. Kimss AI sits in front of the call.

Open Runtimes Make Governance More Important

Open runtimes are good for builders.

You want flexibility to test providers, switch models, and ship quickly without rewriting application code every quarter.

But open infrastructure also increases operational sprawl. More models and more agents mean more places where traffic can escape visibility.

That is why governance has to be lightweight enough to adopt early.

The fastest path is usually the right one:
a one-line gateway swap instead of a rewrite.

The One-Line Change

For OpenAI-compatible SDKs, the integration is just pointing base_url at https://api.kimss.ai.

from openai import OpenAI

client = OpenAI(
    api_key=os.environ["KIMSS_API_KEY"],
    base_url="https://api.kimss.ai"
)
Enter fullscreen mode Exit fullscreen mode

Or with the Kimss SDK:

from kimss import KimssClient

client = KimssClient(api_key=os.environ["KIMSS_API_KEY"])
Enter fullscreen mode Exit fullscreen mode

That attaches governance, identity, routing controls, and gateway logging without changing your model logic.

Shadow Agents Already Exist

Count the agents your teams are running.

Now count the rows in your agent inventory.

The gap between those two numbers is the shadow agent problem.

Kimss AI does not scan networks or endpoints. It inventories agents whose traffic is routed through the gateway. Existing traffic routed through https://api.kimss.ai starts creating inventory rows automatically, including unattributed calls labeled by model.

That means teams can start discovering real production usage without forcing every developer through a migration project first.

Start Before The Surface Area Explodes

The biggest operational advantage is not compliance theater.

It is staying flexible while the product evolves.

When model access runs through one governed layer:

  • provider swaps stop becoming product rewrites
  • logging becomes consistent
  • identity travels with requests
  • kill switches exist before incidents happen
  • teams experiment faster without losing visibility

That is easier to establish at 10k requests than after the architecture hardens around direct provider integrations everywhere.

Start Free

Developer Tier includes 25,000 governed requests per month with no credit card required.

Create a free account, get an API key, point base_url at https://api.kimss.ai, and send your first governed request.

If you ship with models, put a control plane in front of them. Start free.

Top comments (0)