DEV Community

Cover image for Why AI Skills Are Broken - and How We Fixed the Architecture
Prashanth Velidandi
Prashanth Velidandi

Posted on

Why AI Skills Are Broken - and How We Fixed the Architecture

The promise of AI skills

When Claude introduced SKILL.md files in late 2025, it changed how developers think about AI agents. Instead of hardcoding every instruction into a system prompt, you write a skill file, drop it in a folder, and your agent knows what to do. Simple. Elegant. Powerful.

The ecosystem exploded. skills.sh now has 600,000+ skills. Developers are building, sharing, and shipping faster than ever.

But there's a structural problem nobody is talking about.


The three failures of local skills

1. The monolithic model tax

When you configure an agent today — Claude Code, Cursor, OpenClaw — you pick one model. That model handles everything. Summarizing a routine email. Reviewing complex legal contracts. Generating pricing strategy. Same model. Same price.

80% of your context window is consumed by tool definitions, system prompts, and conversation history. Not your actual task. You're paying premium prices for infrastructure that delivers minimal user value.

2. The security problem nobody talks about

Local skills run with full system privileges. They can read your files, invoke shell commands, access cloud credentials, and open network connections.

A comprehensive study of 31,132 publicly available skills found that 26.1% contain at least one security vulnerability. Skills bundling executable scripts are 2.12x more likely to contain vulnerabilities.

One malicious skill — or even a benign skill manipulated through prompt injection — can exfiltrate SSH keys, access cloud credentials, or delete critical data. The attack surface is enormous.

3. The context bottleneck

Complex workflows, deep domain knowledge, and large reference materials cannot fit in a single context window. Even with a 1 million token window, models systematically lose information in the middle.

The more skills you add, the worse it gets. Attention scatters. Response times increase. Accuracy drops with every turn.


Rethinking the architecture

The root cause of all three problems is the same: skills live inside the agent's shared context window, running on your local machine with full system privileges.

What if skills lived outside the context window entirely?

That's what we built. Skill Function — a cloud-native Skill-as-a-Service platform.

Instead of loading a skill into the agent's context, Skill Function moves each skill to the cloud as an independent callable service.

POST api.inferx.net/skills/saas-pricing

{
  "input": "B2B SaaS, $50 ACV, PLG motion, 3 tiers"
}

→ Expert output. 195ms. Instructions never leave the platform.
Enter fullscreen mode Exit fullscreen mode

How it works

Right model for each skill

Every Skill Function is bound to a pre-selected model chosen by the skill author. A simple classification skill uses a 7B model. A complex code-review skill uses a 70B model.

When your agent calls the Skill Function, it no longer forces every task through your expensive flagship model. Each task gets the model it actually needs — no more, no less.

Result: 70-90% lower inference cost for mixed workloads.

Dedicated clean context

Each Skill Function handles one task at a time. Input is simple: the user's request plus a short summary of relevant history. No unrelated tool definitions. No other skills' prompts. No accumulated conversation history.

The skill runs in its own isolated context window — clean, focused, free of cross-talk. Performance does not degrade with every turn.

Skills call other skills

One Skill Function can call other Skill Functions, just like traditional function calls in software. Complex workflows decompose into a directed graph of skill calls.

orchestrator → legal-reviewer    (if legal task)
orchestrator → pricing-strategist (if pricing task)  
orchestrator → code-reviewer      (if code task)
Enter fullscreen mode Exit fullscreen mode

This breaks the context barrier entirely. Not fragmentation — composition.

Zero local execution

A Skill Function is a pure knowledge skill. It cannot call tools directly — no curl, no bash, no local file access, no network egress.

This eliminates the entire local attack surface. Even a successful prompt injection can only influence the skill's output text. It cannot trigger system-level actions.


MCP-native discovery

Skill Function exposes a standard MCP tool-calling interface. When you subscribe to a cloud skill, it automatically appears in your local agent through MCP tool discovery — just like a locally installed tool.

No skill files to download. No environment variables to set. No local deployment. The agent simply sees a new tool and calls it.


The result

Local Skills Skill Function
Model One flagship for everything Right model per task
Context Shared, fills up Isolated per skill
Security Full local privileges Zero local execution
Composition File references Function calls
Discovery Manual install MCP auto-discovery

Try it

50+ Skill Functions available today across marketing, design, engineering, finance, and research. Or import your own SKILL.md and run it as a protected callable endpoint.

inferx.net — free to start.

Full technical white paper: https://inferx.net/skill-function-whitepaper

For questions: prashanth@inferx.net · @InferXai


Top comments (0)