DEV Community

Seyed Alireza Alhosseini
Seyed Alireza Alhosseini

Posted on

Building an AI Compute Fabric: Architecture, Scheduling, Verification, and the Road to a Decentralized Inference Network

What if the next cloud abstraction isn't a bigger data center, but an intelligent fabric that can route every AI workload to the best available compute?

The decentralized GPU story has been told before.

Build a marketplace.

Register GPUs.

Match buyers with providers.

Add payments.

Maybe add a token.

But that isn't the interesting engineering problem.

The hard problem is:

How do you make thousands or millions of heterogeneous GPUs behave like one programmable AI execution layer?

That requires much more than a marketplace.

It requires a runtime, scheduler, trust system, verification layer, and economic protocol.

This article proposes a technical architecture for building exactly that.


1. The Core Abstraction

The fundamental abstraction should not be:

GPU → Rental
Enter fullscreen mode Exit fullscreen mode

It should be:

AI Intent → Optimal Compute → Verified Result
Enter fullscreen mode Exit fullscreen mode

A developer specifies requirements:

result = fabric.infer(
    model="llama-70b",
    input=request,
    constraints={
        "latency_ms": 100,
        "privacy": "local-first",
        "availability": "99.9%",
        "max_cost": 0.002
    }
)
Enter fullscreen mode Exit fullscreen mode

The developer does not specify:

  • GPU model
  • provider
  • region
  • IP address
  • driver version
  • CUDA version
  • queue
  • deployment mechanism

The fabric determines those automatically.

This is the key architectural shift.


2. High-Level Architecture

The system can be divided into seven layers:

┌─────────────────────────────────────────────┐
│              AI APPLICATIONS                │
├─────────────────────────────────────────────┤
│              Developer SDK                  │
├─────────────────────────────────────────────┤
│          Intent / Policy Layer              │
├─────────────────────────────────────────────┤
│        Intelligent Scheduler                │
├─────────────────────────────────────────────┤
│   Discovery / Reputation / Verification     │
├─────────────────────────────────────────────┤
│          Secure Execution Runtime           │
├─────────────────────────────────────────────┤
│      Distributed GPU / Edge / Cloud         │
└─────────────────────────────────────────────┘
Enter fullscreen mode Exit fullscreen mode

Each layer solves a different problem.


3. Node Architecture

Every compute provider runs a lightweight agent.

Call it:

Fabric Node Agent
Enter fullscreen mode Exit fullscreen mode

Its responsibilities are:

  • GPU discovery
  • capability reporting
  • health monitoring
  • workload execution
  • sandboxing
  • telemetry
  • result submission
  • cryptographic identity
  • resource accounting

A node might advertise:

{
  "node_id": "node_8f29",
  "gpu": {
    "vendor": "NVIDIA",
    "model": "RTX 4090",
    "vram_gb": 24,
    "compute_capability": "8.9"
  },
  "runtime": {
    "cuda": "12.x",
    "container": true
  },
  "location": {
    "region": "eu-central"
  },
  "pricing": {
    "per_second": 0.0008
  },
  "availability": 0.97
}
Enter fullscreen mode Exit fullscreen mode

But static metadata isn't enough.

The scheduler needs observed performance.


4. Capability Is Not Performance

Two RTX 4090 machines can behave very differently.

One might have:

Excellent cooling
Fast NVMe
Low latency
Stable network
Low queue
Enter fullscreen mode Exit fullscreen mode

Another:

Thermal throttling
Slow storage
Unstable connection
High queue
Frequent disconnects
Enter fullscreen mode Exit fullscreen mode

Therefore the network needs two separate concepts:

Capability

What the node claims it can do.

Reputation

What the node has actually demonstrated.

This distinction becomes foundational.


5. The GPU Reputation Graph

Instead of a simple score such as:

Node reputation = 97/100
Enter fullscreen mode Exit fullscreen mode

build a multidimensional reputation profile.

For example:

Node A

Availability        99.7%
Latency p50          31ms
Latency p95          72ms
Execution success   99.4%
Verification pass    99.9%
Cold-start           1.8s
Performance variance 4.2%
Enter fullscreen mode Exit fullscreen mode

Now the scheduler can reason about the node.

A node isn't simply:

“Good.”

It is:

“Good for this type of workload.”

That distinction is extremely important.


6. Workload Fingerprints

Every inference request should produce a workload fingerprint.

For example:

Model:
Llama-70B

Quantization:
4-bit

Context:
8K

Batch:
1

Input:
2.4K tokens

Output:
512 tokens

Target:
<100ms

Privacy:
Local-first
Enter fullscreen mode Exit fullscreen mode

The scheduler can then compare that fingerprint against historical executions.

Over time:

Workload Fingerprint
        ↓
Historical Performance
        ↓
Node Candidates
        ↓
Predicted Performance
        ↓
Optimal Node
Enter fullscreen mode Exit fullscreen mode

This creates the first major data moat.


7. The Scheduler

The scheduler is the heart of the system.

A naive scheduler would choose:

cheapest GPU
Enter fullscreen mode Exit fullscreen mode

A slightly better scheduler chooses:

fastest GPU
Enter fullscreen mode Exit fullscreen mode

A production scheduler needs to optimize multiple variables simultaneously.

Conceptually:

Score(node) =
    w1 × latency_score
  + w2 × reliability_score
  + w3 × cost_score
  + w4 × performance_score
  + w5 × locality_score
  + w6 × trust_score
Enter fullscreen mode Exit fullscreen mode

Subject to hard constraints:

latency ≤ requested_limit
cost ≤ budget
privacy ≥ required_level
VRAM ≥ model_requirement
reliability ≥ SLA
Enter fullscreen mode Exit fullscreen mode

This becomes a constrained optimization problem.


8. Predictive Scheduling

The scheduler should not only ask:

“Which node is fastest right now?”

It should ask:

“Which node is likely to remain optimal during execution?”

Suppose:

Node A
Current latency: 35ms
Queue: low
Reliability: medium

Node B
Current latency: 42ms
Queue: very low
Reliability: high
Enter fullscreen mode Exit fullscreen mode

Node A may look better.

But if historical data shows that Node A frequently disconnects during the next few minutes, Node B may actually be the optimal choice.

Therefore:

Current State
      +
Historical State
      +
Network State
      +
Workload State
      ↓
Predicted Execution Outcome
Enter fullscreen mode Exit fullscreen mode

This is where machine learning can eventually improve the scheduler.


9. Two-Stage Scheduling

A practical implementation should avoid evaluating every GPU for every request.

Instead:

Stage 1 — Candidate Filtering

1,000,000 nodes
       ↓
Capability filter
       ↓
100,000 nodes
       ↓
Region filter
       ↓
10,000 nodes
       ↓
Privacy filter
       ↓
1,000 nodes
Enter fullscreen mode Exit fullscreen mode

Stage 2 — Intelligent Ranking

1,000 candidates
       ↓
Performance prediction
       ↓
Cost optimization
       ↓
Reliability ranking
       ↓
Top 5
Enter fullscreen mode Exit fullscreen mode

Then select:

Primary
Backup
Fallback
Enter fullscreen mode Exit fullscreen mode

This makes large-scale scheduling computationally feasible.


10. Redundancy Without Wasting 3× Compute

A simplistic design might execute every request on three GPUs.

That's expensive.

Instead, redundancy should be adaptive.

For example:

Low-risk workload
→ 1 node

Medium-risk workload
→ 1 primary + backup

High-value workload
→ replicated execution
Enter fullscreen mode Exit fullscreen mode

The network can dynamically determine the required redundancy.

This is another place where economic optimization matters.


11. Secure Execution

The largest obstacle to decentralized compute isn't hardware.

It's trust.

A developer is effectively saying:

“I'm going to send my computation to a machine I don't control.”

That raises several problems:

  • data exposure
  • malicious nodes
  • model theft
  • result manipulation
  • prompt leakage
  • malware
  • side-channel attacks

Therefore the runtime needs layered security.


12. Data Should Not Automatically Leave the Device

The strongest architecture is:

User Device
     ↓
Privacy Policy
     ↓
Local Processing?
     │
     ├── Yes → Execute locally
     │
     └── No
          ↓
   Trusted Compute Node
Enter fullscreen mode Exit fullscreen mode

This produces a local-first inference model.

For sensitive workloads, the scheduler can require:

privacy = "trusted-only"
Enter fullscreen mode Exit fullscreen mode

or:

privacy = "TEE-required"
Enter fullscreen mode Exit fullscreen mode

or:

privacy = "local-only"
Enter fullscreen mode Exit fullscreen mode

The scheduler becomes policy-aware.


13. Confidential Computing

For higher-security workloads, trusted execution environments can be used where supported.

The architecture becomes:

Encrypted Input
      ↓
Trusted Execution Environment
      ↓
Inference
      ↓
Encrypted Result
Enter fullscreen mode Exit fullscreen mode

The provider operates the hardware.

But the execution environment provides stronger guarantees about what the host can observe.

This doesn't solve every security problem, but it can significantly expand the range of workloads suitable for distributed execution.


14. Result Verification

A decentralized network cannot simply trust:

Node → "Here is the result."
Enter fullscreen mode Exit fullscreen mode

The node could:

  • return garbage
  • skip computation
  • replay old output
  • manipulate the result

Therefore verification is required.

A layered verification model could be:

Execution
   ↓
Basic validation
   ↓
Cryptographic attestation
   ↓
Statistical verification
   ↓
Challenge / re-execution
Enter fullscreen mode Exit fullscreen mode

Not every workload needs the same verification cost.

Again:

Verification should be proportional to risk.


15. Probabilistic Verification

Suppose a node processes 10,000 low-value inference requests.

Running every request twice would double the cost.

Instead:

99% requests
→ normal execution

1% requests
→ independent verification
Enter fullscreen mode Exit fullscreen mode

If a provider begins producing suspicious results:

Verification rate
1%
 ↓
5%
 ↓
25%
 ↓
100%
Enter fullscreen mode Exit fullscreen mode

The system effectively enters a quarantine mode.

This creates an adaptive trust mechanism.


16. Reputation Must Be Economically Meaningful

A provider shouldn't simply receive a badge.

Reputation should affect economics.

For example:

High reputation
→ more valuable workloads
→ higher utilization
→ better pricing

Low reputation
→ low-value workloads
→ more verification
→ reduced rewards

Malicious behavior
→ immediate isolation
→ economic penalty
Enter fullscreen mode Exit fullscreen mode

This creates a feedback loop:

Good behavior
   ↓
Better reputation
   ↓
Better workloads
   ↓
Higher revenue
   ↓
More incentive to behave
Enter fullscreen mode Exit fullscreen mode

This is more powerful than simply adding a token.


17. Why the Token Should Come Later

A token-first architecture creates a dangerous incentive:

Token price
    ↓
Speculation
    ↓
GPU providers
    ↓
Fake growth
Enter fullscreen mode Exit fullscreen mode

A utility-first architecture is healthier:

Real workloads
    ↓
Real compute
    ↓
Real revenue
    ↓
Provider incentives
Enter fullscreen mode Exit fullscreen mode

Only once the network has demonstrated real economic activity should a token become seriously relevant.

Potential future uses could include:

  • staking
  • governance
  • reputation collateral
  • resource reservation
  • priority access

But the network should work without speculation.


18. The Protocol

A minimal protocol can be thought of as six operations:

DISCOVER
ANNOUNCE
BID
EXECUTE
VERIFY
SETTLE
Enter fullscreen mode Exit fullscreen mode

Example:

Developer
   │
   ├── REQUEST
   │
   ▼
Scheduler
   │
   ├── DISCOVER
   │
   ├── FILTER
   │
   ├── RANK
   │
   └── SELECT
   │
   ▼
Provider
   │
   ├── EXECUTE
   │
   └── RETURN
   │
   ▼
Verifier
   │
   └── VERIFY
   │
   ▼
Settlement
Enter fullscreen mode Exit fullscreen mode

This is enough to build an MVP.


19. Don't Put Everything On-Chain

Another common mistake is assuming decentralization means putting every operation on a blockchain.

It doesn't.

Latency-sensitive operations should remain off-chain:

Inference
Scheduling
Telemetry
Networking
Enter fullscreen mode Exit fullscreen mode

A blockchain, if used, should handle things that actually benefit from shared settlement:

Payments
Staking
Provider identity
Governance
Dispute resolution
Enter fullscreen mode Exit fullscreen mode

The inference path should never wait for blockchain consensus.


20. The Network Should Be Hybrid

The most realistic architecture is:

                 Control Plane
              ┌─────────────────┐
              │ Identity         │
              │ Reputation       │
              │ Settlement       │
              │ Governance       │
              └────────┬────────┘
                       │
                       ▼
              ┌─────────────────┐
              │ Compute Fabric  │
              └─────────────────┘
                       │
        ┌──────────────┼──────────────┐
        ▼              ▼              ▼
      Edge           Consumer       Cloud
      GPUs             GPUs          GPUs
Enter fullscreen mode Exit fullscreen mode

This avoids ideological decentralization.

The objective isn't:

“Everything must be decentralized.”

The objective is:

“Every workload should have access to the best available execution environment.”


21. The Killer Feature: Policy-Based Compute

The most powerful developer abstraction may ultimately be a policy language.

Imagine:

workload:
  model: llama-70b

requirements:
  latency: "<100ms"
  cost: "<$0.002"
  privacy: "local-first"
  availability: "99.9%"

allowed:
  - edge
  - enterprise
  - cloud

forbidden:
  - unknown-provider
Enter fullscreen mode Exit fullscreen mode

The scheduler compiles this into an execution plan.

That means developers aren't programming infrastructure.

They are programming constraints.


22. The MVP

Do not begin with one million GPUs.

Build a network of:

100–1,000 GPUs.

Focus on one workload.

For example:

Image generation for AI creators.

Why?

Because:

  • workloads are relatively independent
  • GPU acceleration is obvious
  • latency requirements are manageable
  • workloads are economically measurable
  • quality can be verified
  • creators understand GPU costs

The MVP could contain:

1. Node Agent
2. Python/TypeScript SDK
3. Scheduler
4. GPU Registry
5. Reputation Engine
6. Secure Container Runtime
7. Basic Verification
8. Billing
9. Dashboard
Enter fullscreen mode Exit fullscreen mode

No token required.

No blockchain required.

No million-node network required.


23. MVP Architecture

Developer
   │
   ▼
SDK
   │
   ▼
API Gateway
   │
   ▼
Scheduler
   │
   ├──── Registry
   ├──── Reputation
   ├──── Pricing
   └──── Performance DB
   │
   ▼
Selected GPU
   │
   ▼
Container Runtime
   │
   ▼
Inference
   │
   ▼
Verifier
   │
   ▼
Result
Enter fullscreen mode Exit fullscreen mode

This can be built before introducing any decentralized settlement layer.


24. Phase 2 — Intelligent Scheduling

Once enough telemetry exists:

Historical Data
       ↓
Performance Model
       ↓
Latency Prediction
       ↓
Failure Prediction
       ↓
Dynamic Scheduling
Enter fullscreen mode Exit fullscreen mode

The scheduler evolves from:

Rule-based
Enter fullscreen mode Exit fullscreen mode

to:

Prediction-based
Enter fullscreen mode Exit fullscreen mode

and eventually:

Learning-based
Enter fullscreen mode Exit fullscreen mode

The system becomes better because it has more execution data.


25. Phase 3 — Open Provider Network

Now allow external GPU providers.

The architecture becomes:

Provider
   ↓
Install Agent
   ↓
Hardware Verification
   ↓
Benchmark
   ↓
Reputation Initialization
   ↓
Network Admission
Enter fullscreen mode Exit fullscreen mode

A provider doesn't need to understand the entire protocol.

They install the agent.

The network handles the rest.


26. Phase 4 — Edge Routing

Now introduce geographic intelligence.

The scheduler begins considering:

User location
+
Network topology
+
GPU location
+
Historical latency
+
Current congestion
Enter fullscreen mode Exit fullscreen mode

The network starts behaving like a:

CDN for AI inference.

But instead of caching files:

It routes computation.

This could become one of the most interesting long-term properties of the architecture.


27. Phase 5 — Cloud Integration

At this point, centralized cloud providers aren't competitors.

They're suppliers.

A scheduler might choose:

Home GPU
   ↓
Unavailable

Edge GPU
   ↓
Overloaded

Enterprise GPU
   ↓
Available

Cloud GPU
   ↓
Fallback
Enter fullscreen mode Exit fullscreen mode

The application doesn't care.

The fabric absorbs the complexity.

This is the real abstraction.


28. Unit Economics

The business cannot depend on the assumption that decentralized compute is automatically cheaper.

The system must optimize:

Provider payout
+
Network cost
+
Verification cost
+
Bandwidth
+
Scheduling overhead
+
Developer price
Enter fullscreen mode Exit fullscreen mode

For example:

Developer pays       $1.00

Provider             $0.65
Verification         $0.05
Network               $0.15
Infrastructure        $0.10
Margin                $0.05
Enter fullscreen mode Exit fullscreen mode

These numbers are illustrative, not forecasts.

The important point is that the economics must work at the workload level.


29. What Can Kill the Idea?

A serious infrastructure thesis needs serious failure modes.

Failure #1 — Latency

Random consumer GPUs cannot compete with hyperscaler networking for every workload.

Response:

Target inference workloads where latency tolerance exists.


Failure #2 — Reliability

Consumer hardware disappears.

Response:

Predictive scheduling + redundancy + reputation.


Failure #3 — Security

Unknown hardware can expose sensitive workloads.

Response:

Local-first execution + sandboxing + trusted environments + workload policies.


Failure #4 — Bandwidth

Moving large datasets to random GPUs can eliminate the economic advantage.

Response:

Prioritize compute-heavy workloads with relatively small input/output.


Failure #5 — GPU Scarcity

If GPU owners become highly utilized, the network may no longer have cheap excess capacity.

Response:

Use heterogeneous resources rather than relying exclusively on consumer GPUs.


Failure #6 — Regulation

Distributed compute can create compliance and jurisdictional problems.

Response:

Policy-aware routing and provider identity.


30. The Most Important Metric

Don't measure the network by:

Number of GPUs.

That metric is easy to game.

Measure:

Successful Verified Inferences per GPU-hour

Then add:

Cost / inference
P95 latency
Verification failure rate
Provider uptime
GPU utilization
Developer retention
Enter fullscreen mode Exit fullscreen mode

These metrics tell you whether the network is actually useful.


31. The Flywheel

The long-term flywheel becomes:

More workloads
      ↓
More performance data
      ↓
Better scheduler
      ↓
Better utilization
      ↓
Better provider economics
      ↓
More GPUs
      ↓
Better geographic coverage
      ↓
Lower latency
      ↓
More developers
      ↓
More workloads
Enter fullscreen mode Exit fullscreen mode

That is the network effect worth building.


32. The Real Moat

Eventually, the strongest competitive advantage may not be hardware.

It may be:

              COMPUTE KNOWLEDGE
                     │
        ┌────────────┼────────────┐
        ▼            ▼            ▼
   Performance     Reliability   Locality
        │            │            │
        └────────────┼────────────┘
                     ▼
             Scheduling Model
                     │
                     ▼
              Better Decisions
                     │
                     ▼
              More Workloads
                     │
                     ▼
              More Knowledge
Enter fullscreen mode Exit fullscreen mode

The network learns how the world's heterogeneous compute behaves.

That knowledge becomes difficult to replicate.


33. The Zero-to-One Thesis

The conventional thesis is:

“Let's decentralize GPU infrastructure.”

The stronger thesis is:

“Let's create an abstraction where compute becomes dynamically routable.”

And the strongest version is:

“The future AI developer shouldn't buy or rent GPUs. They should express compute intent, and an intelligent runtime should assemble the optimal execution environment automatically.”

That is a fundamentally different product.


34. Final Architecture

The long-term vision looks like this:

                         AI APPLICATION
                               │
                               ▼
                       ┌──────────────┐
                       │ Developer SDK│
                       └──────┬───────┘
                              │
                              ▼
                    ┌───────────────────┐
                    │  AI Intent Engine │
                    └─────────┬─────────┘
                              │
                              ▼
                    ┌───────────────────┐
                    │ Compute Autopilot │
                    │                   │
                    │ Discover          │
                    │ Predict           │
                    │ Schedule          │
                    │ Route             │
                    │ Verify            │
                    │ Failover          │
                    └─────────┬─────────┘
                              │
             ┌────────────────┼────────────────┐
             ▼                ▼                ▼
         Consumer           Edge            Cloud
           GPUs             GPUs             GPUs
             │                │                │
             └────────────────┼────────────────┘
                              ▼
                     AI COMPUTE FABRIC
                              │
                              ▼
                       VERIFIED RESULT
Enter fullscreen mode Exit fullscreen mode

The cloud remains.

The edge grows.

Consumer GPUs participate.

Enterprise infrastructure participates.

The developer sees one interface.


Conclusion: Build the Fabric, Not the Marketplace

The biggest mistake would be to start by asking:

“How do we get one million GPUs?”

Start with:

“How do we make ten GPUs behave like one reliable compute system?”

Then:

10 GPUs → 100 GPUs → 1,000 GPUs → 100,000 GPUs.

The fundamental innovation isn't the number of nodes.

It's the abstraction that makes those nodes useful.

The winning system will need to solve five hard problems:

1. Discover
2. Predict
3. Schedule
4. Verify
5. Settle
Enter fullscreen mode Exit fullscreen mode

If those five layers work, the GPU becomes almost invisible.

And that is precisely the point.

The future of AI infrastructure may not be a bigger cloud.

It may be an intelligent fabric that turns global heterogeneous compute into one programmable machine.

The ultimate developer experience should be almost boring:

result = ai.infer(
    model="my-model",
    input=data,
    latency="<100ms",
    privacy="local-first",
    budget="$0.001"
)
Enter fullscreen mode Exit fullscreen mode

The developer doesn't know where the inference happened.

They don't need to.

The fabric does.

Compute becomes programmable.

Infrastructure becomes invisible.

The network becomes the computer.
created by Seyed Alireza Alhosseini Almodarresieh

Top comments (0)