DEV Community

Saeed Jutt
Saeed Jutt

Posted on Originally published at toolify.studio AI-assisted

GTA 6 NPC Technology: How Open-World Crowds Are Actually Simulated

GTA 6 NPC Technology: How Open-World Crowds Are Actually Simulated

Pedestrians and traffic under a mural-covered highway overpass in Vice City in Grand Theft Auto VI

GTA 6's crowds look alive — but the tech behind believable NPCs isn't generative AI. How rule-based systems, animation blending and strict frame budgets produce Leonida's living world, and why that's harder than it sounds.

Toolify Editorial Team

toolify.studio

One moment from GTA 6's Extended Look did more for the game's "this world is alive" reputation than any lighting demo: a crowd reacting to a roadside incident — some filming it, some helping, some just walking past. It sparked the predictable takes about AI revolutionizing games.

Here's the inconvenient technical truth: that behavior is almost certainly not a neural network. It's the product of decades-old techniques — rule-based decision systems, behavior trees, and carefully budgeted simulation — executed at a scale and polish level few studios can match. Understanding how it actually works is more interesting than the hype, and it explains something important about where game AI is really going.

What Games Like GTA 6 Actually Simulate

An open-world crowd isn't one AI. It's a stack of systems running simultaneously, each with its own update rate and cost:

  • Ambient pedestrians — walk paths, avoid collisions, pick idle behaviors such as checking phones, chatting, or sitting
  • Traffic AI — lane following, intersection negotiation, obstacle reaction, pedestrian yielding
  • "Eyewitness" behaviors — scripted reactions triggered by world events such as accidents, gunfire, or unusual player behavior
  • The wanted system — police search patterns, escalation logic, and line-of-sight checks
  • Mission AI — the actual scripted intelligence of characters you interact with

The key engineering insight: these systems run at different frequencies.

A pedestrian deciding whether to check their phone doesn't need to re-evaluate at 30 FPS. It might only need to update once a second, staggered across the crowd.

Path re-planning for traffic might happen a few times per second.

Only a handful of "near camera" agents get expensive per-frame treatment.

This is called level-of-detail for AI, and it's the only reason a beach holding hundreds of individually animated people can fit within a frame budget.

Why Rules Beat Neural Networks (For Now)

Generative AI is the story of the decade, so people assume it's behind everything that looks smart.

For real-time NPC crowds, the case against it is brutally practical.

Determinism

A rule-based NPC that sees a crash runs its "react to crash" logic in a predictable way.

You can test it, debug it, and ship it.

A generative model can produce a brilliant reaction, but it can also produce a bizarre one, and you cannot fully control which result you get.

Cost

Running a language model per pedestrian is off by orders of magnitude.

Consoles dedicate tens of milliseconds per frame to everything. Even heavily optimized small models cost more per inference than an entire frame budget allows when multiplied across hundreds of agents.

Animation Is the Real Disguise

What reads as "intelligent" in GTA 6's crowds is mostly animation and motion-matching quality.

Characters need to do the right thing physically:

  • Step over curbs
  • Catch their balance
  • Turn naturally
  • React with believable body movement
  • Transition smoothly between different animations

The decision layer chooses what happens.

A curated animation system makes it look human.

That's where a huge amount of the visible polish comes from.

This is why Digital Foundry's analysis of the Extended Look kept returning to density and coherence — hundreds of agents whose compositions look alive — rather than any single agent doing something unfathomably clever.

Crowds of NPCs gathered outside The Rusty Anchor bar on the water in Grand Theft Auto VI

Crowds of NPCs gathered outside The Rusty Anchor bar on the water in Grand Theft Auto VI.

The Frame Budget: Where AI Meets Physics Meets Rendering

Every AI decision competes with everything else in the game for the same milliseconds.

Digital Foundry confirmed GTA 6 targets 30 FPS on consoles — a 33.3 ms frame budget — and their verdict was that the workload saturates the hardware so completely that even a PS5 Pro 60 FPS mode is unrealistic.

Roughly speaking, that budget must cover:

  • AI and gameplay simulation
  • Physics
  • Animation
  • Rendering
  • Audio
  • Streaming
  • Input
  • Other engine systems

Note: These shares are illustrative. Rockstar does not publish a detailed frame-time breakdown. The important point is that every subsystem competes for the same limited frame budget.

AI's slice is small, so every optimization matters.

Developers can use:

  • Agent LOD
  • Time-sliced updates
  • Cached decisions
  • Simplified distant simulation
  • Statistical crowd flows
  • Expensive logic only for nearby agents

When you hear that a game's world feels alive, you're really seeing a scheduler working perfectly.

What Rockstar Has Actually Said

Careful attribution matters here.

Rockstar has publicly described GTA VI as its most detailed world, and the trailers showcase ambient life — in-universe social feeds, beach crowds, dynamic events, and more.

Rockstar's engine, RAGE, is its long-running in-house technology and has handled world simulation, streaming, and rendering across previous GTA titles.

But Rockstar has not published technical papers on GTA VI's AI architecture.

Specific claims about new AI subsystems circulating on YouTube, forums, and social media should therefore be treated cautiously.

What's verifiable is the observable output: crowd density, reaction variety, and animation quality visible in officially released footage.

Digital Foundry has analyzed the footage extensively and described it as potentially one of the most impressive real-time rendering showcases they have evaluated.

Agent LOD: How Hundreds of Pedestrians Fit in a Few Milliseconds

If you've ever debugged a crowd system, the first surprise is how little time each agent actually gets.

The solution is tiering.

Think of it as treating NPC simulation the way rendering treats geometry.

A simplified crowd system might look something like this:


text
Tier 1: Near player
↓
Full AI + animation + collision + detailed perception

Tier 2: Medium distance
↓
Simplified AI + reduced update frequency

Tier 3: Far away
↓
Cheap simulation + statistical movement

Tier 4: Extremely distant
↓
Minimal representation or no individual simulation
Enter fullscreen mode Exit fullscreen mode

Top comments (0)