DEV Community

Ishant Singh
Ishant Singh

Posted on

๐Ÿค– While Everyone Was Talking About AI, I Was Building an Autonomous Game Engine Agent

Hey devs, Ishant here ๐Ÿ‘‹

While everyone else is arguing about which LLM is better, I locked myself in a room and built Cogent โ€” the autonomous AI agent for Godot which can run every LLM people are arguing about.

Think of it as Cursor / Claude Code โ€” but for game engines. ๐ŸŽฎ๐Ÿฆพ


๐ŸŽฒ What is Cogent?

Most โ€œAI pluginsโ€ are just chatbots trapped in a sidebar.

Cogent is different.

Itโ€™s an agent.

It doesnโ€™t just suggest code โ€” it reads your project, plans tasks, executes tool calls, validates its own work, and ships working scenes.

If you tell Cogent:

โ€œCreate a 2D platformer player with a dash mechanic and WASD movement.โ€

โ€ฆit will literally:

  • Read your folder structure ๐Ÿ“‚
  • Plan the implementation
  • Write the scripts
  • Create the .tscn scene
  • Add collision shapes ๐Ÿ—๏ธ
  • Inject Input Map actions into project.godot
  • Auto-validate the code
  • Fix its own parser errors ๐Ÿ’€
  • Reload the scene
  • Verify the editor output before declaring success

You can ask it for menus, level transitions, win states, shaders, refactors, debugging โ€” whatever fits inside the workflow.

It feels less like autocomplete and more like having a senior developer living in your Godot dock who never complains about your task.

And the screenshots below are not mockups or manually staged demos. ๐Ÿ’€

I basically gave Cogent some assets, set it loose inside the editor, and watched it plan tasks, build scenes, validate scripts, wire systems together, and expand the project into a playable platformer by itself.

Later I asked it to add more levels, menus, animations, transitions, and gameplay flow โ€” and it continued iterating on the same project structure instead of hallucinating itself into another dimension.

The backend also watches for looping / fake-success behavior and intervenes when the model starts spiraling into nonsense. Because trust me, watching an agent confidently fail the same thing 14 times changes a person spiritually. ๐Ÿ˜ญ


๐Ÿ”ง Tech & Questionable Life Choices

Cogent currently has:

  • 57 built-in tools
  • 917 indexed Godot docs/classes
  • Compile โ†’ check โ†’ fix loops
  • Scene + editor control
  • Project-wide context awareness
  • 5 AI providers

It can:

  • Refactor scripts
  • Generate shaders
  • Create scenes
  • Connect signals
  • Edit project settings
  • Search docs offline
  • Run Git commands
  • Validate GDScript automatically

โ€ฆand more.

You literally watch the workflow happen live:

read โ†’ plan โ†’ write โ†’ validate โ†’ refresh

That execution loop basically became the entire design philosophy behind Cogent.


๐Ÿง  Providers

Run it on:

  • Gemini (free tier ๐Ÿค‘)
  • Claude
  • xAI Grok
  • OpenAI
  • Or fully offline through LM Studio for FREE (Unless you don't pay your electricity bill to run local LLM ๐Ÿ’€)

So yes:
free-tier users are covered,
GPU hoarders are happy,
and Unity refugees are welcome. ๐Ÿ˜ญ


๐Ÿ’€ Why tho?

Because game development still has a massive tooling gap.

Web dev has Cursor.
Terminal workflows have Claude Code.

Meanwhile game dev is still:

build โ†’ break โ†’ fix โ†’ repeat โ†’ Alt+F4

Unity AI is credit-gated and corporate.

Unreal plugins areโ€ฆ an experience. ๐Ÿ’€

And Godot โ€” the GOAT engine โ€” still had no real autonomous AI workflow.

I wanted to bridge that gap before my board exams catch up to me.


๐Ÿš€ The Vision

Right now Cogent is a plugin.

Long term?
v1.67?
No noโ€ฆ thatโ€™s for future-you to discover. ๐Ÿ‘€


๐Ÿงช Closed Testing

Cogent is currently in closed testing while I harden the agent loop and reliability systems.

Iโ€™m looking for serious Godot devs who want to help stress-test it before wider release.

๐Ÿ‘‰ cogent.games (coming soon)

And no, itโ€™s not open source yet. ๐Ÿ˜ญ

Iโ€™ve spent months building this thing and Iโ€™m not emotionally prepared to watch someone fork my sleep schedule.


๐Ÿ™Œ Roasts / Tester Applications Welcome

Whatโ€™s the ONE thing in Godot that makes you want to Alt+F4?

  • signal wiring?
  • UI setup?
  • collision debugging?
  • animation trees?
  • project organization?

Tell me below.

If Cogent can automate the painful stuff, we all get to spend more time actually making games.

Now excuse me while I go see if the agent can fix the bugs I created while writing this post.

โ€” Ishant ๐Ÿ–ค

Top comments (0)