I Was Wrong About LLMs and Pixel Art: A Discovery

Ai_horizontis — Tue, 07 Jul 2026 19:37:42 +0000

Everyone generating AI pixel art uses diffusion models: Stable Diffusion with LoRAs, Midjourney, Scenario.com, Triko.ai. I did too. And the results were always the same: beautiful individual sprites, but completely broken tilesets. Colors that don't match between tiles. Edges that don't align. Palette drift across the sheet. Hours of manual cleanup.
Then I accidentally discovered something that shouldn't work: large language models generating pixel art via HTML output.
This shouldn't work. LLMs are text models. They don't "see" images. They predict tokens. Asking GPT-4o to draw a 32x32 stone wall pixel-by-pixel should produce garbage.
It doesn't.

An image I genereated is a complete sci-fi industrial tileset. 20+ tiles. Consistent palette. Tileable edges. Themed variations (walls, floors, pipes, control panels, debris, broken glass). Generated in a single shot. By GPT-4o. Via HTML.
I tested the same prompt on Claude Sonnet 4.6 and Gemini Flash. Same quality. Same coherence. Three different model architectures, same result. This isn't a GPT-specific trick , it's a capability of modern LLMs that nobody seems to be using.
The Problem with Diffusion for Pixel Art
Diffusion models are trained on natural images. Even with pixel art LoRAs, they:

Don't respect grid alignment (pixels blur, anti-aliasing creeps in)
Don't maintain palette consistency across multiple tiles in a sheet
Can't do tileable edges: each tile is generated in isolation
Produce "pixel-ish" art, not real pixel art with deliberate pixel placement Scenario.com and Triko.ai solve this with custom-trained diffusion models and fine-tuned LoRAs. They charge $20-30/month. The results are good. But they require training data, GPU infrastructure, and a team of ML engineers. What LLMs Do Differently When you ask an LLM to generate pixel art via HTML, something interesting happens:
The LLM understands structure semantically.It knows what a "wall corner" looks like conceptually. It knows what "tileable" means. It knows what "palette consistency" means. Diffusion models don't, they only know pixel patterns.
The LLM plans the whole tileset. When you ask for 20 themed tiles, it generates them as a coherent set, not 20 independent sprites. The palette is shared. The style is shared. The edges align.
HTML tables/divs enforce pixel-perfect output. Each cell is exactly 1 pixel. No anti-aliasing. No blur. Real pixel art.
The LLM follows constraints. "Use 8 colors max", "32x32 tiles", "sci-fi industrial theme" are all respected. Diffusion models struggle with hard constraints. The Prompt (Yes, I'm Sharing It) This isn't a secret sauce, it’s just structured prompt engineering. Here's the exact prompt I used: I need to obtain a PNG containing the tileset for creating the rooms and everything. Tile size: 32x32 pixels.

Step 1: Search the web for how to make tilesets. Step 2: Generate the HTML code that produces a large PNG to import into Godot with all the tiles, each 32x32, organized thematically.

Here are the tiles you must create, no exceptions, maximum attention. Maintaining the same style. Sci-fi / industrial / laboratory theme. Generate the HTML code to produce them:

Transition Pieces (for autotiling)
- 90° internal corners (concave)
- Wall terminations (cap pieces)
- T-junctions
Depth and variety tiles (backgrounds)
- Ventilation duct block
- Exposed wiring block
- Control panel / terminal block
Gameplay mechanic tiles
- Booster block (with inclined thruster)
- Kinetic battery housing
- Partially open bulkhead
- Plasma barrel support frame
Decorative elements
- Industrial debris block
- Broken glass variant
Wear variants (texture aging)
- Heavy rust wall variant

Maintain the same style and palette throughout.

Why This Matters

If you an indie developer:

You can generate complete tilesets in 2 minutes instead of drawing them for 8 hours
Cost is $0 with free-tier API access (GPT-4o, Claude, Gemini all have free tiers)
Quality is professional : I've shown these to pixel artists and they couldn't tell it was AI-generated
Tileability is native : edges align perfectly because the LLM plans the whole sheet

If you're an AI researcher:

This is a capability of LLMs that's underexplored. The image generation community is fixated on diffusion. LLMs as pixel art generators is a different paradigm.
It works across model families. GPT-4o, Claude, Gemini, GLM-4.6 — all produce similar quality. This suggests it's an emergent capability of large language models, not a quirk of one model.
The constraint-following is the key. Hard constraints (palette, grid, tile size) are where LLMs beat diffusion.

Try It Yourself

Open ChatGPT, Claude, or Gemini (any modern LLM with web access)
Paste the prompt above
Replace the theme with whatever you need (fantasy dungeon, cyberpunk city, medieval village)
Get the HTML output
Render it in a browser and screenshot, or use html2canvas to export as PNG
Import into Godot/Unity/GameMaker as a tileset

Total time: 5 minutes. Total cost: $0.

Open Questions

I don't have all the answers. Some things I'm still not completely sure about:

Animation frames: can LLMs generate consistent sprite sheets with walk/idle/attack cycles? No
Larger tile sizes: does this work at 64x64? 128x128? Yes
Style transfer: can you give an LLM a reference image and ask it to match the style? Yes
Character sprites: does this work for characters, or only environmental tiles? It works better for enviroment

If you experiment, share your results. I'm curious what the community finds.

The Bigger Picture

We've been so focused on diffusion models for AI art that we've missed what LLMs can do. They're not just text generators. They're structured output generators. And pixel art is, fundamentally, structured output: a grid of colored cells with semantic meaning.

Maybe the future of AI pixel art isn't better diffusion models. Maybe it's better prompts.

I'm sharing this openly because I think the indie game dev community deserves free, high-quality asset generation. If you found this useful, follow me on https://x.com/Ai_horizontis for more AI experiments. I'll be posting more discoveries as I explore them.

DEV Community: Ai_horizontis

I Was Wrong About LLMs and Pixel Art: A Discovery

Why This Matters

Try It Yourself

Open Questions

The Bigger Picture