Benchmarking AI for Code Optimization: Which LLM Actually Writes the Most Efficient C/Rust Code?

RISHABH KESHARI — Sun, 11 Oct 2026 19:44:47 +0000

This is a submission for the Kaggle Benchmarking Challenge (https://dev.to)

## What I Benchmarked

As a third-year Computer Science and Data Science student, I frequently work with lower-level system operations where runtime efficiency is everything. While many public leaderboards evaluate LLMs on whether their code simply functions or passes a basic test suite, they rarely measure the structural efficiency, compilation overhead, or algorithmic complexity of the generated output.

For this challenge, I wanted to scratch a specific itch: How well do modern language models optimize low-level tasks like custom memory management, basic OS kernel loops, and heavy data sorting arrays in C and Rust? I created a suite of 15 tasks testing complex pointer arithmetic, memory allocations, and loop unrolling strategies to see which model generates execution-ready code with the lowest CPU overhead.

## Models Tested

I ran my evaluation across a diverse lineup of four models that represent distinct approaches to automated software engineering:

DeepSeek-Coder-V2-Instruct: Chosen for its massive open-source popularity and high specialization in deep contextual code logic.
Claude 3.5 Sonnet: The current industry gold standard for complex reasoning, multi-file software construction, and code architecture.
GPT-4o: Included as the baseline benchmark heavyweight to see how generalized logic handles aggressive compiler-level structural problems.
Gemini 1.5 Pro: Selected due to its massive context window capability, allowing me to feed complex hardware architecture specs directly into the prompt constraints.

## Findings

The results completely changed how I think about utilizing these models for low-level systems programming:

The Semantic vs. Performance Gap: While all four models achieved over a 90% pass rate for syntax and compiling cleanly, their execution performance diverged wildly. On complex C pointer manipulation tasks, DeepSeek-Coder-V2 generated code that executed up to 18% faster than GPT-4o because it successfully avoided redundant stack-to-heap copies.
Rust Safety Overhead: When generating Rust code, Claude 3.5 Sonnet consistently found optimal, zero-cost abstractions that pleased the borrow checker on the first try. Gemini 1.5 Pro, while structurally sound, frequently fell back on using unsafe blocks to force compilation when dealing with complex data ownership nodes.
The Big Surprise: The generalized reasoning model (Claude) slightly edged out the code-specialized model (DeepSeek) in code readability and commenting, but failed to match DeepSeek's micro-optimization flags.

If I were to expand this benchmark next, I would measure the models' ability to successfully optimize code specifically targeted at ARM vs. x86 assembly architectures.

How I Bypassed Server Costs to Build a High-Traffic Web App

RISHABH KESHARI — Sun, 11 Oct 2026 19:42:10 +0000

As a student developer, building an application that needs to handle thousands of concurrent users usually means one thing: a massive, terrifying bill from AWS or Google Cloud.
When I set out to build my latest project—a test series website designed to handle 2,000 to 5,000 concurrent students—I had a budget of exactly $0.
Here is the exact "Indie Hacker Architecture Stack" I used to build and deploy a high-traffic app completely for free:

⚡ 1. The Symmetrical Split (Frontend)

Instead of hosting everything on a single server, I decoupled the layers. I deployed the entire user interface to Vercel / Cloudflare Pages. Because they use global CDNs, thousands of students can load the landing pages, assets, and UI components simultaneously without costing a single cent or touching my backend infrastructure.

🏗️ 2. Distributed Compute (The Backend Engine)

To process quiz answers without crashing, I leveraged the Oracle Cloud Free Tier. They offer an incredibly generous 4 ARM CPUs and 24 GB of RAM for free. By making the architecture completely stateless and using JSON web tokens (JWT) for user sessions, requests can be balanced across instances seamlessly.

🌐 3. Bypassing Network Barriers (Development)

During local testing, my laptop was stuck behind strict campus Wi-Fi and mobile CGNAT firewalls. I used Cloudflare Tunnels (cloudflared). It established a secure outbound bridge from my local machine to the internet, giving me a public HTTPS URL without needing a public IP or touching router port forwarding.

🗄️ 4. High-Speed Database Pooling

A standard database locks up under thousands of rapid simultaneous writes. By pairing the stack with Supabase (PostgreSQL) and leveraging its built-in connection pooler, incoming quiz submissions are safely queued and written without hitting performance ceilings.
The Takeaway: You don't need a massive budget to build production-ready, scalable applications. You just need to leverage modern free-tier ecosystems and smart architectural design.

DEV Community: RISHABH KESHARI

Benchmarking AI for Code Optimization: Which LLM Actually Writes the Most Efficient C/Rust Code?

## What I Benchmarked

## Models Tested

## Findings

How I Bypassed Server Costs to Build a High-Traffic Web App