DEV Community

Cover image for How I caught a hardcoded API key that a Senior Expert missed (using Multi-LLM Consensus)
NEXADiag Nexa
NEXADiag Nexa

Posted on

How I caught a hardcoded API key that a Senior Expert missed (using Multi-LLM Consensus)

Last week, I decided to run a "Truth Test" on my latest project, Propulse.

I invited a Senior Infrastructure Expert to perform a manual security audit. He spent over an hour digging through the code. He did an amazing job, finding 27 vulnerabilities, including 4 critical ones related to Authentication and Session Storage.

Then, I ran the same codebase through my consensus engine, NexaVerify.

The result? It took 12 seconds.

The Human vs. Machine Showdown

Metric Human Expert NexaVerify (8-AI Consensus)
Time Spent ~60 minutes 12 seconds
Issues Found 27 91 (validated by consensus)
Silent Killers Missed 1 (Hardcoded Cloudinary API Key)

The "Invisible" Leak

The most striking discovery wasn't in the logic files (.tsx or .ts). It was buried in a documentation file: HANOUTI-GUIDE.html at line 662.

NexaVerify flagged a Cloudinary API Secret exposed in plain text inside a guide. Because humans (and most standard linters) often ignore the /docs or static .html folders during a rush, this leak had been sitting there for weeks.

Why Consensus Wins

Why did the AI find it when the human missed it? It’s not because the AI is "smarter." It's because the AI doesn't get tired and my architecture forces Consensus.

In this run, Gemini, Groq, and Cerebras acted as a jury. When multiple models flag a pattern as a security risk, the signal overrides the noise.

I also identified 10 conflict zones where the models disagreed. This is where I saved the most time: instead of re-reading 12,000 lines, I only focused on the areas where the AI jury was fighting.

Engineering > Vibe Coding

We are moving away from the era of "asking an AI if the code is good." That's probabilistic gambling.

The future is Multi-stage validation:

  1. Deterministic Triage (Static scans)
  2. Multi-LLM Consensus (Semantic reasoning)
  3. Runtime Reality (Sandbox execution)

Conclusion

The machine didn't replace the expert; it prepared the ground for him. By automating the "obvious" and the "hidden" patterns, NexaVerify allowed me to spend my mental energy on architecture, not on hunting for hardcoded strings.

How many secrets are sleeping in your /docs folder right now?


I'm Redha, Software Architect at NEXADiag. Building local-first tools for engineers who value determinism.
Test NexaVerify Beta here

Top comments (0)