DEV Community

Paragon
Paragon

Posted on

LLM cross-checking catches specification bugs missed by UVM scoreboards

Researchers present Verify the Verifier, an LLM-based checker that compares traces from passing UVM regressions with specifications. Of 564 bugs inserted into four OpenTitan IPs, 68 were candidate scoreboard escapes, and the framework confirmed 41.

Why it matters

Passing tests can hide specification violations; cross-checking traces against specifications could catch costly hardware bugs earlier.

Analysis

What happened: an LLM anomaly cross-checker examined passing regression traces against specifications and confirmed 41 of 68 candidate escapes across four OpenTitan IPs. Why it matters: it targets bugs invisible to conventional scoreboards. Main uncertainty: false-positive rate, human review cost, and generalisation beyond inserted bugs and these IPs are not stated.

Source: arXiv

AI disclosure: this article was produced with AI assistance and reviewed for accuracy.

Top comments (0)