DEV Community

#evaluation

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
An 8-Point nDCG Bump That Costs Two Minutes Is Not Free

An 8-Point nDCG Bump That Costs Two Minutes Is Not Free

Comments
4 min read
What gives an accidental paste away

What gives an accidental paste away

Comments
7 min read
LLM Evaluation & Benchmarking: Metrics, Frameworks & Production Testing

LLM Evaluation & Benchmarking: Metrics, Frameworks & Production Testing

Comments
14 min read
RAG Evaluation & Monitoring: Metrics, Frameworks & Production Observability

RAG Evaluation & Monitoring: Metrics, Frameworks & Production Observability

Comments
14 min read
RAG Evaluation & Monitoring: Metrics, Frameworks & Production Observability

RAG Evaluation & Monitoring: Metrics, Frameworks & Production Observability

Comments
14 min read
Can You Tell an Eval from a Review?

Can You Tell an Eval from a Review?

Comments 1
21 min read
LLM Evaluation Explained: How a Benchmark Produces Comparable Numbers

LLM Evaluation Explained: How a Benchmark Produces Comparable Numbers

Comments
3 min read
How LLM Evaluation Actually Works: Inside a Benchmark That Produces Comparable Numbers

How LLM Evaluation Actually Works: Inside a Benchmark That Produces Comparable Numbers

Comments
4 min read
AI Agent Evaluation: Grade the Database, Not the Reply

AI Agent Evaluation: Grade the Database, Not the Reply

Comments
6 min read
FrontierAgent Runs Its Terminal Agent on the Same Engine as Its Benchmarks

FrontierAgent Runs Its Terminal Agent on the Same Engine as Its Benchmarks

Comments
4 min read
LLM Evaluation: How a Benchmark Turns Raw Answers Into Comparable Numbers

LLM Evaluation: How a Benchmark Turns Raw Answers Into Comparable Numbers

Comments
4 min read
LLM-as-Judge Is Not a Score. It Is a Reasoning Contract.

LLM-as-Judge Is Not a Score. It Is a Reasoning Contract.

Comments
5 min read
Sorry, That Was For Another Chat

Sorry, That Was For Another Chat

Comments
8 min read
Jev vs Local Models: Where Japanese Intent Routing Stands After 1,000 Utterances

Jev vs Local Models: Where Japanese Intent Routing Stands After 1,000 Utterances

Comments
12 min read
Assessing the Security of a Nondeterministic Encryption Method: Identifying Weaknesses and Improvements

Assessing the Security of a Nondeterministic Encryption Method: Identifying Weaknesses and Improvements

Comments
12 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.