Evaluation

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Saurav Bhattacharya

Aug 12

Measure the Judge Before You Trust It: Self-Consistency Comes Before Human Agreement

#ai #evaluation #dotnet #testing

6 min read

Sanjeev Kumar

Aug 12

Choosing the Right LLM-as-a-Judge: A Practical Guide with Model Recommendations

#ai #llm #evaluation

7 min read

Saurav Bhattacharya

Aug 12

Your Agent's Context Window Overflowed and It Answered Anyway

#ai #agents #observability #evaluation

4 min read

Sanjeev Kumar

Aug 12

Choosing the Right LLM-as-a-Judge: A Practical Guide with Model Recommendations

#ai #llm #evaluation

7 min read

Adha AK

Aug 4

How EvalPort's Grader System Works: 11 Types for LLM Evaluation

#llm #evaluation #testing #opensource

2 min read

Xinyang Wu

Aug 3

RAG Beyond the Demo: Pipeline, Citations, Evaluation, and When Not to Bother

#rag #llm #embeddings #evaluation

7 min read

Adha AK

Jul 30

OpenEval: Why LLM Evaluation Needs a Standard Format

#llm #evaluation #ai #testing

1 min read

Maya Andersson

Jul 21

Your eval dashboard has 30 metrics. When one "moves," that is usually arithmetic, not a regression.

#statistics #machinelearning #datascience #evaluation

6 min read

Saurav Bhattacharya

Aug 9

Your Golden Dataset Is Rotting: The Eval Oracle Nobody Re-Validates

#ai #agents #evaluation #observability

5 min read

Pneumetron

Jul 15

PoPE: Placebo-Controlled Evaluation Challenges Error-Conditioned Self-Repair in Small Code LLMs

#llms #codegeneration #selfrepair #evaluation

3 min read

Rickesh T N

Aug 7

Your reasoning model isn't dumb. Your parser is throwing away its best answers.

#machinelearning #llm #evaluation #ai

4 min read

shakti tiwari

Aug 5

I Built an Agent Evaluation Harness for Local AI — What Most People Get Wrong

#aiagents #evaluation #localai #testing

13 min read

Muhammed Rasin O M

Jul 10

Half the answer keys in text-to-SQL benchmarks are wrong. So I generated the database from the answer key.

#evaluation #dataagents #benchmarks #syntheticdata

7 min read

Puneet Gupta

Jul 5

Evaluating LLM Apps in Python

#python #ai #llm #evaluation

9 min read

Puneet Gupta

Jul 5

Evaluating LLM Apps in Java

#java #ai #llm #evaluation

10 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.