DEV Community

#evaluation

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
PO Matching Looked Like It Halved Unsafe Invoice Approvals Until I Checked Why

PO Matching Looked Like It Halved Unsafe Invoice Approvals Until I Checked Why

Comments
5 min read
I built an oracle to prove my benchmark needed full document coverage. I only tested it from one end.

I built an oracle to prove my benchmark needed full document coverage. I only tested it from one end.

Comments
5 min read
Don't just say "ignore it"

Don't just say "ignore it"

Comments
7 min read
AI Agent Evaluation: How the LFORLA JS 3D Builder Leaderboard Actually Scores Models

AI Agent Evaluation: How the LFORLA JS 3D Builder Leaderboard Actually Scores Models

Comments
4 min read
We Reviewed an AI Startup’s Website with Preveo. Here’s What Its Founder Said.

We Reviewed an AI Startup’s Website with Preveo. Here’s What Its Founder Said.

4
Comments
6 min read
An 8-Point nDCG Bump That Costs Two Minutes Is Not Free

An 8-Point nDCG Bump That Costs Two Minutes Is Not Free

Comments
4 min read
What gives an accidental paste away

What gives an accidental paste away

Comments
7 min read
Can You Tell an Eval from a Review?

Can You Tell an Eval from a Review?

Comments 1
21 min read
LLM Evaluation Explained: How a Benchmark Produces Comparable Numbers

LLM Evaluation Explained: How a Benchmark Produces Comparable Numbers

Comments
3 min read
How LLM Evaluation Actually Works: Inside a Benchmark That Produces Comparable Numbers

How LLM Evaluation Actually Works: Inside a Benchmark That Produces Comparable Numbers

Comments
4 min read
FrontierAgent Runs Its Terminal Agent on the Same Engine as Its Benchmarks

FrontierAgent Runs Its Terminal Agent on the Same Engine as Its Benchmarks

Comments
4 min read
LLM Evaluation: How a Benchmark Turns Raw Answers Into Comparable Numbers

LLM Evaluation: How a Benchmark Turns Raw Answers Into Comparable Numbers

Comments
4 min read
LLM-as-Judge Is Not a Score. It Is a Reasoning Contract.

LLM-as-Judge Is Not a Score. It Is a Reasoning Contract.

Comments
5 min read
Sorry, That Was For Another Chat

Sorry, That Was For Another Chat

Comments
8 min read
Jev vs Local Models: Where Japanese Intent Routing Stands After 1,000 Utterances

Jev vs Local Models: Where Japanese Intent Routing Stands After 1,000 Utterances

Comments
12 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.