Evaluation - DEV Community

Skip to content

DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Sep 4

How to Evaluate AI Agents

#ai #agentskills #agents #evaluation

7 min read

Ama Senevirathne

Sep 5

JuryTrace: make agent-judge failures inspectable

#ai #llm #evaluation #python

4 min read

Erik Hill

Aug 31

My board never scored an outage as a regression. My evidence couldn't prove it.

#evaluation #testing #llm #opensource

5 min read

Aug 30

We spent two days bisecting a prompt change. The regression was noise.

#mlops #regression #evaluation #agents

1 min read

Aug 25

Production-Ready Multi-Turn Evaluation

#multiturn #evaluation #python #docker

7 min read

Quinn Li

Aug 17

A Free Server Is Enough to Test a New Model Before You Trust It

#ai #python #evaluation #agents

3 min read

The Engineering Manager’s Desk

Aug 15

Writing the code is no longer the bottleneck

#engineeringculture #evaluation #ai #techdebt

3 min read

The AI Downside

Aug 15

Why AI Benchmarks Mean Less Than You Think

#benchmarks #llms #evaluation #hype

6 min read

Saurav Bhattacharya

Aug 19

One Quality Score Is a Lie: Split Your RAG Judge Into Retrieval, Groundedness, and Relevance

#ai #evaluation #dotnet #testing

5 min read

Guatu

Aug 14

We Almost Deployed a Temporal Knowledge Graph. The Eval Said No.

#aiagents #knowledgegraph #evaluation #rag

7 min read

Aug 12

Choosing the Right LLM-as-a-Judge: A Practical Guide with Model Recommendations

#ai #llm #evaluation

7 min read

Adha AK

Aug 4

How EvalPort's Grader System Works: 11 Types for LLM Evaluation

#llm #evaluation #testing #opensource

2 min read

Saurav Bhattacharya

Aug 12

Measure the Judge Before You Trust It: Self-Consistency Comes Before Human Agreement

#ai #evaluation #dotnet #testing

6 min read

Xinyang Wu

Aug 3

RAG Beyond the Demo: Pipeline, Citations, Evaluation, and When Not to Bother

#rag #llm #embeddings #evaluation

7 min read

Adha AK

Jul 30

OpenEval: Why LLM Evaluation Needs a Standard Format

#llm #evaluation #ai #testing

1 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.