Evaluation - DEV Community

Skip to content

DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Jason Lau

Sep 24

Your Agent Has Observability. It Doesn't Have Evals.

#agents #observability #evaluation #llm

10 min read

RESK

Sep 24

LLM Evaluation: How a Benchmark Produces Comparable Numbers

#llm #evaluation #benchmark #reinforcementlearnin

4 min read

RESK

Sep 22

How LLM Evaluation Actually Works: Inside the Satellite Geo QCM Leaderboard

#llm #evaluation #benchmark #vision

4 min read

Modusensus

Sep 25

Cosine Gating Won't Save You From Sycophancy: A Self-Refutation Observed by Three Judges

#ai #oss #evaluation #llm

5 min read

Sep 19

An LLM reviewer's "block" is a feature, not a verdict

#aicodereview #llm #evaluation #machinelearning

4 min read

Sep 17

My local 7B thinks "kill a Python process" is a violent crime — and my regex beat it

#ai #security #evaluation #llm

4 min read

saaro

Sep 17

RAG Evaluation 2026: The Four Core Metrics and How to Read Them Diagnostically

#rag #ai #evaluation #metrics

4 min read

Sep 17

Using Execution Traces to Evaluate AI Agent Behavior

#ai #opensource #evaluation

5 min read

Sep 15

Cheap LLM code review is fine until it hits an authorization bug

#aicodereview #llm #security #evaluation

2 min read

Debashish Ghosal

Sep 24

7 Agent Eval Mistakes That Cost Me Weeks (And the One-Line Fixes That Ended Them)

#ai #evaluation #llm #programming

5 min read

Sep 24

Ranking Isn't Judging: What the Jev Wave Still Owes Retrieval

#rag #evaluation #ai

4 min read

Cristian Gormaz

Sep 7

El modelo encontró evidencia relevante y aun así falló: por qué “alucinación” se me quedó corta

#ai #testing #llm #evaluation

4 min read

Sep 7

The sleep loop is the tell: agents that pay per action optimize to do nothing

#aiagents #evaluation #llm #benchmarking

2 min read

Sep 7

The model did the reverse-engineering. The validator was the hard part.

#aicoding #agents #llm #evaluation

2 min read

PRANJUL RATHOUR

Sep 6

Judging AI hackathon projects: what to check when every team says 'we used AI'

#hackathonjudging #ai #evaluation #rubric

3 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.