Evals - DEV Community

Skip to content

DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Konstantin Gredeskoul

Nov 5

Home-made Evals Just Taste Better

#evals #ai #ruby #opensource

8 min read

deavgprime

Nov 4

Did the model fail, or did the environment?

#ai #evals #testing #devops

9 min read

deavgprime

Nov 3

When a higher eval score means worse work

#ai #evals #agents #testing

7 min read

deavgprime

Nov 2

Passing once is not the same as being reliable

#ai #evals #python #testing

7 min read

deavgprime

Nov 1

Resuming an eval without changing the experiment

#ai #evals #python #testing

6 min read

deavgprime

Nov 1

Before scoring a model, test the evaluator

#ai #evals #scoring #kubernetes

6 min read

Nov 1

LLM Evals Start as Thirty Test Cases, Not a Platform

#ai #llm #evals #typescript

4 min read

Oct 29

"⛔ Stop Merging Agents Without a Required Check"

#agents #evals #github #devops

2 min read

Oct 29

"🚫 Your Agent Demo Is Not a Release Gate"

#agents #evals #devops #ci

2 min read

Oct 29

"🧪 RAG Without CI Metrics Is Just a Chatbot"

#rag #evals #llm #python

2 min read

Oct 30

Testing multi-agent crews: forcing split-brain, goal drift, and context drift to happen in CI

#multiagent #testing #evals #coordination

9 min read

Oct 25

Evals before prompts: a small eval harness for an LLM feature

#ai #llm #evals #testing

9 min read

Oct 25

Pick Your LLM With Your Own Prompt: A Side-by-Side Model Comparison Tool

#ai #evals #chatgpt #claude

7 min read

Oct 17

Jev is not as cheap as you think. Unless it is.

#ai #jev #evals #webdev

6 min read

deavgprime

Nov 1

What exactly are AI evals?

#ai #llm #evals #scoring

10 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.