DEV Community

#benchmark

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
One Hung API Call Used to Kill My 1,000-Run Benchmark. Here's the Fix.
debashish_ghosal profile

One Hung API Call Used to Kill My 1,000-Run Benchmark. Here's the Fix.

#ai #llm #programming #benchmark
7
Comments
3 min read
LLM Evaluation: How a Benchmark Produces Comparable Numbers
resk profile
RESK

LLM Evaluation: How a Benchmark Produces Comparable Numbers

#llm #evaluation #benchmark #reinforcementlearnin
Comments
4 min read
Claude Opus 5.5: 40% cheaper, frontier-grade performance
devsignal profile

Claude Opus 5.5: 40% cheaper, frontier-grade performance

#ai #devtools #programming #benchmark
Comments
5 min read
Glasshouse v0.1 Is Out: A Memory Benchmark for AI Systems
woochan profile

Glasshouse v0.1 Is Out: A Memory Benchmark for AI Systems

#ai #memory #benchmark #wontopos
7
Comments 1
2 min read
Onboarding benchmarks from real data across 464 SaaS products: median tour completion is 29%, 1-2 step tours complete at 73%, 9+ step tours at 8%
olli_produktly profile
Olli

Onboarding benchmarks from real data across 464 SaaS products: median tour completion is 29%, 1-2 step tours complete at 73%, 9+ step tours at 8%

#saas #onboarding #product #benchmark
Comments 1
2 min read
How LLM Evaluation Actually Works: Inside the Satellite Geo QCM Leaderboard
resk profile
RESK

How LLM Evaluation Actually Works: Inside the Satellite Geo QCM Leaderboard

#llm #evaluation #benchmark #vision
1
Comments
4 min read
netcup VPS 1000 G12 benchmarked: how fast is it really?
serverkueche profile

netcup VPS 1000 G12 benchmarked: how fast is it really?

#benchmark #vps #selfhosted
Comments
7 min read
A code review benchmark that isn't the vendor ranking itself
tessainsley profile

A code review benchmark that isn't the vendor ranking itself

#codereview #aicode #benchmark #reviewtools
Comments
4 min read
Enterprise Vector Database 2026: Qdrant vs Milvus vs pgvector vs Pinecone
devrudals profile

Enterprise Vector Database 2026: Qdrant vs Milvus vs pgvector vs Pinecone

#ai #devops #benchmark #cloud
Comments
23 min read
You can read Claude Code's whole harness now. That's what every benchmark score throws away
cole_halton_42f71d71b809b profile

You can read Claude Code's whole harness now. That's what every benchmark score throws away

#codingagents #harness #benchmark #eval
Comments
5 min read
TypeSafe’s JEV Model: Is It Really 193x Faster and 444x Cheaper?
arifulislamat profile

TypeSafe’s JEV Model: Is It Really 193x Faster and 444x Cheaper?

#jev #typesafe #ai #benchmark
2
Comments 1
6 min read
JetBrains Ranked AI Agents on Real Kotlin Projects. The Token Column Is the Real Story.
jamilxt profile

JetBrains Ranked AI Agents on Real Kotlin Projects. The Token Column Is the Real Story.

#ai #kotlin #java #benchmark
1
Comments
7 min read
Two "Codex CLI" models on the same benchmark: the harness hides the model
cole_halton_42f71d71b809b profile

Two "Codex CLI" models on the same benchmark: the harness hides the model

#ai #codingagents #benchmark #eval
Comments
2 min read
How Fast Can Neovim Start? Benchmarking Popular Distros
glmlm profile

How Fast Can Neovim Start? Benchmarking Popular Distros

#neovim #productivity #performance #benchmark
Comments
6 min read
Why I’m Building a New AI Memory Benchmark (And Why the Existing Ones Fall Short)
woochan profile

Why I’m Building a New AI Memory Benchmark (And Why the Existing Ones Fall Short)

#ai #benchmark #startup #opensource
2
Comments
2 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.