DEV Community

#benchmarking

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Do Drafters Work on Small Models? Gemma 4 E2B and E4B on Two Small GPUs

Do Drafters Work on Small Models? Gemma 4 E2B and E4B on Two Small GPUs

7
Comments
19 min read
Benchmarking an Agent Without Lying to Yourself

Benchmarking an Agent Without Lying to Yourself

Comments
5 min read
Benchmarking S3 Throughput: How to Measure Without Lying

Benchmarking S3 Throughput: How to Measure Without Lying

Comments
11 min read
csperf Diff: Comparing Two Runs Without Spreadsheet Chaos

csperf Diff: Comparing Two Runs Without Spreadsheet Chaos

Comments
4 min read
We Wanted a Fast Offline AI. First, We Had to Fix Our Benchmark.

We Wanted a Fast Offline AI. First, We Had to Fix Our Benchmark.

Comments
22 min read
I Built a Benchmark That Catches AI Models Cheating (And They All Failed)

I Built a Benchmark That Catches AI Models Cheating (And They All Failed)

Comments
3 min read
Noise Sources: Affinity, Frequency, and Background Load — How to isolate and quantify non‑compiler variance with csperf

Noise Sources: Affinity, Frequency, and Background Load — How to isolate and quantify non‑compiler variance with csperf

Comments
3 min read
Kev gives the same answer every time. Until you batch it.

Kev gives the same answer every time. Until you batch it.

Comments
8 min read
I Tested Whether Frontier AI Can Do a Texas Real Estate Agent's Desk Work — Here's What 3 Models Taught Me (and What the 4th Taught Me About Benchmarks)

Kaggle Benchmarking Challenge Submission

I Tested Whether Frontier AI Can Do a Texas Real Estate Agent's Desk Work — Here's What 3 Models Taught Me (and What the 4th Taught Me About Benchmarks)

Comments
6 min read
Warmup Deep Dive: What You’re Throwing Away and Why

Warmup Deep Dive: What You’re Throwing Away and Why

Comments
4 min read
Stability Metrics: Min, Max, and Standard Deviation as First-Class Citizens

Stability Metrics: Min, Max, and Standard Deviation as First-Class Citizens

Comments
3 min read
Benchmarking regex patterns properly: P95/P99, equivalence checks, real engines

Benchmarking regex patterns properly: P95/P99, equivalence checks, real engines

Comments
2 min read
MyanmarChemCalc-Bench: Do LLMs Do Chemistry Better in English Than in Burmese?

Kaggle Benchmarking Challenge Submission

MyanmarChemCalc-Bench: Do LLMs Do Chemistry Better in English Than in Burmese?

Comments
3 min read
LiteLLM Rust Gateway Benchmarked: Fast and Tiny, but Not Yet a Python Proxy Replacement

LiteLLM Rust Gateway Benchmarked: Fast and Tiny, but Not Yet a Python Proxy Replacement

Comments
11 min read
I benchmarked what frontier models actually know about 2026 — most of it, they don't

Kaggle Benchmarking Challenge Submission

I benchmarked what frontier models actually know about 2026 — most of it, they don't

Comments
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.