Benchmarks

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Rickesh T N

Oct 16

I built an oracle to prove my benchmark needed full document coverage. I only tested it from one end.

#benchmarks #evaluation #llm #testing

5 min read

AI OpenFree

Oct 15

Who Holds #1 on Every Hugging Face Official Benchmark? A Live Index

#machinelearning #ai #benchmarks #opensource

2 min read

lnc

Oct 14

Stop Blaming Serialization for Slow Python UDFs

#spark #pyspark #arrow #benchmarks

8 min read

Max Quimby

Oct 14

Meta's Muse Wonder Scores Big and Delivers Little

#ai #meta #llm #benchmarks

9 min read

Daniel Sam Pete Thiyagu

Oct 11

Passed Once, Failed 19 Times: The Reliability Gap Microsoft's ThinkingBox Found in Every Agent

#ai #agents #machinelearning #benchmarks

6 min read

Amit

Oct 10

Opus 5.5 Leads a Four-Model OWASP Java Test by 7 to 9 Points. Kimi K3, GLM 5.3, and GPT-6 Sol Tie.

#benchmarks #modeleconomics #security #bedrock

9 min read

QuantID

Oct 9

Reading the S1MB result: why Borda aggregation makes a #1 harder to fake

#ai #machinelearning #benchmarks #datascience

2 min read

Peremptory

Oct 9

OpenAI's 722 Math Proofs All Came From One Prompt

#openai #modelrelease #research #benchmarks

2 min read

Oct 8

The benchmark score is the number to trust least

#ai #benchmarks #llmops

2 min read

Efrain Garay

Oct 7

Strands Decider 2B vs LLM as a judge: a keyword regex tied the 2B

#llm #machinelearning #benchmarks #python

1 min read

Travis Frisinger

Oct 8

The Visible Test Suite Is the Ceiling on What the Next Agent Can Deliver

#aiagents #testdiscipline #verification #benchmarks

8 min read

Reid Marlow

Oct 12

Synthetic GUI Benchmarks Fail When the App Doesn't Actually Run

#ai #agents #benchmarks #devtools

2 min read

Efrain Garay

Oct 10

Qwen-Image 2.1 on 16 GB of VRAM, quantized to NF4: a real benchmark against FLUX

#stablediffusion #machinelearning #benchmarks #python

2 min read

Nobody

Sep 25

Why your SQLite WAL file never shrinks

#sqlite #database #internals #benchmarks

12 min read

Daniel Sam Pete Thiyagu

Oct 7

The Model Wasn't Stupid. It Was Blind: How a Four-Sentence Prompt Took Claude to a Perfect 100 on ARC-AGI-3

#ai #agents #machinelearning #benchmarks

6 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.