DEV Community

#benchmark

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Testei LLMs no ENEM 2024, e o ranking não diz o que parece

Testei LLMs no ENEM 2024, e o ranking não diz o que parece

Comments
8 min read
Same correct total, 69% fewer tokens: what a shopping agent spends on WooCommerce

Same correct total, 69% fewer tokens: what a shopping agent spends on WooCommerce

Comments
8 min read
Darwin-180B-RSI, 중국 SuperCLUE 11월 평가 수학·과학 추론 오픈 가중치 모델 1위: 아버지 모델을 넘어선 자기개선

Darwin-180B-RSI, 중국 SuperCLUE 11월 평가 수학·과학 추론 오픈 가중치 모델 1위: 아버지 모델을 넘어선 자기개선

Comments
2 min read
Darwin-180B-RSI Ranks #1 Open-Weight Model in Math and Science Reasoning on SuperCLUE (Nov 2026)

Darwin-180B-RSI Ranks #1 Open-Weight Model in Math and Science Reasoning on SuperCLUE (Nov 2026)

Comments
5 min read
Your link checker's timeout is lying to you: a local benchmark of false positives

Your link checker's timeout is lying to you: a local benchmark of false positives

Comments
5 min read
SWE-bench Verified on Hugging Face: 9 Self-Reported Rows Top the Official Table's Best, and 6 Repos Fill 16 of 78 Rows

SWE-bench Verified on Hugging Face: 9 Self-Reported Rows Top the Official Table's Best, and 6 Repos Fill 16 of 78 Rows

Comments 1
14 min read
How LLM Evaluation Produces Comparable Numbers: Inside the LFORLA Capability Retention Benchmark

How LLM Evaluation Produces Comparable Numbers: Inside the LFORLA Capability Retention Benchmark

Comments
3 min read
Cheapest per token is not cheapest per finished job: what 2,400 runs show

Cheapest per token is not cheapest per finished job: what 2,400 runs show

1
Comments
3 min read
Can Local LLMs Replace Opus and Codex? I Tested a MacBook, an RTX 5080, a DGX Spark and Cheap Chinese Models

Can Local LLMs Replace Opus and Codex? I Tested a MacBook, an RTX 5080, a DGX Spark and Cheap Chinese Models

Comments
21 min read
Claude contre GPT sur 20 tâches de bureau d'une PME : protocole, chiffres et limites

Claude contre GPT sur 20 tâches de bureau d'une PME : protocole, chiffres et limites

Comments
6 min read
Spatial Memory vs Correction Memory: I Benchmarked Both Against a Plain LLM

Spatial Memory vs Correction Memory: I Benchmarked Both Against a Plain LLM

1
Comments 2
8 min read
Funções anônimas são mais lentas em Go? Medi os 6 cenários e só 1 custa caro

Funções anônimas são mais lentas em Go? Medi os 6 cenários e só 1 custa caro

Comments
9 min read
GSM8K on Hugging Face: 4 of the Top 12 Rows Show a Sibling Checkpoint's Score, and 20 of 28 Rows Are Unmerged PRs

GSM8K on Hugging Face: 4 of the Top 12 Rows Show a Sibling Checkpoint's Score, and 20 of 28 Rows Are Unmerged PRs

Comments
14 min read
Two independent audits of Terminal Bench 4: 41 of 65, or 30 of 66?

Two independent audits of Terminal Bench 4: 41 of 65, or 30 of 66?

Comments
6 min read
Which Document Extraction API Can You Actually Trust?

Which Document Extraction API Can You Actually Trust?

Comments
11 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.