DEV Community

Casey Zhang profile picture

Casey Zhang

Building things with Python, Go, and JavaScript. Love automating everything.

Location Singapore Joined Joined on 
Don't Ship the Pass Rate. Ship the Failure Mix.
byteio_501 profile

Don't Ship the Pass Rate. Ship the Failure Mix.

#ai #testing #agents #python
Comments
7 min read
Freeze the Retry Budget Before You Trust an Agent Pass Rate
byteio_501 profile

Freeze the Retry Budget Before You Trust an Agent Pass Rate

#ai #testing #python #agents
Comments
8 min read
Build an LLM Cache Proxy in 40 Lines to Cut Token Costs 83%
byteio_501 profile

Build an LLM Cache Proxy in 40 Lines to Cut Token Costs 83%

#llmcache #python #sqlite #tokencost
Comments
6 min read
Your Coding Agent's Pass Rate Isn't a Benchmark Until the Oracle Is Frozen
byteio_501 profile

Your Coding Agent's Pass Rate Isn't a Benchmark Until the Oracle Is Frozen

#ai #testing #python #opensource
Comments
7 min read
Benchmarking an AI Coding Tool? Start With the Data You Actually Trust
byteio_501 profile

Benchmarking an AI Coding Tool? Start With the Data You Actually Trust

#ai #benchmark #programming #llm
Comments
5 min read
Your Prompt A/B Test Is Probably Random Noise: A Paired-Test Harness for Free-Tier LLMs
byteio_501 profile

Your Prompt A/B Test Is Probably Random Noise: A Paired-Test Harness for Free-Tier LLMs

#ai #llm #testing #python
Comments
5 min read
Benchmarking AI Code Generators: A Reproducible Method You Can Run on a Free Server
byteio_501 profile

Benchmarking AI Code Generators: A Reproducible Method You Can Run on a Free Server

#ai #testing #benchmark #llm
Comments
5 min read
Cold Starts Will Eat Your Free LLM Tier: A Reproducible Benchmark
byteio_501 profile

Cold Starts Will Eat Your Free LLM Tier: A Reproducible Benchmark

#benchmark #serverless #llm #testing
Comments
4 min read
The Token Allowance Trap: A Task-Price Benchmark Before You Build on Free LLM APIs
byteio_501 profile

The Token Allowance Trap: A Task-Price Benchmark Before You Build on Free LLM APIs

#ai #llm #python #testing
Comments
4 min read
Measure Your AI Reviewer Before You Trust It: A Seeded-Defect Benchmark
byteio_501 profile

Measure Your AI Reviewer Before You Trust It: A Seeded-Defect Benchmark

#ai #testing #python #productivity
Comments
5 min read
Benchmarking LLM Agents Without the Marketing Math: Dataset, Metrics, and Controls
byteio_501 profile

Benchmarking LLM Agents Without the Marketing Math: Dataset, Metrics, and Controls

#ai #llm #testing #opensource
Comments
5 min read
From git log to Release Notes: A Free-Tier Agent Case Study
byteio_501 profile

From git log to Release Notes: A Free-Tier Agent Case Study

#ai #agents #python #opensource
Comments
5 min read
Crash-Proof Batch LLM Processing: A SQLite Job Queue on a Free Server
byteio_501 profile

Crash-Proof Batch LLM Processing: A SQLite Job Queue on a Free Server

#sqlite #llm #python #devops
Comments 1
5 min read
Building a Free-Tier GitHub Issue Triage Agent: A Case Study
byteio_501 profile

Building a Free-Tier GitHub Issue Triage Agent: A Case Study

#ai #agents #python #opensource
Comments
5 min read
Cheap Model Hype Is Not a Benchmark: Run a 30-Minute Agent Gate Before You Swap
byteio_501 profile

Cheap Model Hype Is Not a Benchmark: Run a 30-Minute Agent Gate Before You Swap

#ai #agents #testing #python
Comments
4 min read
Cheap Model Hype Is Not a Benchmark: Run a 30-Minute Agent Gate Before You Swap
byteio_501 profile

Cheap Model Hype Is Not a Benchmark: Run a 30-Minute Agent Gate Before You Swap

#ai #agents #testing #python
Comments
4 min read
Tool-Permission Gate: The Only MiniMax H3 Test That Matters
byteio_501 profile

Tool-Permission Gate: The Only MiniMax H3 Test That Matters

#ai #agents #testing #llmsafety
Comments
5 min read
Pin Your Agent's Behavior: Snapshot Tests for Tool-Call Sequences When You Swap Models
byteio_501 profile

Pin Your Agent's Behavior: Snapshot Tests for Tool-Call Sequences When You Swap Models

#ai #testing #agents #python
Comments
5 min read
AI Agent Boundary Testing: Fake-Tool Harness on a Free Server
byteio_501 profile

AI Agent Boundary Testing: Fake-Tool Harness on a Free Server

#aiagents #security #promptinjection #python
Comments
6 min read
I Gave My Coding Agent Fake Tools on Purpose: A Boundary-Test Harness You Can Run on a Free Server
byteio_501 profile

I Gave My Coding Agent Fake Tools on Purpose: A Boundary-Test Harness You Can Run on a Free Server

#ai #agents #security #python
Comments
5 min read
Stop Guessing: A Reproducible Harness for Evaluating Free AI Coding Models on Your Own Repo
byteio_501 profile

Stop Guessing: A Reproducible Harness for Evaluating Free AI Coding Models on Your Own Repo

#ai #testing #productivity #tooling
Comments
5 min read
loading...