DEV Community

Shridhar Shah profile picture

Shridhar Shah

Senior Software Engineer -AI at Cisco

Joined Joined on 

Education

San Jose State University

Work

Senior Software Engineer at Cisco

Stop Paying the Worst Case on Every Query: Adaptive Test-Time Compute

Stop Paying the Worst Case on Every Query: Adaptive Test-Time Compute

Comments
5 min read

Want to connect with Shridhar Shah?

Create an account to connect with Shridhar Shah. You can also sign in below to proceed if you already have an account.

Already have an account? Sign in
One Long Prompt Shouldn't Freeze Everyone's Tokens: Prefill/Decode Disaggregation

One Long Prompt Shouldn't Freeze Everyone's Tokens: Prefill/Decode Disaggregation

Comments
5 min read
Your Agent Has a Bug You Can't Reproduce. Here's How to Catch It.

Your Agent Has a Bug You Can't Reproduce. Here's How to Catch It.

Comments
5 min read
Stop Making Your Agent Wait: Branch Prediction for Tool Calls

Stop Making Your Agent Wait: Branch Prediction for Tool Calls

Comments
6 min read
The Agent That Answers Before You Ask

The Agent That Answers Before You Ask

Comments
4 min read
Your Agent's Context Window Is RAM. Start Paging It.

Your Agent's Context Window Is RAM. Start Paging It.

Comments
5 min read
Your Load Balancer Is Throwing Away the KV Cache

Your Load Balancer Is Throwing Away the KV Cache

Comments
5 min read
Stop Streaming Tools Through Your LLM

Stop Streaming Tools Through Your LLM

Comments
5 min read
AI Agents That Live Inside a Dreamed-Up World

AI Agents That Live Inside a Dreamed-Up World

Comments 1
4 min read
I Gave 3 AI Agents a Decaying Notepad and They Built a Culture

I Gave 3 AI Agents a Decaying Notepad and They Built a Culture

Comments
3 min read
I Watched Two AI Agents Invent Their Own Language

I Watched Two AI Agents Invent Their Own Language

1
Comments
3 min read
Agents Are Learning to Write Their Own SKILL.md Files

Agents Are Learning to Write Their Own SKILL.md Files

1
Comments
7 min read
How Do You Trust an AI Agent With Your Money? You Don't — You Check Its Receipt

How Do You Trust an AI Agent With Your Money? You Don't — You Check Its Receipt

1
Comments
4 min read
I Built an AI Agent That Gets Curious On Its Own

I Built an AI Agent That Gets Curious On Its Own

3
Comments 6
4 min read
Can an AI Agent Pass the Test We Give 4-Year-Olds?

Can an AI Agent Pass the Test We Give 4-Year-Olds?

1
Comments
4 min read
Do AI Agents Need to Sleep? I Built One That Does

Do AI Agents Need to Sleep? I Built One That Does

1
Comments
4 min read
I Built an AI Agent That Rewrites Its Own Code

I Built an AI Agent That Rewrites Its Own Code

1
Comments 2
5 min read
loading...