DEV Community

#aiengineering

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
WebGPU LLM Inference: Running 7B Models Natively in the Browser

WebGPU LLM Inference: Running 7B Models Natively in the Browser

Comments
4 min read
Structured Output Generation: Enforcing JSON & Regex at the Logits Level

Structured Output Generation: Enforcing JSON & Regex at the Logits Level

Comments
3 min read
S-LoRA: Multiplexing Thousands of Fine-Tuned Adapters on a Single GPU

S-LoRA: Multiplexing Thousands of Fine-Tuned Adapters on a Single GPU

Comments
3 min read
Multi-Agent Swarm Orchestration: Hierarchical Agentic Workflows

Multi-Agent Swarm Orchestration: Hierarchical Agentic Workflows

Comments
3 min read
KV Cache INT4 Quantization for 1M+ Token Context Windows

KV Cache INT4 Quantization for 1M+ Token Context Windows

Comments
3 min read
Serving Mixture of Experts (MoE): Memory-Efficient Inference Routing

Serving Mixture of Experts (MoE): Memory-Efficient Inference Routing

Comments
3 min read
OmniRouter Architecture: Resilient LLM Gateway Routing & Fallback Pipelines

OmniRouter Architecture: Resilient LLM Gateway Routing & Fallback Pipelines

Comments
5 min read
DSPy: Replacing Prompt Engineering with Declarative Optimization Compilers

DSPy: Replacing Prompt Engineering with Declarative Optimization Compilers

Comments
3 min read
ColBERT Late Interaction: Advancing RAG Beyond Dense Embeddings

ColBERT Late Interaction: Advancing RAG Beyond Dense Embeddings

Comments
4 min read
vLLM PagedAttention: Memory Optimization & High-Throughput LLM Inference Tuning

vLLM PagedAttention: Memory Optimization & High-Throughput LLM Inference Tuning

Comments
4 min read
An Agent Is a Loop: a Working Mental Model for Agentic Systems

An Agent Is a Loop: a Working Mental Model for Agentic Systems

Comments 1
6 min read
Logistic Regression Doesn't Make Decisions—Your Business Does

Logistic Regression Doesn't Make Decisions—Your Business Does

Comments
3 min read
Best Practices for AI-DLC: Amazon

Best Practices for AI-DLC: Amazon

Comments
17 min read
Building a Pi Agent from Scratch (7-Day Retrospective)

Building a Pi Agent from Scratch (7-Day Retrospective)

Comments 3
29 min read
Your banned-word list expired in March 2024

Your banned-word list expired in March 2024

Comments 1
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.