DEV Community

#edgeai

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Tri-Hybrid Architecture Deep Dive: Liquid AI's LFM3-1.7B, Sub-Millisecond Convolutions, and 256K Context on Edge Silicon

Tri-Hybrid Architecture Deep Dive: Liquid AI's LFM3-1.7B, Sub-Millisecond Convolutions, and 256K Context on Edge Silicon

Comments
7 min read
Kimi K3 in 8 GB of RAM: Why 28x More Memory Buys Only 1.7x Speed, and the Byte Math That Predicts It

Kimi K3 in 8 GB of RAM: Why 28x More Memory Buys Only 1.7x Speed, and the Byte Math That Predicts It

Comments
12 min read
A 763B MoE on a 12 GB GPU: Our Speed Ceiling Versus What Strata Reports, and What Closes the Gap

A 763B MoE on a 12 GB GPU: Our Speed Ceiling Versus What Strata Reports, and What Closes the Gap

Comments
13 min read
Pinning NPU cores on RK3588 buys you 5% — and costs the big model 10%

Pinning NPU cores on RK3588 buys you 5% — and costs the big model 10%

Comments
2 min read
System design for physical AI: from a defect image to the chamber that drifted

System design for physical AI: from a defect image to the chamber that drifted

Comments
5 min read
RK3576 vs RK3568: Which Rockchip SoC Is Right For Your Embedded Edge Project?

RK3576 vs RK3568: Which Rockchip SoC Is Right For Your Embedded Edge Project?

2
Comments
3 min read
A 763B MoE at "2 Bits": Where the Bytes Really Go in the GSQ-RCO GGUFs, and Why 100% Recovery Sits Inside the Noise

A 763B MoE at "2 Bits": Where the Bytes Really Go in the GSQ-RCO GGUFs, and Why 100% Recovery Sits Inside the Noise

Comments
15 min read
10 RKNN models benchmarked on RK3588 — and the fastest one is cheating onto the CPU

10 RKNN models benchmarked on RK3588 — and the fastest one is cheating onto the CPU

Comments
4 min read
RK3588 INT8, measured: 1.96 on YOLOv8n, 1.4 on YOLO11n — plus OCR joins the bench

RK3588 INT8, measured: 1.96 on YOLOv8n, 1.4 on YOLO11n — plus OCR joins the bench

Comments
2 min read
From 46M to 325M: An Inference NPU Now Pretrains a Language Model at GPU Quality

From 46M to 325M: An Inference NPU Now Pretrains a Language Model at GPU Quality

Comments
2 min read
The Rise of Small Language Models: Why Smaller is Better for the Future of AI

The Rise of Small Language Models: Why Smaller is Better for the Future of AI

Comments
3 min read
Liquid Neural Networks: The AI That Adapts on the Fly

Liquid Neural Networks: The AI That Adapts on the Fly

Comments
1 min read
LFM2.5-24B-A2B on Your Own Hardware: The RAM, KV Cache and Bandwidth Budget

LFM2.5-24B-A2B on Your Own Hardware: The RAM, KV Cache and Bandwidth Budget

Comments
11 min read
New artificial intelligence system drives animals off roads and train tracks

New artificial intelligence system drives animals off roads and train tracks

Comments
2 min read
On-Device LLM Inference: The Tradeoffs Nobody Puts on the Spec Sheet

On-Device LLM Inference: The Tradeoffs Nobody Puts on the Spec Sheet

Comments
3 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.