Skip to content

DEV Community

Roy Mu

404 bio not found

Joined on Sep 17, 2020

Roy Mu

Oct 13

SonicBoom: 52 tok/s decode on a laptop RTX 3050 (llama.cpp: 45) with the same quantized kernels, the difference is a graph compiler. No Python.

#ai #computerscience #sonicboom #compiler

2 min read

loading...