Gpu - DEV Community

Skip to content

DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

EME GUG

Oct 17

Your GPU Benchmark Is Lying: Measuring LLM Inference Under Thermal Throttling the Right Way

#llm #gpu #benchmark #performance

7 min read

Oct 16

I put the 381 tok/s Qwen stack on one RTX 3090, real chat does 118 and the headline mode crashes

#llm #inference #gpu #docker

5 min read

InferenceKey for InferenceKey

Oct 16

A 763B MoE on two 96 GB GPUs: put the idle experts in host RAM, then measure per stream

#llm #gpu #machinelearning #selfhosted

4 min read

Alex Chen

Oct 16

Stop Overpaying for GPUs: Spot vs On-Demand for LLM Inference (With Real Numbers)

#gpu #llm #cloud #machinelearning

3 min read

InferenceKey for InferenceKey

Oct 15

Same config.json, different serve command: what to check before serving AREX-2

#ai #llm #machinelearning #gpu

5 min read

Oct 15

Open weights don't make a 1T model cheap to run

#ai #llm #mistral #gpu

1 min read

Oct 14

Kandinsky 6.0 on a 16 GB GPU: the official recipe runs out of memory, and only the 29B model passed my Spanish test

#ai #machinelearning #gpu #benchmark

2 min read

Sanskriti Harmukh for Vultr

Oct 14

Installing K3s with ROCm GPU Operator on Ubuntu 24.04

#kubernetes #k3s #rocm #gpu

3 min read

Oct 14

Run GPU kernel tuning as an overnight search loop

#ai #gpu #performance #python

6 min read

Hacks.gr

Oct 14

Nvidia's new graphics cards are very expensive in Japan

#nvidia #hardware #gpu #ai

1 min read

lucanu

Oct 14

Building a Distributed GPU Cluster for LLM Inference on Idle Apple Silicon Macs

#gpu #llm #macos #distributed

2 min read

Oct 13

I got tired of checking GPU cloud pricing pages by hand, so I built a price index API

#gpu #cloud #api #llm

2 min read

Sanskriti Harmukh for Vultr

Oct 14

Configuring Smart Routing in NVIDIA Dynamo

#llm #nvidia #gpu #inference

19 min read

Sanskriti Harmukh for Vultr

Oct 14

Installing Docker with ROCm GPU Support on Ubuntu 24.04

#docker #rocm #gpu #ubuntu

3 min read

VoltageGPU

Oct 13

Verifying Intel TDX and NVIDIA GPU attestation from inside a rented VM, and what it can't prove

#security #python #gpu #ai

3 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.