Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
pytorch
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
How many GPUs do you need to train an AI model?
Viswaretas Kotra
Viswaretas Kotra
Viswaretas Kotra
Follow
Nov 5
How many GPUs do you need to train an AI model?
#
gpu
#
machinelearning
#
ai
#
pytorch
Comments
Add Comment
8 min read
Moderation
My Gradient Clipping Was Never Clipping. It Was Secretly Multiplying My Weight Decay
b1ackjack12
b1ackjack12
b1ackjack12
Follow
Nov 4
My Gradient Clipping Was Never Clipping. It Was Secretly Multiplying My Weight Decay
#
pytorch
#
machinelearning
#
deeplearning
#
hyperparameters
Comments
Add Comment
4 min read
Moderation
Warmup Did Nothing for My Learning Rate — Then It Fully Rescued the Wrong One
b1ackjack12
b1ackjack12
b1ackjack12
Follow
Nov 4
Warmup Did Nothing for My Learning Rate — Then It Fully Rescued the Wrong One
#
pytorch
#
machinelearning
#
deeplearning
#
hyperparameters
Comments
Add Comment
4 min read
Moderation
Saving and Loading Models in PyTorch: state_dict, Checkpoints and Resuming Training
Wesam Khallaf — Author of PyTorch From Ground Up
Wesam Khallaf — Author of PyTorch From Ground Up
Wesam Khallaf — Author of PyTorch From Ground Up
Follow
Nov 4
Saving and Loading Models in PyTorch: state_dict, Checkpoints and Resuming Training
#
deeplearning
#
pytorch
#
beginners
#
machinelearning
Comments
Add Comment
13 min read
Moderation
Weight Decay 0.05: Catastrophe in Adam, Optimum in AdamW
b1ackjack12
b1ackjack12
b1ackjack12
Follow
Nov 3
Weight Decay 0.05: Catastrophe in Adam, Optimum in AdamW
#
pytorch
#
machinelearning
#
deeplearning
#
hyperparameters
Comments
Add Comment
4 min read
Moderation
Distillation didn't help our small model until we took the labels away
Distil
Distil
Distil
Follow
Nov 2
Distillation didn't help our small model until we took the labels away
#
machinelearning
#
pytorch
#
nlp
#
tutorial
Comments
Add Comment
3 min read
Moderation
Running Captum on Cloud TPUs with TorchTPU: a work log
Joinal Ahmed
Joinal Ahmed
Joinal Ahmed
Follow
Nov 1
Running Captum on Cloud TPUs with TorchTPU: a work log
#
pytorch
#
tpu
#
machinelearning
#
performance
Comments
Add Comment
19 min read
Moderation
Gemma 4 in Rust on TorchTPU: Hands On With Colab
xbill
xbill
xbill
Follow
for
Google Developer Experts
Nov 2
Gemma 4 in Rust on TorchTPU: Hands On With Colab
#
rust
#
pytorch
#
tpu
#
gemma
8
 reactions
Comments
Add Comment
9 min read
Moderation
TorchTitan's October update is out. I fixed 2 bugs in its quick-start script
Shreya Boyane
Shreya Boyane
Shreya Boyane
Follow
Oct 29
TorchTitan's October update is out. I fixed 2 bugs in its quick-start script
#
pytorch
#
python
#
opensource
#
machinelearning
Comments
Add Comment
6 min read
Moderation
Model soups failed until we fixed one line: our 26M grammar tagger from 11% to 1.9% false fixes
Georgii Kharlampiiev
Georgii Kharlampiiev
Georgii Kharlampiiev
Follow
Oct 28
Model soups failed until we fixed one line: our 26M grammar tagger from 11% to 1.9% false fixes
#
machinelearning
#
nlp
#
ios
#
pytorch
Comments
Add Comment
3 min read
Moderation
PyTorch Custom Dataset and DataLoader: __getitem__, __len__, collate_fn, and num_workers
Soham Sharma
Soham Sharma
Soham Sharma
Follow
Oct 28
PyTorch Custom Dataset and DataLoader: __getitem__, __len__, collate_fn, and num_workers
#
pytorch
#
python
#
deeplearning
#
datascience
Comments
Add Comment
9 min read
Moderation
How PyTorch Became the Socket Every AI Chip Plugs Into
Dhruv Agrawal
Dhruv Agrawal
Dhruv Agrawal
Follow
Oct 28
How PyTorch Became the Socket Every AI Chip Plugs Into
#
machinelearning
#
pytorch
#
python
#
performance
5
 reactions
Comments
Add Comment
4 min read
Moderation
LoRA on a 16 GB card: what fits and what does not
Ivan Zdravkov
Ivan Zdravkov
Ivan Zdravkov
Follow
Oct 28
LoRA on a 16 GB card: what fits and what does not
#
ai
#
pytorch
#
deeplearning
#
opensource
Comments
Add Comment
5 min read
Moderation
Blackwell quantisation on my own card
Ivan Zdravkov
Ivan Zdravkov
Ivan Zdravkov
Follow
Oct 28
Blackwell quantisation on my own card
#
ai
#
pytorch
#
deeplearning
#
research
Comments
Add Comment
5 min read
Moderation
Two PyTorch ops that stopped a CUDA text model on an Apple GPU
Leo Newton
Leo Newton
Leo Newton
Follow
Oct 28
Two PyTorch ops that stopped a CUDA text model on an Apple GPU
#
python
#
pytorch
#
machinelearning
#
applesilicon
Comments
Add Comment
5 min read
Moderation
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account