DEV Community

#transformers

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
How Hugging Face's Transformers Added UltraBERT with Layer-Specific Rotary Embeddings

How Hugging Face's Transformers Added UltraBERT with Layer-Specific Rotary Embeddings

Comments
2 min read
Detectar volatilidad anĂłmala en los mercados con un Temporal Fusion Transformer

Detectar volatilidad anĂłmala en los mercados con un Temporal Fusion Transformer

Comments
2 min read
They Put 7 Attention Mechanisms on a Latin Square. Then Removed Them One by One.

They Put 7 Attention Mechanisms on a Latin Square. Then Removed Them One by One.

Comments
5 min read
Masked Self-Attention, Explained Through Avengers: Endgame

Masked Self-Attention, Explained Through Avengers: Endgame

1
Comments
6 min read
Puzzle Solution Revealed - Transformer: Need for Position Embedding

Puzzle Solution Revealed - Transformer: Need for Position Embedding

Comments 1
13 min read
Depth-Attention: Opening an Attention Channel Between Transformer Layers

Depth-Attention: Opening an Attention Channel Between Transformer Layers

Comments
11 min read
Top 5 Dev Tools Released in Late July 2026

Top 5 Dev Tools Released in Late July 2026

Comments
3 min read
How a Baseten Engineer Traced 7 Years of Attention Mechanism Evolution -- From GPT-2 to Kimi K3, in Runable PyTorch

How a Baseten Engineer Traced 7 Years of Attention Mechanism Evolution -- From GPT-2 to Kimi K3, in Runable PyTorch

2
Comments 4
7 min read
Attention Is All You Need: The Translation Problem That Led to ChatGPT

Attention Is All You Need: The Translation Problem That Led to ChatGPT

Comments 2
8 min read
Self-attention, explained without the heavy math

Self-attention, explained without the heavy math

3
Comments
3 min read
The KV Cache Is the Bottleneck: A 2026 Field Guide to Attention Variants

The KV Cache Is the Bottleneck: A 2026 Field Guide to Attention Variants

1
Comments 2
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.