About 118 results for "UCtAcpQcYerN8xxZJYTfWBMw"

Titans: Learning to Memorize at Test Time

Umar Jamil • Feb 23, 2025

Attention is all you need (Transformer) - Model explanation (including math), Inference and Training

Umar Jamil • Apr 30, 2024

LoRA: Low-Rank Adaptation of Large Language Models - Explained visually + PyTorch code from scratch

Umar Jamil • Apr 28, 2024

Distributed Training with PyTorch: complete tutorial with cloud infrastructure and code

Umar Jamil • Apr 28, 2024

LLaMA explained: KV-Cache, Rotary Positional Embedding, RMS Norm, Grouped Query Attention, SwiGLU

Umar Jamil • Apr 23, 2024

Reinforcement Learning from Human Feedback explained with math derivations and the PyTorch code.

Umar Jamil • Apr 23, 2024

Direct Preference Optimization (DPO) explained: Bradley-Terry model, log probabilities, math

Umar Jamil • Apr 23, 2024

Retrieval Augmented Generation (RAG) Explained: Embedding, Sentence BERT, Vector Database (HNSW)

Umar Jamil • Apr 23, 2024

Mistral / Mixtral Explained: Sliding Window Attention, Sparse Mixture of Experts, Rolling Buffer

Umar Jamil • Apr 23, 2024