Umar Jamil

I'm a Machine Learning Engineer from Milan, Italy, teaching complex deep learning and machine learning concepts to my cat, 奥利奥.
我也会一点中文.

Бейне

Kolmogorov-Arnold Networks: MLP vs KAN, Math, B-Splines, Universal Approximation Theorem
14 күн бұрын
Direct Preference Optimization (DPO) explained: Bradley-Terry model, log probabilities, math
Ай бұрын
Reinforcement Learning from Human Feedback explained with math derivations and the PyTorch code.
2 ай бұрын
Mamba and S4 Explained: Architecture, Parallel Scan, Kernel Fusion, Recurrent, Convolution, Math
4 ай бұрын
Mistral / Mixtral Explained: Sliding Window Attention, Sparse Mixture of Experts, Rolling Buffer
4 ай бұрын
Distributed Training with PyTorch: complete tutorial with cloud infrastructure and code
5 ай бұрын
Quantization explained with PyTorch - Post-Training Quantization, Quantization-Aware Training
5 ай бұрын
Retrieval Augmented Generation (RAG) Explained: Embedding, Sentence BERT, Vector Database (HNSW)
5 ай бұрын
BERT explained: Training, Inference, BERT vs GPT/LLamA, Fine tuning, [CLS] token
7 ай бұрын
Coding Stable Diffusion from scratch in PyTorch
7 ай бұрын
Coding LLaMA 2 from scratch in PyTorch - KV Cache, Grouped Query Attention, Rotary PE, RMSNorm
8 ай бұрын
LLaMA explained: KV-Cache, Rotary Positional Embedding, RMS Norm, Grouped Query Attention, SwiGLU
9 ай бұрын
Segment Anything - Model explanation with code
9 ай бұрын
LoRA: Low-Rank Adaptation of Large Language Models - Explained visually + PyTorch code from scratch
10 ай бұрын
LongNet: Scaling Transformers to 1,000,000,000 tokens: Python Code + Explanation
10 ай бұрын
How diffusion models work - explanation and code!
10 ай бұрын
Variational Autoencoder - Model, ELBO, loss function and maths explained easily!
11 ай бұрын
Attention is all you need (Transformer) - Model explanation (including math), Inference and Training
11 ай бұрын
Coding a Transformer from scratch on PyTorch, with full explanation, training and inference.
Жыл бұрын
CLIP - Paper explanation (training and inference)
Жыл бұрын
Wav2Lip (generate talking avatar videos) - Paper reading and explanation
Жыл бұрын

Kolmogorov-Arnold Networks: MLP vs KAN, Math, B-Splines, Universal Approximation Theorem

Direct Preference Optimization (DPO) explained: Bradley-Terry model, log probabilities, math

Reinforcement Learning from Human Feedback explained with math derivations and the PyTorch code.

Mamba and S4 Explained: Architecture, Parallel Scan, Kernel Fusion, Recurrent, Convolution, Math

Mistral / Mixtral Explained: Sliding Window Attention, Sparse Mixture of Experts, Rolling Buffer

Distributed Training with PyTorch: complete tutorial with cloud infrastructure and code

Quantization explained with PyTorch - Post-Training Quantization, Quantization-Aware Training

Retrieval Augmented Generation (RAG) Explained: Embedding, Sentence BERT, Vector Database (HNSW)

BERT explained: Training, Inference, BERT vs GPT/LLamA, Fine tuning, [CLS] token

Coding Stable Diffusion from scratch in PyTorch

Coding LLaMA 2 from scratch in PyTorch - KV Cache, Grouped Query Attention, Rotary PE, RMSNorm

LLaMA explained: KV-Cache, Rotary Positional Embedding, RMS Norm, Grouped Query Attention, SwiGLU

Segment Anything - Model explanation with code

LoRA: Low-Rank Adaptation of Large Language Models - Explained visually + PyTorch code from scratch

LongNet: Scaling Transformers to 1,000,000,000 tokens: Python Code + Explanation

How diffusion models work - explanation and code!

Variational Autoencoder - Model, ELBO, loss function and maths explained easily!

Attention is all you need (Transformer) - Model explanation (including math), Inference and Training

Coding a Transformer from scratch on PyTorch, with full explanation, training and inference.

CLIP - Paper explanation (training and inference)

Wav2Lip (generate talking avatar videos) - Paper reading and explanation