Chart Gallery

121 Charts | Updated: 2025-12-16

N-grams (9) Embeddings (13) RNN/LSTM (13) Seq2Seq (8) Transformers (7) Pre-trained (10) Scaling (11) Tokenization (9) Decoding (8) Fine-tuning (10) Efficiency (8) Ethics (9) Summarization (4) Other Charts (2)

Week 1: N-grams 9

Addk Smoothing

Addk Smoothing

Bigram Calculation Steps

Bigram Calculation Steps

Conditional Probability Tree

Conditional Probability Tree

Corpus Statistics

Corpus Statistics

Ngram Context Windows

Ngram Context Windows

Ngrams

Ngrams

Perplexity Comparison

Perplexity Comparison

Smoothing Comparison

Smoothing Comparison

Vocabulary Probability

Vocabulary Probability

Week 2: Embeddings 13

Cbow Architecture

Cbow Architecture

Context Movement 3D

Context Movement 3D

Cultural Analogies 3D

Cultural Analogies 3D

Embeddings

Embeddings

Landmark Analogies 3D

Landmark Analogies 3D

Negative Sampling Process

Negative Sampling Process

Semantic Clusters 3D

Semantic Clusters 3D

Semantic Space 2D

Semantic Space 2D

Skipgram Architecture

Skipgram Architecture

Skipgram Training Steps

Skipgram Training Steps

Word2Vec Architectures

Word2Vec Architectures

Word Arithmetic 3D

Word Arithmetic 3D

Word As Vector Concept

Word As Vector Concept

Week 3: RNN/LSTM 13

Forward Pass Flowchart

Forward Pass Flowchart

Gate Activation Heatmap

Gate Activation Heatmap

Gradient Flow Comparison

Gradient Flow Comparison

Gradient Flow Comparison

Gradient Flow Comparison

LSTM Architecture

LSTM Architecture

LSTM Architecture

LSTM Architecture

LSTM Architecture Overview

LSTM Architecture Overview

LSTM Gates Simple

LSTM Gates Simple

RNN-LSTM

RNN-LSTM

RNN Simple Unrolled

RNN Simple Unrolled

RNN Unrolled

RNN Unrolled

Vanishing Gradient

Vanishing Gradient

Vanishing Gradient Problem

Vanishing Gradient Problem

Week 4: Seq2Seq 8

Attention Heatmap

Attention Heatmap

Attention Heatmap

Attention Heatmap

Encoder Decoder Architecture

Encoder Decoder Architecture

Seq2Seq

Seq2Seq

Week4 Attention Heatmap

Week4 Attention Heatmap

Week4 Beam Search Tree

Week4 Beam Search Tree

Week4 Encoder Decoder Flow

Week4 Encoder Decoder Flow

Week4 Seq2Seq Architecture Minimalist

Week4 Seq2Seq Architecture Minimalist

Week 5: Transformers 7

3D Multihead Attention

3D Multihead Attention

3D Transformer Architecture

3D Transformer Architecture

Multihead Attention

Multihead Attention

Positional Encoding 3D

Positional Encoding 3D

Positional Encoding

Positional Encoding

Sr 16 Transformer Architecture Annotated

Sr 16 Transformer Architecture Annotated

Transformers

Transformers

Week 6: Pre-trained 10

BERT Architecture

BERT Architecture

BERT Finetuning Process

BERT Finetuning Process

BERT Results Glue

BERT Results Glue

BERT Vs GPT Architecture

BERT Vs GPT Architecture

Classifier Head Architecture

Classifier Head Architecture

GPT3 Capabilities

GPT3 Capabilities

GPT Architecture

GPT Architecture

Pretraining Finetuning Paradigm

Pretraining Finetuning Paradigm

Pretraining Workflow

Pretraining Workflow

Transfer Learning Visual

Transfer Learning Visual

Week 7: Scaling 11

Accuracy Size Pareto

Accuracy Size Pareto

Compute Scaling

Compute Scaling

Data Performance Curves

Data Performance Curves

Emergent Abilities Chart

Emergent Abilities Chart

Emergent Abilities Chart

Emergent Abilities Chart

Model Scale Timeline

Model Scale Timeline

Model Scale Timeline

Model Scale Timeline

Parameter Spectrum

Parameter Spectrum

Scaling

Scaling

Scaling Laws

Scaling Laws

Scaling Laws

Scaling Laws

Week 8: Tokenization 9

BPE Progression Visual

BPE Progression Visual

BPE Progression Visual

BPE Progression Visual

BPE Visualization

BPE Visualization

Rare Word Handling Visual

Rare Word Handling Visual

Tokenization

Tokenization

Tokenization Comparison

Tokenization Comparison

Tokenization Comparison Visual

Tokenization Comparison Visual

Tokenization Impact

Tokenization Impact

Vocab Size Oov Visual

Vocab Size Oov Visual

Week 9: Decoding 8

Beam Search Tree

Beam Search Tree

Beam Search Tree Graphviz

Beam Search Tree Graphviz

Contrastive Vs Nucleus

Contrastive Vs Nucleus

Decoding

Decoding

Degeneration Problem

Degeneration Problem

Llm Pipeline Graphviz

Llm Pipeline Graphviz

Temperature Effects

Temperature Effects

Topk Example

Topk Example

Week 10: Fine-tuning 10

Adapter Architecture

Adapter Architecture

Catastrophic Forgetting

Catastrophic Forgetting

Deployment Inference Pipeline

Deployment Inference Pipeline

Deployment Pipeline

Deployment Pipeline

Finetuning

Finetuning

Finetuning Pipeline

Finetuning Pipeline

Finetuning Vs Prompting

Finetuning Vs Prompting

Lora Explanation

Lora Explanation

Lora Explanation

Lora Explanation

Unified Framework

Unified Framework

Week 11: Efficiency 8

Distillation Architecture

Distillation Architecture

Distillation Architecture

Distillation Architecture

Efficiency

Efficiency

Model Compression Landscape

Model Compression Landscape

Model Compression Landscape

Model Compression Landscape

Practical Methods Coverage

Practical Methods Coverage

Quantization Comparison

Quantization Comparison

Quantization Levels

Quantization Levels

Week 12: Ethics 9

AI Ethics Landscape

AI Ethics Landscape

Bias Sources Flowchart

Bias Sources Flowchart

Bias Sources Flowchart

Bias Sources Flowchart

Ethics

Ethics

Fairness Metrics Comparison

Fairness Metrics Comparison

Fairness Metrics Comparison

Fairness Metrics Comparison

Harm Taxonomy Tree

Harm Taxonomy Tree

Harm Taxonomy Tree

Harm Taxonomy Tree

Real World Harms

Real World Harms

Module: Summarization 4

Bleu Comparison

Bleu Comparison

Evaluation Metrics

Evaluation Metrics

Map Reduce Summarization

Map Reduce Summarization

RAG Summarization Pipeline

RAG Summarization Pipeline

Other Charts 2

Pretrained

Pretrained

Training Evolution

Training Evolution