Resources
Word2Vec and Word Embeddings
- Visualize embeddings in 3D space, powered by EmbeddingGemma and Transformers.js
- Original Word2Vec Papers - Google Code archive with original papers
- Word2Vec Tutorial - The Skip-Gram Model - Chris McCormick’s detailed tutorial
- Gensim Word2Vec Tutorial - Popular Python library for word embeddings
- A Visual Introduction to Vector Embeddings, Pamela Fox
- A Visual Exploration of Vectors, Pamela Fox
Tokenization and Byte Pair Encoding
- BPE Original Paper (1994) - Philip Gage’s original compression algorithm
- Neural Machine Translation with BPE - 2016 paper adapting BPE for NLP
- Hugging Face Tokenizers - Understanding different tokenization strategies
- OpenAI Tokenizer Tool - Interactive tool to see how text is tokenized
Transformers
- The Illustrated Transformer - Jay Alammar’s visual guide
- “Attention is All You Need” Paper - The original transformer paper (2017)
- The Annotated Transformer - Harvard NLP’s line-by-line implementation guide
- Transformer Math 101 - Understanding transformer computation
- Attention Mechanism Explained - Visual explanation of attention
GPT and Language Models
- GPT-1 Paper: “Improving Language Understanding” - Original GPT paper (2018)
- GPT-2 Paper: “Language Models are Unsupervised Multitask Learners” - GPT-2 paper (2019)
- GPT-2 Release Blog Post - OpenAI’s staged release announcement
- Understanding Decoder-Only Models - Sebastian Raschka’s explanation
- Andrej Karpathy’s “Let’s build GPT” - Building GPT from scratch
Python and Programming Basics
- Learn Python with Jupyter, Serena Bonaretti
- Python Official Documentation - Official Python 3 documentation
- Python for Beginners - Python.org’s getting started guide
- Automate the Boring Stuff with Python - Free online book for Python beginners
Python Package Management
- pip Documentation - Python’s standard package installer
- uv Documentation - Modern, fast Python package manager
- PyPI - Python Package Index - Repository of 500K+ Python packages
Notebooks and Development Environment
- Google Colab Sign-up Page
- Google Colab Tips and Tricks - Making the most of Colab
- Project Jupyter Page
- Jupyter Notebook Beginner Guide - Getting started with Jupyter
- VS Code Jupyter Extension - Run notebooks in VS Code