Core Knowledge Base
Topic Library & Architectural Guides
Comprehensive, peer-reviewed CS documentation. Designed in a 3-column classic developer format with interactive syntax-highlighted code blocks, mathematical derivations, and video walkthroughs.
AI Engineering
(2 articles)AI Engineering
16 min read
The Mathematics & Implementation of Multi-Head Self-Attention
Deriving Scaled Dot-Product Attention from first principles, vectorizing batch calculations in PyTorch, and analyzing KV caching memory dynamics.
#AI/ML#PyTorch#Transformers
Read
AI Engineering
14 min read
High-Dimensional Vector Indexing: HNSW and IVF-PQ Explained
How vector search engines index billions of embeddings. A mathematical and algorithmic breakdown of Hierarchical Navigable Small World graphs and Inverted File Product Quantization.
#Vector DB#Embeddings#Algorithms
Read