Linear Algebra
Vector spaces, matrix transformations, Gaussian elimination, eigenvalues, eigenvectors, and Singular Value Decomposition (SVD).
Span, linear combinations, basis vectors, dimension, and fundamental subspaces of a matrix.
Vector Subspaces, Linear Independence & Span Mechanics
Mathematical definitions of vector space axioms, linear combinations, and basis dimensions.
Inner product spaces, Cauchy-Schwarz bounds, Gram-Schmidt orthogonalization, Householder reflections, and QR matrix factorization.
Orthogonal Subspaces, Projection Geometry & QR Factorization
Vector norms, projection matrices, Modified Gram-Schmidt stability, and QR factorizations for overdetermined linear systems.
Characteristic polynomials, eigenvalues, eigenvectors, algebraic vs geometric multiplicity, and the Spectral Theorem for symmetric matrices.
Eigenvalues, Characteristic Polynomials & Diagonalization
Invariant subspaces, eigenvalue computation, diagonalizability criteria, and real symmetric matrix spectral decompositions.
Singular values, singular vectors, Eckart-Young-Mirsky Theorem, Moore-Penrose pseudoinverse, and data dimensionality reduction.
SVD Geometry, Fundamental Subspaces & Low-Rank Factorization
Left/right singular vectors, singular value spectrum, low-rank matrix compression, and robust pseudo-inversion for rank-deficient systems.