Skip to content

Linear Algebra

A comprehensive book covering linear algebra from foundations through spectral theory, matrix decompositions, numerical methods, and modern applications in ten parts with appendices.

Part I. Foundations

ChapterTitle
1What Linear Algebra Is
2Scalars, Vectors, and Fields
3Geometry of Euclidean Space
4Linear Equations
5Systems of Linear Equations
6Matrices
7Matrix Operations
8Elementary Row Operations
9Gaussian Elimination
10Gauss-Jordan Elimination
11Invertible Matrices
12Rank and Nullity
13Determinants
14Cofactors and Adjugates
15Block Matrices
16Matrix Factorizations Overview

Part II. Vector Spaces

ChapterTitle
17Vector Spaces
18Subspaces
19Span and Linear Combination
20Linear Independence
21Basis
22Dimension
23Coordinate Systems
24Change of Basis
25Row Space and Column Space
26Null Space
27Quotient Spaces
28Dual Spaces
29Annihilators
30Direct Sums
31Affine Spaces

Part III. Linear Transformations

ChapterTitle
32Linear Transformations
33Kernel and Image
34Matrix Representation of Linear Maps
35Composition of Transformations
36Isomorphisms
37Automorphisms
38Projection Operators
39Reflection Operators
40Rotation Operators
41Shears and Scalings
42Similarity Transformations
43Invariant Subspaces
44Cyclic Subspaces

Part IV. Inner Product Spaces

ChapterTitle
45Inner Products
46Norms and Metrics
47Orthogonality
48Orthogonal Complements
49Orthonormal Bases
50Gram-Schmidt Orthogonalization
51Orthogonal Projections
52Least Squares Problems
53QR Factorization
54Unitary and Orthogonal Matrices
55Hermitian Spaces
56Positive Definite Matrices
57Quadratic Forms
58Sylvester’s Law of Inertia

Part V. Eigenvalues and Spectral Theory

ChapterTitle
59Eigenvalues
60Eigenvectors
61Characteristic Polynomial
62Eigenspaces
63Diagonalization
64Spectral Theorem
65Symmetric Matrices
66Hermitian Operators
67Normal Operators
68Jordan Canonical Form
69Minimal Polynomial
70Cayley-Hamilton Theorem
71Rational Canonical Form
72Matrix Functions
73Matrix Exponential
74Perron-Frobenius Theory

Part VI. Matrix Decompositions

ChapterTitle
75LU Decomposition
76PLU Decomposition
77Cholesky Decomposition
78QR Decomposition
79Schur Decomposition
80Singular Value Decomposition
81Polar Decomposition
82Hessenberg Form
83Tridiagonalization
84Canonical Matrix Forms

Part VII. Numerical Linear Algebra

ChapterTitle
85Floating Point Arithmetic
86Conditioning and Stability
87Error Analysis
88Iterative Methods for Linear Systems
89Jacobi Method
90Gauss-Seidel Method
91Conjugate Gradient Method
92Krylov Subspaces
93Power Iteration
94QR Algorithm
95Sparse Matrices
96Structured Matrices
97Randomized Linear Algebra

Part VIII. Advanced Structures

ChapterTitle
98Tensor Products
99Exterior Algebra
100Symmetric Algebra
101Multilinear Maps
102Bilinear Forms
103Alternating Forms
104Clifford Algebras
105Lie Algebras
106Representation Theory Basics
107Infinite-Dimensional Vector Spaces
108Functional Analysis Connections

Part IX. Applications

ChapterTitle
109Linear Regression
110Optimization and Linear Algebra
111Graphs and Adjacency Matrices
112Markov Chains
113Differential Equations
114Fourier Series and Transforms
115Signal Processing
116Computer Graphics
117Robotics and Kinematics
118Control Theory
119Quantum Mechanics
120Machine Learning
121Principal Component Analysis
122PageRank and Network Analysis
123Coding Theory
124Cryptography
125Finite Element Methods
126Scientific Computing

Part X. Specialized Topics

ChapterTitle
127Complex Vector Spaces
128Finite Fields
129Linear Algebra over Arbitrary Fields
130Modules and Linear Algebra
131Category-Theoretic Perspective
132Convex Geometry
133Random Matrices
134Numerical Optimization
135Operator Theory
136Spectral Graph Theory
137Compressed Sensing
138Tensor Decompositions
139Geometric Algebra
140Modern Applications in AI

Appendices

AppendixTitle
ASet Theory and Logic
BProof Techniques
CReal and Complex Numbers
DPolynomial Algebra
ECalculus Review
FNumerical Computation
GMathematical Notation
HHistorical Notes
IGlossary
JTheorem Index
KSymbol Index

This structure combines the standard undergraduate sequence with numerical, computational, geometric, and modern applied directions. It follows the progression used in many major references and courses: systems and matrices, vector spaces, linear maps, inner products, spectral theory, decompositions, then advanced and applied topics.

I. FoundationsScalars, vectors, matrices, linear equations, Gaussian elimination, determinants, and matrix factorizations — the bedrock of linear algebra.
16 pages · 144 min
II. Vector SpacesAbstract vector spaces, subspaces, span, linear independence, basis, dimension, coordinate systems, dual spaces, and direct sums.
15 pages · 130 min
III. Linear TransformationsLinear maps, kernel and image, matrix representation, isomorphisms, projections, reflections, rotations, similarity, and invariant subspaces.
13 pages · 136 min
IV. Inner Product SpacesInner products, norms, orthogonality, Gram-Schmidt, orthogonal projections, least squares, QR factorization, Hermitian spaces, and quadratic forms.
14 pages · 131 min
V. Eigenvalues and Spectral TheoryEigenvalues, eigenvectors, diagonalization, the spectral theorem, Jordan canonical form, Cayley-Hamilton, matrix functions, and Perron-Frobenius theory.
16 pages · 158 min
VI. Matrix DecompositionsLU, PLU, Cholesky, QR, Schur, SVD, polar, Hessenberg, tridiagonalization, and canonical matrix forms.
10 pages · 108 min
VII. Numerical Linear AlgebraFloating point arithmetic, conditioning, stability, iterative solvers, Jacobi, Gauss-Seidel, conjugate gradient, Krylov subspaces, QR algorithm, sparse and randomized methods.
13 pages · 137 min
VIII. Advanced StructuresTensor products, exterior and symmetric algebras, multilinear maps, bilinear forms, Clifford algebras, Lie algebras, representation theory, and infinite-dimensional spaces.
11 pages · 97 min
IX. ApplicationsLinear regression, optimization, graphs, Markov chains, differential equations, Fourier transforms, signal processing, computer graphics, robotics, quantum mechanics, machine learning, PCA, and more.
18 pages · 202 min
X. Specialized TopicsComplex vector spaces, finite fields, modules, category theory, convex geometry, random matrices, operator theory, spectral graph theory, compressed sensing, tensor decompositions, geometric algebra, and AI applications.
14 pages · 127 min
AppendicesReference material: set theory, proof techniques, real and complex numbers, polynomial algebra, calculus review, numerical computation, notation, historical notes, glossary, and index.
11 pages · 91 min