Skip to content

Appendix K. Symbol Index

This appendix lists common symbols used in the book. A symbol may have several meanings in different contexts. When ambiguity is possible, the surrounding definition controls the meaning.

K.1 Number Systems and Fields

SymbolMeaning
N\mathbb{N}Natural numbers
Z\mathbb{Z}Integers
Q\mathbb{Q}Rational numbers
R\mathbb{R}Real numbers
C\mathbb{C}Complex numbers
FFA field of scalars
00Zero scalar, zero vector, or zero matrix
11Multiplicative identity in a field

K.2 Sets and Logic

SymbolMeaning
xAx\in Axx is an element of AA
xAx\notin Axx is not an element of AA
ABA\subseteq BAA is a subset of BB
ABA\cup BUnion
ABA\cap BIntersection
ABA\setminus BSet difference
\varnothingEmpty set
A×BA\times BCartesian product
\forallFor all
\existsThere exists
!\exists!There exists exactly one
    \impliesImplies
    \iffIf and only if

K.3 Functions and Maps

SymbolMeaning
f:ABf:A\to BFunction from AA to BB
xf(x)x\mapsto f(x)Mapping rule
f(S)f(S)Image of a set SS
f1(T)f^{-1}(T)Preimage of a set TT
fgf\circ gComposition of functions
dom(f)\operatorname{dom}(f)Domain of ff
im(f)\operatorname{im}(f)Image of ff

K.4 Vectors and Vector Spaces

SymbolMeaning
V,W,UV,W,UVector spaces or subspaces
v,u,w,x,y,zv,u,w,x,y,zVectors or scalar variables
FnF^nnn-dimensional coordinate space over FF
Rn\mathbb{R}^nReal coordinate space
Cn\mathbb{C}^nComplex coordinate space
viv_iii-th component of vv
eie_iii-th standard basis vector
span(S)\operatorname{span}(S)Span of SS
dim(V)\dim(V)Dimension of VV
[v]B[v]_{\mathcal B}Coordinate vector of vv in basis B\mathcal B

K.5 Matrices

SymbolMeaning
A,B,CA,B,CMatrices or linear transformations
Fm×nF^{m\times n}Set of m×nm\times n matrices over FF
aija_{ij}Entry of AA in row ii, column jj
ATA^TTranspose of AA
AA^*Conjugate transpose of AA
A1A^{-1}Inverse of AA
II, InI_nIdentity matrix
diag(d1,,dn)\operatorname{diag}(d_1,\ldots,d_n)Diagonal matrix
tr(A)\operatorname{tr}(A)Trace of AA
det(A)\det(A)Determinant of AA
rank(A)\operatorname{rank}(A)Rank of AA

Matrix notation commonly uses two subscripts for entries, with the first index giving the row and the second index giving the column. Matrix multiplication may be viewed entrywise, columnwise, or as composition of linear maps.

K.6 Linear Transformations

SymbolMeaning
T:VWT:V\to WLinear transformation from VV to WW
ker(T)\ker(T)Kernel of TT
im(T)\operatorname{im}(T)Image of TT
rank(T)\operatorname{rank}(T)Dimension of image
nullity(T)\operatorname{nullity}(T)Dimension of kernel
T1T^{-1}Inverse transformation, when it exists
[T]BC[T]_{\mathcal B}^{\mathcal C}Matrix of TT from basis B\mathcal B to basis C\mathcal C

K.7 Inner Products, Norms, and Orthogonality

SymbolMeaning
u,v\langle u,v\rangleInner product
uvu\cdot vDot product
v\|v\|Norm of vv
v1\|v\|_1Sum of absolute component values
v2\|v\|_2Euclidean norm
v\|v\|_\inftyMaximum absolute component value
AF\|A\|_FFrobenius norm
uvu\perp vuu is orthogonal to vv
WW^\perpOrthogonal complement of WW
projW(v)\operatorname{proj}_W(v)Projection of vv onto WW

K.8 Eigenvalues and Spectral Notation

SymbolMeaning
λ,μ\lambda,\muEigenvalues or scalar parameters
Av=λvAv=\lambda vEigenvalue equation
EλE_\lambdaEigenspace for λ\lambda
pA(λ)p_A(\lambda)Characteristic polynomial of AA
χA(λ)\chi_A(\lambda)Alternative notation for characteristic polynomial
mA(λ)m_A(\lambda)Minimal polynomial of AA
ρ(A)\rho(A)Spectral radius of AA
Λ\LambdaDiagonal matrix of eigenvalues

Eigenvectors are nonzero vectors whose direction is preserved by a linear transformation, up to scalar multiplication. Eigenvalues are the corresponding scalars.

K.9 Matrix Factorizations

SymbolMeaning
A=LUA=LULU factorization
A=PLUA=PLULU factorization with permutation
A=QRA=QRQR factorization
A=LLTA=LL^TCholesky factorization, real case
A=LLA=LL^*Cholesky factorization, complex case
A=UΣVA=U\Sigma V^*Singular value decomposition
A=PDP1A=PDP^{-1}Diagonalization
A=QTQA=QTQ^*Schur decomposition
Σ\SigmaDiagonal matrix of singular values

K.10 Polynomial Notation

SymbolMeaning
F[x]F[x]Polynomials in xx with coefficients in FF
p(x),q(x)p(x),q(x)Polynomials
deg(p)\deg(p)Degree of pp
p(A)p(A)Polynomial evaluated at matrix AA
(xλ)p(x)(x-\lambda)\mid p(x)xλx-\lambda divides p(x)p(x)
gcd(p,q)\gcd(p,q)Greatest common divisor of polynomials
λ\lambdaRoot of a polynomial or eigenvalue

K.11 Determinants and Permutations

SymbolMeaning
SnS_nSymmetric group on nn elements
σ\sigmaPermutation
sgn(σ)\operatorname{sgn}(\sigma)Sign of a permutation
εijk\varepsilon_{ijk}Levi-Civita symbol
δij\delta_{ij}Kronecker delta
MijM_{ij}Minor of entry aija_{ij}
CijC_{ij}Cofactor of entry aija_{ij}
adj(A)\operatorname{adj}(A)Adjugate of AA

K.12 Numerical Computation

SymbolMeaning
x^\widehat{x}Computed approximation to xx
r=bAx^r=b-A\widehat{x}Residual
ϵ\epsilonSmall error or tolerance
uuUnit roundoff
κ(A)\kappa(A)Condition number of AA
fl(x)\operatorname{fl}(x)Floating-point representation of xx
O()O(\cdot)Big-O asymptotic bound
τ\tauNumerical tolerance

K.13 Calculus and Optimization

SymbolMeaning
f(x)f'(x)Derivative of ff
fxi\frac{\partial f}{\partial x_i}Partial derivative
f(x)\nabla f(x)Gradient
2f(x)\nabla^2 f(x)Hessian
JF(x)J_F(x)Jacobian matrix
argminxf(x)\arg\min_x f(x)Value of xx minimizing ff
minxf(x)\min_x f(x)Minimum value of ff
Axb2\|Ax-b\|^2Least squares objective

K.14 Common Greek Symbols

SymbolCommon use
α,β,γ\alpha,\beta,\gammaScalars or coefficients
δ\deltaPerturbation or Kronecker delta
ϵ\epsilonSmall positive number or error
θ,ϕ\theta,\phiAngles
λ,μ\lambda,\muEigenvalues
σi\sigma_iSingular values
Σ\SigmaSingular value matrix
Λ\LambdaEigenvalue matrix

K.15 Summary

This symbol index is a reference for notation, not a replacement for definitions. Symbols in linear algebra are compact because they often describe high-dimensional objects. A single expression such as

A=UΣV A=U\Sigma V^*

contains several layers of meaning: a matrix factorization, orthonormal coordinate systems, singular values, rank information, and geometric scaling.

When reading a formula, first identify the type of each object. Determine whether each symbol denotes a scalar, vector, matrix, set, space, function, or operator. Once the types are clear, the meaning of the expression usually becomes much simpler.