Skip to content

Chapter 28. Dual Spaces

The dual space of a vector space is the vector space of all linear maps from that space to its field of scalars. If VV is a vector space over FF, then its dual space is written

V V^*

and is defined by

V={φ:VF:φ is linear}. V^*=\{\varphi:V\to F:\varphi \text{ is linear}\}.

The elements of VV^* are called linear functionals, covectors, or linear forms. A linear functional takes a vector as input and returns a scalar. The dual space itself is a vector space under pointwise addition and scalar multiplication.

28.1 Linear Functionals

A linear functional on VV is a linear map

φ:VF. \varphi:V\to F.

It satisfies

φ(u+v)=φ(u)+φ(v) \varphi(u+v)=\varphi(u)+\varphi(v)

and

φ(cv)=cφ(v). \varphi(cv)=c\varphi(v).

The output is a scalar, not a vector.

For example, define

φ:R3R \varphi:\mathbb{R}^3\to\mathbb{R}

by

φ(x,y,z)=2xy+5z. \varphi(x,y,z)=2x-y+5z.

Then φ\varphi is linear. It takes a vector in R3\mathbb{R}^3 and returns one real number.

28.2 The Dual Space

The dual space VV^* is the set of all linear functionals on VV:

V=Hom(V,F). V^*=\operatorname{Hom}(V,F).

If φ,ψV\varphi,\psi\in V^*, define

(φ+ψ)(v)=φ(v)+ψ(v). (\varphi+\psi)(v)=\varphi(v)+\psi(v).

If cFc\in F, define

(cφ)(v)=cφ(v). (c\varphi)(v)=c\varphi(v).

With these operations, VV^* is a vector space.

The zero vector of VV^* is the zero functional:

0(v)=0 0(v)=0

for every vVv\in V.

28.3 Functionals on Rn\mathbb{R}^n

Every linear functional on Rn\mathbb{R}^n has the form

φ(x)=a1x1+a2x2++anxn. \varphi(x)=a_1x_1+a_2x_2+\cdots+a_nx_n.

Equivalently,

φ(x)=aTx, \varphi(x)=a^Tx,

where

a=[a1a2an]. a= \begin{bmatrix} a_1\\ a_2\\ \vdots\\ a_n \end{bmatrix}.

Thus a linear functional on Rn\mathbb{R}^n may be represented by a row vector:

φ=[a1a2an]. \varphi= \begin{bmatrix} a_1&a_2&\cdots&a_n \end{bmatrix}.

This representation depends on the standard basis.

28.4 Covectors

Vectors in VV and vectors in VV^* have different roles.

A vector vVv\in V is an input object. A covector φV\varphi\in V^* is a scalar-valued linear measurement.

The pairing is written

φ(v). \varphi(v).

Some texts also write

φ,v. \langle \varphi,v\rangle.

The pairing takes one covector and one vector and returns a scalar. It is linear in each argument.

28.5 The Dual Basis

Let

B=(v1,,vn) B=(v_1,\ldots,v_n)

be a basis of VV. The dual basis is the basis

B=(v1,,vn) B^*=(v^1,\ldots,v^n)

of VV^* defined by

vi(vj)=δji. v^i(v_j)=\delta^i_j.

Here δji\delta^i_j is the Kronecker delta:

δji={1,i=j,0,ij. \delta^i_j= \begin{cases} 1,& i=j,\\ 0,& i\neq j. \end{cases}

Thus viv^i extracts the ii-th coordinate relative to the basis BB.

28.6 Meaning of the Dual Basis

If

v=c1v1++cnvn, v=c_1v_1+\cdots+c_nv_n,

then

vi(v)=ci. v^i(v)=c_i.

So the dual basis functional viv^i reads off the ii-th coordinate of vv.

For example, in R3\mathbb{R}^3 with the standard basis,

e1(x,y,z)=x, e^1(x,y,z)=x, e2(x,y,z)=y, e^2(x,y,z)=y, e3(x,y,z)=z. e^3(x,y,z)=z.

The dual basis consists of the coordinate projection maps.

28.7 Basis of the Dual Space

If VV has basis

B=(v1,,vn), B=(v_1,\ldots,v_n),

then the dual basis

B=(v1,,vn) B^*=(v^1,\ldots,v^n)

is a basis of VV^*. Therefore

dimV=dimV \dim V^*=\dim V

when VV is finite-dimensional.

Every functional φV\varphi\in V^* can be written uniquely as

φ=a1v1++anvn. \varphi=a_1v^1+\cdots+a_nv^n.

The coefficients are

ai=φ(vi). a_i=\varphi(v_i).

Indeed, for

v=c1v1++cnvn, v=c_1v_1+\cdots+c_nv_n,

we have

φ(v)=c1φ(v1)++cnφ(vn). \varphi(v)=c_1\varphi(v_1)+\cdots+c_n\varphi(v_n).

28.8 Example in R2\mathbb{R}^2

Let V=R2V=\mathbb{R}^2 with standard basis

e1=[10],e2=[01]. e_1= \begin{bmatrix} 1\\ 0 \end{bmatrix}, \qquad e_2= \begin{bmatrix} 0\\ 1 \end{bmatrix}.

The dual basis is

e1(x,y)=x,e2(x,y)=y. e^1(x,y)=x, \qquad e^2(x,y)=y.

Let

φ(x,y)=3x5y. \varphi(x,y)=3x-5y.

Then

φ=3e15e2. \varphi=3e^1-5e^2.

The coordinate vector of φ\varphi in the dual basis is

[φ]B=[35]. [\varphi]_{B^*} = \begin{bmatrix} 3\\ -5 \end{bmatrix}.

28.9 Example with a Nonstandard Basis

Let

B=(v1,v2) B=(v_1,v_2)

where

v1=[11],v2=[11]. v_1= \begin{bmatrix} 1\\ 1 \end{bmatrix}, \qquad v_2= \begin{bmatrix} 1\\ -1 \end{bmatrix}.

We seek the dual basis

B=(v1,v2). B^*=(v^1,v^2).

Write

v1(x,y)=ax+by. v^1(x,y)=ax+by.

The conditions are

v1(v1)=1,v1(v2)=0. v^1(v_1)=1, \qquad v^1(v_2)=0.

Thus

a+b=1,ab=0. a+b=1, \qquad a-b=0.

Solving gives

a=b=12. a=b=\frac12.

So

v1(x,y)=12x+12y. v^1(x,y)=\frac12x+\frac12y.

Similarly, write

v2(x,y)=cx+dy. v^2(x,y)=cx+dy.

The conditions are

c+d=0,cd=1. c+d=0, \qquad c-d=1.

Solving gives

c=12,d=12. c=\frac12, \qquad d=-\frac12.

Thus

v2(x,y)=12x12y. v^2(x,y)=\frac12x-\frac12y.

28.10 Dual Basis and Inverse Matrices

Let B=(v1,,vn)B=(v_1,\ldots,v_n) be a basis of Rn\mathbb{R}^n, and let

PB=[v1v2vn]. P_B= \begin{bmatrix} |&|&&|\\ v_1&v_2&\cdots&v_n\\ |&|&&| \end{bmatrix}.

The dual basis functionals are the rows of

PB1. P_B^{-1}.

Indeed, the condition

vi(vj)=δji v^i(v_j)=\delta^i_j

says that the ii-th dual row applied to the jj-th basis column gives the (i,j)(i,j)-entry of the identity matrix.

Thus

PB1PB=I. P_B^{-1}P_B=I.

This is often the fastest way to compute a dual basis in coordinates.

28.11 The Natural Pairing

There is a natural pairing

V×VF V^*\times V\to F

defined by

(φ,v)φ(v). (\varphi,v)\mapsto \varphi(v).

This pairing is bilinear:

(φ+ψ)(v)=φ(v)+ψ(v), (\varphi+\psi)(v)=\varphi(v)+\psi(v), φ(u+v)=φ(u)+φ(v), \varphi(u+v)=\varphi(u)+\varphi(v),

and scalar multiplication can be moved through either side.

The pairing connects a vector space with its dual without requiring an inner product.

28.12 Dual Space Versus Inner Product Identification

In Rn\mathbb{R}^n, every vector aa defines a functional

φa(x)=aTx. \varphi_a(x)=a^Tx.

This uses the standard dot product.

It is tempting to identify VV and VV^*. In finite-dimensional inner product spaces, this can be done. But the identification depends on the inner product.

Without an inner product, VV and VV^* are separate spaces. A vector is not automatically a covector.

This distinction becomes important in geometry, tensor algebra, differential forms, and functional analysis.

28.13 The Double Dual

The dual of the dual space is

V=(V). V^{**}=(V^*)^*.

There is a natural map

J:VV J:V\to V^{**}

defined by

J(v)(φ)=φ(v). J(v)(\varphi)=\varphi(v).

Thus J(v)J(v) is a functional on VV^*: it takes a covector φ\varphi and evaluates it at vv.

If VV is finite-dimensional, then JJ is an isomorphism:

VV. V\cong V^{**}.

This identification is canonical. It does not require choosing a basis.

28.14 Transpose of a Linear Map

Let

T:VW T:V\to W

be a linear map. The dual map, also called the transpose or pullback, is

T:WV T^*:W^*\to V^*

defined by

T(ψ)=ψT. T^*(\psi)=\psi\circ T.

That is, if ψ\psi is a functional on WW, then T(ψ)T^*(\psi) is a functional on VV.

For vVv\in V,

(Tψ)(v)=ψ(Tv). (T^*\psi)(v)=\psi(Tv).

The direction reverses: TT goes from VV to WW, while TT^* goes from WW^* to VV^*.

28.15 Matrix of the Dual Map

Suppose T:VWT:V\to W is represented by a matrix AA with respect to bases of VV and WW. Then T:WVT^*:W^*\to V^* is represented by the transpose matrix

AT A^T

with respect to the corresponding dual bases.

This explains the name transpose.

If

y=Ax y=Ax

describes the original map on column vectors, then the dual map sends row functionals backward:

ψψA. \psi \mapsto \psi A.

In column-coordinate notation for dual bases, this becomes multiplication by ATA^T.

28.16 Annihilators

Let SVS\subseteq V. The annihilator of SS is

S0={φV:φ(s)=0 for all sS}. S^0=\{\varphi\in V^*:\varphi(s)=0\text{ for all }s\in S\}.

It is a subspace of VV^*.

If UVU\subseteq V is a subspace, then U0U^0 consists of all linear functionals that vanish on UU.

For example, in R2\mathbb{R}^2, if

U=span([10]), U=\operatorname{span} \left( \begin{bmatrix} 1\\ 0 \end{bmatrix} \right),

then a functional

φ(x,y)=ax+by \varphi(x,y)=ax+by

vanishes on UU exactly when

a=0. a=0.

Thus

U0={φ(x,y)=by:bR}. U^0=\{\varphi(x,y)=by:b\in\mathbb{R}\}.

28.17 Dimension of an Annihilator

If VV is finite-dimensional and UVU\subseteq V, then

dimU0=dimVdimU. \dim U^0=\dim V-\dim U.

This is analogous to the dimension of an orthogonal complement.

Indeed, if

dimV=n \dim V=n

and

dimU=k, \dim U=k,

then a basis of UU can be extended to a basis of VV. The dual basis functionals that vanish on UU correspond exactly to the basis vectors added outside UU.

Thus the annihilator measures the number of independent linear conditions that ignore UU.

28.18 Quotients and Dual Spaces

There is a natural relation between quotient spaces and annihilators:

(V/U)U0. (V/U)^*\cong U^0.

A functional on V/UV/U corresponds to a functional on VV that vanishes on UU.

Indeed, if

λ:V/UF \lambda:V/U\to F

is linear, then

φ(v)=λ(v+U) \varphi(v)=\lambda(v+U)

defines a linear functional on VV, and φ\varphi vanishes on UU.

Conversely, if φU0\varphi\in U^0, then

λ(v+U)=φ(v) \lambda(v+U)=\varphi(v)

is well-defined.

28.19 Common Notation

NotationMeaning
VV^*Dual space of VV
φ,ψ\varphi,\psiTypical linear functionals
BB^*Dual basis of BB
viv^iii-th dual basis functional
φ(v)\varphi(v)Pairing of functional and vector
TT^*Dual map or transpose of TT
S0S^0Annihilator of SS
VV^{**}Double dual

28.20 Summary

The dual space VV^* is the vector space of all linear functionals on VV. Its elements measure vectors by producing scalars.

The key ideas are:

ConceptMeaning
Linear functionalLinear map VFV\to F
Dual spaceSpace of all linear functionals
CovectorAnother name for element of VV^*
Dual basisFunctionals viv^i satisfying vi(vj)=δjiv^i(v_j)=\delta^i_j
Natural pairingEvaluation φ(v)\varphi(v)
Double dualVV^{**}, naturally containing VV
Dual mapT(ψ)=ψTT^*(\psi)=\psi\circ T
AnnihilatorFunctionals that vanish on a subset

Dual spaces turn vectors into objects that can be measured linearly. They are the natural home of coordinates, linear equations, transpose maps, annihilators, and many constructions that appear later in geometry and analysis.