MathIsimple
LA-3.5
Available

Dual Spaces

The dual space VV^* consists of all linear functionals on VV—linear maps from VV to the base field. It's a "mirror" of VV that reveals deep structural insights.

3-4 hours Advanced 10 Objectives
Learning Objectives
  • Define linear functionals and the dual space V*
  • Understand the geometric meaning of linear functionals as hyperplanes
  • Construct the dual basis from any given basis
  • Prove dim(V*) = dim(V) for finite-dimensional V
  • Define and compute annihilators of subspaces
  • Understand the dimension formula for annihilators
  • Define the double dual V** and the evaluation map
  • Prove V ≅ V** naturally for finite-dimensional V
  • Distinguish natural vs. non-natural isomorphisms
  • Define and understand the dual (transpose) of a linear map
Prerequisites
  • Linear maps and L(V, W) (LA-3.1)
  • Isomorphisms and dimension (LA-3.4)
  • Basis and dimension (LA-2.4)
  • Kernel and image (LA-3.2)
  • Rank-Nullity Theorem (LA-3.3)
Historical Context

The concept of duality pervades mathematics. In geometry, points and lines are dual; in logic, AND and OR are dual. Linear algebra's dual space captures this idea perfectly.

The distinction between "natural" and "unnatural" isomorphisms was formalized by Samuel Eilenberg and Saunders Mac Lane when they invented category theory in the 1940s. The natural isomorphism VVV \cong V^{**} was one of the motivating examples!

1. Linear Functionals

A linear functional is the simplest type of linear map: it takes vectors to scalars.

Definition 3.11: Linear Functional

A linear functional on a vector space VV over field FF is a linear map ϕ:VF\phi: V \to F.

Equivalently, ϕ\phi satisfies:

  • ϕ(v+w)=ϕ(v)+ϕ(w)\phi(v + w) = \phi(v) + \phi(w) for all v,wVv, w \in V
  • ϕ(cv)=cϕ(v)\phi(cv) = c\phi(v) for all cF,vVc \in F, v \in V
Example 3.25: Examples of Linear Functionals
  1. Coordinate extraction: ϕ(x1,,xn)=xi\phi(x_1, \ldots, x_n) = x_i (projects onto ii-th coordinate)
  2. Dot product: ϕa(x)=ax\phi_a(x) = a \cdot x for fixed aRna \in \mathbb{R}^n
  3. Evaluation: evc(p)=p(c)\text{ev}_c(p) = p(c) for polynomials pp
  4. Integration: ϕ(f)=01f(x)dx\phi(f) = \int_0^1 f(x)\,dx on C[0,1]C[0,1]
  5. Trace: tr(A)=iaii\text{tr}(A) = \sum_i a_{ii} on Mn×nM_{n \times n}
Remark 3.16: Geometric Meaning

A nonzero linear functional ϕ:VF\phi: V \to F defines a family of parallel hyperplanes:

Hc={vV:ϕ(v)=c}H_c = \{v \in V : \phi(v) = c\}

The kernel kerϕ=H0\ker \phi = H_0 is the hyperplane through the origin. Since ϕ\phi is nonzero and surjective onto FF, we have dim(kerϕ)=n1\dim(\ker \phi) = n - 1 (codimension 1).

2. The Dual Space

Definition 3.12: Dual Space

The dual space of VV is the vector space of all linear functionals on VV:

V=L(V,F)={ϕ:VFϕ is linear}V^* = \mathcal{L}(V, F) = \{\phi: V \to F \mid \phi \text{ is linear}\}
Theorem 3.44: Dimension of Dual Space

If VV is a finite-dimensional vector space over FF, then:

dim(V)=dim(V)\dim(V^*) = \dim(V)
Proof:

We have V=L(V,F)V^* = \mathcal{L}(V, F). The dimension formula for L(V,W)\mathcal{L}(V, W) gives:

dim(V)=dim(V)dim(F)=dim(V)1=dim(V)\dim(V^*) = \dim(V) \cdot \dim(F) = \dim(V) \cdot 1 = \dim(V)
Corollary 3.7: V and V* are Isomorphic

For finite-dimensional VV: VVV \cong V^* (as vector spaces).

Remark 3.17: Important Caveat

While VVV \cong V^*, there is no canonical isomorphism! To construct an isomorphism, you must choose a basis. Different bases give different isomorphisms.

3. The Dual Basis

Given a basis of VV, we can construct a corresponding basis of VV^* called the dual basis.

Definition 3.13: Dual Basis

Let B={e1,,en}B = \{e_1, \ldots, e_n\} be a basis of VV. The dual basisB={e1,,en}B^* = \{e_1^*, \ldots, e_n^*\} of VV^* is defined by:

ei(ej)=δij={1if i=j0if ije_i^*(e_j) = \delta_{ij} = \begin{cases} 1 & \text{if } i = j \\ 0 & \text{if } i \neq j \end{cases}
Theorem 3.45: Dual Basis is a Basis

The dual basis {e1,,en}\{e_1^*, \ldots, e_n^*\} is indeed a basis for VV^*.

Proof:

Existence: For each ii, define eie_i^* by specifying its values on the basis:ei(ej)=δije_i^*(e_j) = \delta_{ij}. By the extension theorem, this uniquely defines a linear functional.

Linear independence: Suppose iciei=0\sum_i c_i e_i^* = 0. Apply both sides to eje_j:

0=(iciei)(ej)=iciei(ej)=iciδij=cj0 = \left(\sum_i c_i e_i^*\right)(e_j) = \sum_i c_i e_i^*(e_j) = \sum_i c_i \delta_{ij} = c_j

So all cj=0c_j = 0, proving linear independence.

Spanning: Let ϕV\phi \in V^*. For any v=jajejv = \sum_j a_j e_j:

ϕ(v)=jajϕ(ej)=jϕ(ej)ej(v)=(jϕ(ej)ej)(v)\phi(v) = \sum_j a_j \phi(e_j) = \sum_j \phi(e_j) e_j^*(v) = \left(\sum_j \phi(e_j) e_j^*\right)(v)

So ϕ=jϕ(ej)ej\phi = \sum_j \phi(e_j) e_j^*, proving spanning.

Remark 3.18: Coordinates via Dual Basis

The dual basis extracts coordinates! If v=iaieiv = \sum_i a_i e_i, then:

ej(v)=aje_j^*(v) = a_j

So eje_j^* picks out the jj-th coordinate of vv with respect to the basis BB.

Example 3.26: Dual Basis in R²

Problem: Find the dual basis to {(1,1),(1,1)}\{(1, 1), (1, -1)\} in R2\mathbb{R}^2.

Solution: Let e1=(1,1)e_1 = (1, 1) and e2=(1,1)e_2 = (1, -1).

We need e1,e2:R2Re_1^*, e_2^*: \mathbb{R}^2 \to \mathbb{R} with:

  • e1(1,1)=1e_1^*(1, 1) = 1, e1(1,1)=0e_1^*(1, -1) = 0
  • e2(1,1)=0e_2^*(1, 1) = 0, e2(1,1)=1e_2^*(1, -1) = 1

Writing e1(x,y)=ax+bye_1^*(x, y) = ax + by:

a+b=1a + b = 1 and ab=0a - b = 0, so a=b=1/2a = b = 1/2.

Answer: e1(x,y)=x+y2e_1^*(x, y) = \frac{x + y}{2}, e2(x,y)=xy2e_2^*(x, y) = \frac{x - y}{2}

4. The Double Dual V**

The double dual V=(V)V^{**} = (V^*)^* has a special relationship with VV.

Definition 3.14: Double Dual

The double dual of VV is:

V=(V)=L(V,F)V^{**} = (V^*)^* = \mathcal{L}(V^*, F)
Definition 3.15: Evaluation Map

For each vVv \in V, define evv:VF\text{ev}_v: V^* \to F by:

evv(ϕ)=ϕ(v)\text{ev}_v(\phi) = \phi(v)

This is a linear functional on VV^*, so evvV\text{ev}_v \in V^{**}.

Theorem 3.46: Natural Isomorphism V ≅ V**

The map Φ:VV\Phi: V \to V^{**} defined by Φ(v)=evv\Phi(v) = \text{ev}_v is:

  1. Linear
  2. Injective (for any V)
  3. An isomorphism when V is finite-dimensional

This isomorphism is natural—it doesn't depend on any choices.

Proof:

Linearity: For v,wVv, w \in V and cFc \in F:

Φ(v+w)(ϕ)=ϕ(v+w)=ϕ(v)+ϕ(w)=Φ(v)(ϕ)+Φ(w)(ϕ)\Phi(v + w)(\phi) = \phi(v + w) = \phi(v) + \phi(w) = \Phi(v)(\phi) + \Phi(w)(\phi)

Similarly for scalar multiplication.

Injectivity: Suppose Φ(v)=0\Phi(v) = 0, i.e., evv=0\text{ev}_v = 0. This means ϕ(v)=0\phi(v) = 0 for all ϕV\phi \in V^*.

If v0v \neq 0, extend {v}\{v\} to a basis and define ϕ\phi with ϕ(v)=1\phi(v) = 1. This contradicts ϕ(v)=0\phi(v) = 0. So v=0v = 0.

Surjectivity (finite dim): dim(V)=dim(V)=dim(V)\dim(V^{**}) = \dim(V^*) = \dim(V). Since Φ\Phi is injective and dimensions match, Φ\Phi is surjective.

Remark 3.19: Why 'Natural'?

The isomorphism Φ:VV\Phi: V \to V^{**} is defined by the same formula for all vector spaces. No basis choice is needed. In contrast, VVV \cong V^* requires choosing a basis.

This is formalized in category theory: Φ\Phi is a natural transformation.

5. Annihilators

Annihilators provide a correspondence between subspaces of VV and subspaces of VV^*.

Definition 3.16: Annihilator

Let WVW \subseteq V be a subspace. The annihilator of WW is:

W0={ϕV:ϕ(w)=0 for all wW}W^0 = \{\phi \in V^* : \phi(w) = 0 \text{ for all } w \in W\}
Theorem 3.47: Annihilator is a Subspace

W0W^0 is a subspace of VV^*.

Theorem 3.48: Dimension of Annihilator

For finite-dimensional VV with subspace WVW \subseteq V:

dim(W0)=dim(V)dim(W)\dim(W^0) = \dim(V) - \dim(W)
Proof:

Extend a basis {w1,,wk}\{w_1, \ldots, w_k\} of WW to a basis{w1,,wk,vk+1,,vn}\{w_1, \ldots, w_k, v_{k+1}, \ldots, v_n\} of VV.

Let {w1,,wk,vk+1,,vn}\{w_1^*, \ldots, w_k^*, v_{k+1}^*, \ldots, v_n^*\} be the dual basis.

Then ϕW0\phi \in W^0 iff ϕ(wi)=0\phi(w_i) = 0 for all ii.

Writing ϕ=jcjwj+ldlvl\phi = \sum_j c_j w_j^* + \sum_l d_l v_l^*:

ϕ(wi)=ci=0 for all i\phi(w_i) = c_i = 0 \text{ for all } i

So W0=span{vk+1,,vn}W^0 = \text{span}\{v_{k+1}^*, \ldots, v_n^*\}, which has dimension nkn - k.

Example 3.27: Computing an Annihilator

Problem: Let W=span{(1,0,1)}R3W = \text{span}\{(1, 0, 1)\} \subseteq \mathbb{R}^3. Find W0W^0.

Solution:

ϕ(x,y,z)=ax+by+czW0\phi(x, y, z) = ax + by + cz \in W^0 iff ϕ(1,0,1)=0\phi(1, 0, 1) = 0.

So a+c=0a + c = 0, giving c=ac = -a.

Answer: W0={(x,y,z)ax+byaz:a,bR}W^0 = \{(x, y, z) \mapsto ax + by - az : a, b \in \mathbb{R}\}

dim(W0)=31=2\dim(W^0) = 3 - 1 = 2

Theorem 3.49: Double Annihilator

Under the natural identification VVV \cong V^{**}:

(W0)0=W(W^0)^0 = W

6. The Dual Map (Transpose)

Every linear map T:VWT: V \to W induces a map between the dual spaces in the opposite direction.

Definition 3.17: Dual Map

Let T:VWT: V \to W be linear. The dual map (or transpose) is:

T:WV,T(ϕ)=ϕTT^*: W^* \to V^*, \quad T^*(\phi) = \phi \circ T

That is, T(ϕ)(v)=ϕ(T(v))T^*(\phi)(v) = \phi(T(v)) for all vVv \in V.

Theorem 3.50: Properties of Dual Maps

For linear maps S,TS, T and scalar cc:

  1. (S+T)=S+T(S + T)^* = S^* + T^*
  2. (cT)=cT(cT)^* = cT^*
  3. (ST)=TS(ST)^* = T^* S^* (note the reversal!)
  4. (IV)=IV(I_V)^* = I_{V^*}
  5. If TT is invertible, then (T)1=(T1)(T^*)^{-1} = (T^{-1})^*
Theorem 3.51: Kernel and Image of Dual Map

For T:VWT: V \to W:

  • ker(T)=(im T)0\ker(T^*) = (\text{im } T)^0
  • im(T)=(kerT)0\text{im}(T^*) = (\ker T)^0
Corollary 3.8: Rank of Dual Map

rank(T)=rank(T)\text{rank}(T^*) = \text{rank}(T)

Remark 3.20: Matrix Interpretation

If TT is represented by matrix AA (with respect to bases BVB_V and BWB_W), then TT^* is represented by ATA^T (with respect to dual bases BWB_W^* and BVB_V^*).

This is why TT^* is sometimes called the transpose of TT.

7. Worked Examples

Dual of Differentiation

Problem: Let D:P2P1D: P_2 \to P_1 be differentiation. Describe D:P1P2D^*: P_1^* \to P_2^*.

Solution:

For ϕP1\phi \in P_1^* and pP2p \in P_2:

D(ϕ)(p)=ϕ(D(p))=ϕ(p)D^*(\phi)(p) = \phi(D(p)) = \phi(p')

If ϕ(q)=01q(x)dx\phi(q) = \int_0^1 q(x)\,dx (integration), then:

D(ϕ)(a+bx+cx2)=ϕ(b+2cx)=01(b+2cx)dx=b+cD^*(\phi)(a + bx + cx^2) = \phi(b + 2cx) = \int_0^1 (b + 2cx)\,dx = b + c
Annihilator of Row Space

Problem: Let AA be an m×nm \times n matrix. How is (row(A))0(\text{row}(A))^0 related to ker(A)\ker(A)?

Solution:

Identify (Rn)Rn(\mathbb{R}^n)^* \cong \mathbb{R}^n via the dot product.

Then ϕa(x)=ax(row(A))0\phi_a(x) = a \cdot x \in (\text{row}(A))^0 iff ar=0a \cdot r = 0 for all rows rr.

This means ATa=0A^T a = 0, so aker(AT)a \in \ker(A^T).

Result: (row(A))0ker(AT)=(col(A))(\text{row}(A))^0 \cong \ker(A^T) = (\text{col}(A))^\perp

Dual Basis Computation

Problem: Find the dual basis to {1,1+x,1+x+x2}\{1, 1+x, 1+x+x^2\} in P2P_2.

Solution:

Need e1,e2,e3e_1^*, e_2^*, e_3^* with ei(ej)=δije_i^*(e_j) = \delta_{ij}.

Write ei(p)=aip(0)+bip(0)+cip(0)/2e_i^*(p) = a_i p(0) + b_i p'(0) + c_i p''(0)/2 (Taylor coefficients).

Solving the system:

  • e1(p)=p(0)p(0)+p(0)/2e_1^*(p) = p(0) - p'(0) + p''(0)/2
  • e2(p)=p(0)p(0)e_2^*(p) = p'(0) - p''(0)
  • e3(p)=p(0)/2e_3^*(p) = p''(0)/2

8. Common Mistakes

Mistake 1: V = V*

VVV \cong V^* does NOT mean they're equal! VV contains vectors,VV^* contains linear functionals. They're different types of objects.

Mistake 2: Dual Map Direction

If T:VWT: V \to W, then T:WVT^*: W^* \to V^* goes the opposite direction! This reversal is essential and easy to forget.

Mistake 3: Natural vs. Non-Natural

VVV \cong V^{**} is natural (canonical), but VVV \cong V^* is NOT. Don't assume there's a "preferred" isomorphism between VV and VV^*.

Mistake 4: Infinite Dimensions

In infinite dimensions, VV^* can be much larger than VV! The natural map VVV \to V^{**} is still injective but may not be surjective.

9. Key Takeaways

Dual Space

V=L(V,F)V^* = \mathcal{L}(V, F), dim(V)=dim(V)\dim(V^*) = \dim(V)

Dual Basis

ei(ej)=δije_i^*(e_j) = \delta_{ij}

Double Dual

VVV \cong V^{**} naturally via vevvv \mapsto \text{ev}_v

Annihilator

dim(W0)=dim(V)dim(W)\dim(W^0) = \dim(V) - \dim(W)

10. Additional Practice Problems

Problem 1

Let V=P3V = P_3 and ϕ(p)=p(0)+p(1)\phi(p) = p(0) + p(1). Find ker(ϕ)\ker(\phi) and describe its dual basis.

Problem 2

Prove that if W1W2W_1 \subseteq W_2, then W20W10W_2^0 \subseteq W_1^0.

Problem 3

Show that (W1+W2)0=W10W20(W_1 + W_2)^0 = W_1^0 \cap W_2^0 and (W1W2)0=W10+W20(W_1 \cap W_2)^0 = W_1^0 + W_2^0.

Problem 4

If T:VWT: V \to W is surjective, prove T:WVT^*: W^* \to V^* is injective.

Problem 5

Let {ϕ1,ϕ2,ϕ3}\{\phi_1, \phi_2, \phi_3\} be a basis of (R3)(\mathbb{R}^3)^*. Find the basis of R3\mathbb{R}^3 dual to this.

Problem 6

Show that the trace map tr:MnF\text{tr}: M_n \to F is the unique (up to scalar) linear functional that vanishes on all commutators [A,B]=ABBA[A, B] = AB - BA.

11. More Worked Examples

Integration as Linear Functional

Problem: On P2P_2, define ϕ1(p)=01p\phi_1(p) = \int_0^1 p, ϕ2(p)=02p\phi_2(p) = \int_0^2 p, ϕ3(p)=12p\phi_3(p) = \int_1^2 p. Are these linearly independent?

Solution:

Notice ϕ3=ϕ2ϕ1\phi_3 = \phi_2 - \phi_1 (by additivity of integrals over intervals).

So ϕ1ϕ2+ϕ3=0\phi_1 - \phi_2 + \phi_3 = 0.

Answer: No, they are linearly dependent.

Dual of Projection

Problem: Let P:VVP: V \to V be a projection (P2=PP^2 = P). What is PP^*?

Solution:

(P)2=(P2)=P(P^*)^2 = (P^2)^* = P^*

So PP^* is also a projection!

ker(P)=(im P)0\ker(P^*) = (\text{im } P)^0 and im(P)=(kerP)0\text{im}(P^*) = (\ker P)^0.

Hyperplane Determined by Functional

Problem: Two functionals ϕ,ψV\phi, \psi \in V^* have the same kernel. What can we conclude?

Solution:

If kerϕ=kerψ\ker \phi = \ker \psi and both are nonzero, then both kernels are hyperplanes of the same dimension.

Since dim(kerϕ)=n1\dim(\ker \phi) = n - 1, the quotient V/kerϕV / \ker \phi is 1-dimensional.

Both ϕ\phi and ψ\psi factor through this quotient, so:

Answer: ψ=cϕ\psi = c\phi for some nonzero cFc \in F.

Annihilator of Kernel

Problem: For nonzero ϕV\phi \in V^*, find (kerϕ)0(\ker \phi)^0.

Solution:

dim(kerϕ)0=dimVdim(kerϕ)=n(n1)=1\dim(\ker \phi)^0 = \dim V - \dim(\ker \phi) = n - (n-1) = 1

Any ψ(kerϕ)0\psi \in (\ker \phi)^0 vanishes on kerϕ\ker \phi, so kerϕkerψ\ker \phi \subseteq \ker \psi.

This forces ψ=cϕ\psi = c\phi for some cc.

Answer: (kerϕ)0=span{ϕ}(\ker \phi)^0 = \text{span}\{\phi\}

12. Connections to Other Topics

Inner Products

An inner product ,\langle \cdot, \cdot \rangle on VV gives a canonical isomorphism:

VV,vv,V \to V^*, \quad v \mapsto \langle v, \cdot \rangle

This is called the Riesz representation theorem in infinite dimensions.

Quantum Mechanics: Bra-Ket Notation

In Dirac notation:

  • ψ|\psi\rangle is a ket (vector in VV)
  • ϕ\langle \phi| is a bra (linear functional in VV^*)
  • ϕψ\langle \phi | \psi \rangle is the pairing (inner product)
Differential Geometry: Cotangent Space

The cotangent space TpMT_p^* M at a point pp of a manifold MM is the dual of the tangent space.

  • Tangent vectors = velocities of curves
  • Cotangent vectors = differentials of functions
  • The differential dfdf of a function ff is a cotangent vector
Optimization: Duality Theory

Linear programming has a dual problem involving:

  • Primal variables ↔ Dual constraints
  • Primal constraints ↔ Dual variables
  • Strong duality: optimal values are equal

This extends to convex optimization (Lagrange duality).

13. Theoretical Insights

Theorem 3.52: Annihilator and Quotient

For any subspace WVW \subseteq V:

W0(V/W)W^0 \cong (V/W)^*
Proof:

Define Ψ:W0(V/W)\Psi: W^0 \to (V/W)^* by Ψ(ϕ)([v])=ϕ(v)\Psi(\phi)([v]) = \phi(v).

This is well-defined: if [v]=[v][v] = [v'], then vvWv - v' \in W, so ϕ(v)=ϕ(v)\phi(v) = \phi(v').

Injectivity: If Ψ(ϕ)=0\Psi(\phi) = 0, then ϕ(v)=0\phi(v) = 0 for all vv, so ϕ=0\phi = 0.

Surjectivity: Any ψ(V/W)\psi \in (V/W)^* lifts to ϕ=ψπW0\phi = \psi \circ \pi \in W^0 where π:VV/W\pi: V \to V/W.

Theorem 3.53: Duality Between Subspaces

The maps WW0W \mapsto W^0 and UU0U \mapsto U^0 (in the other direction) are mutually inverse bijections between:

  • Subspaces of VV
  • Subspaces of VV^*

This is an order-reversing correspondence (inclusion ↔ reverse inclusion).

Remark 3.21: Functor Properties

Taking duals is a contravariant functor:

  • It reverses the direction of maps
  • It reverses composition: (ST)=TS(S \circ T)^* = T^* \circ S^*
  • It preserves identity: (IV)=IV(I_V)^* = I_{V^*}

14. Study Tips

Tip 1: Think of Duals as Coordinates

The dual basis functionals eie_i^* extract coordinates. This makes VV^* very concrete.

Tip 2: Annihilators = Constraints

Think of W0W^0 as all linear equations that WW satisfies. Each ϕW0\phi \in W^0 is a constraint.

Tip 3: Dimension Formulas

Use dim(W0)=ndim(W)\dim(W^0) = n - \dim(W) and rank(T)=rank(T)\text{rank}(T) = \text{rank}(T^*) freely.

Tip 4: Direction Reversal

Always remember: T:VWT: V \to W gives T:WVT^*: W^* \to V^* (opposite direction!).

15. Quick Reference Summary

ConceptDefinition/Result
Dual spaceV=L(V,F)V^* = \mathcal{L}(V, F)
Dimensiondim(V)=dim(V)\dim(V^*) = \dim(V)
Dual basisei(ej)=δije_i^*(e_j) = \delta_{ij}
Double dualVVV \cong V^{**} naturally
Annihilator dimdim(W0)=ndim(W)\dim(W^0) = n - \dim(W)
Dual mapT:WVT^*: W^* \to V^*, T(ϕ)=ϕTT^*(\phi) = \phi \circ T
Rank preservedrank(T)=rank(T)\text{rank}(T^*) = \text{rank}(T)

16. Challenge Problems

Challenge 1: Reflexivity

Problem: A Banach space VV is called reflexive if the natural map VVV \to V^{**} is surjective. Give an example of a non-reflexive Banach space.

Hint: Consider 1\ell^1 or c0c_0.

Challenge 2: Annihilator Properties

Problem: Prove that (W1W2)0=W10+W20(W_1 \cap W_2)^0 = W_1^0 + W_2^0 by computing dimensions on both sides and showing inclusion.

Challenge 3: Dual of Direct Sum

Problem: Prove that (VW)VW(V \oplus W)^* \cong V^* \oplus W^* naturally.

Hint: Define the isomorphism by restriction.

17. Geometric Interpretation

Points and Hyperplanes

In projective geometry, there's a perfect duality:

  • Points in Pn\mathbb{P}^n ↔ Hyperplanes in (Pn)(\mathbb{P}^n)^*
  • Lines ↔ Codimension-2 subspaces
  • "Two points determine a line" ↔ "Two hyperplanes intersect in codim-2"
Covectors as Gradients

A linear functional ϕ:RnR\phi: \mathbb{R}^n \to \mathbb{R} can be written as:

ϕ(x)=fx\phi(x) = \nabla f \cdot x

where f(x)=ϕ(x)f(x) = \phi(x). So ϕ\phi is the "gradient" of a linear function.

The level sets ϕ1(c)\phi^{-1}(c) are the hyperplanes perpendicular to this gradient.

Pairing Diagram

The pairing between VV and VV^* is the bilinear map:

,:V×VF,ϕ,v=ϕ(v)\langle \cdot, \cdot \rangle: V^* \times V \to F, \quad \langle \phi, v \rangle = \phi(v)

This is non-degenerate: if ϕ,v=0\langle \phi, v \rangle = 0 for all ϕ\phi, then v=0v = 0.

18. Historical Note

The concept of duality has ancient roots. In projective geometry, Gergonne and Poncelet (early 1800s) discovered the duality between points and lines.

Stefan Banach (1920s-30s) developed the theory of dual spaces in the infinite-dimensional setting, leading to the powerful Hahn-Banach theorem.

The categorical perspective—distinguishing natural from unnatural isomorphisms—was formalized by Eilenberg and Mac Lane in their 1945 paper "General Theory of Natural Equivalences," which founded category theory. The isomorphism VVV \cong V^{**} was one of their key examples!

What's Next?

With dual spaces mastered, you're ready for:

  • Part IV: Matrices: Represent linear maps as matrices
  • Matrix Transpose: The matrix representation of the dual map
  • Bilinear Forms: Connections between V and V* via inner products
  • Spectral Theory: Eigenvectors and eigenvalues

Dual spaces may seem abstract, but they're essential in advanced mathematics—from differential geometry to quantum mechanics to optimization.

Dual Spaces Practice
12
Questions
0
Correct
0%
Accuracy
1
What is dim(V)\dim(V^*) if dim(V)=n\dim(V) = n?
Easy
Not attempted
2
If {e1,e2}\{e_1, e_2\} is a basis of VV, what is e1(e2)e_1^*(e_2)?
Easy
Not attempted
3
The dual of a linear map T:VWT: V \to W is T:??T^*: ? \to ?
Medium
Not attempted
4
Is the map VVV \to V^{**} given by vevvv \mapsto \text{ev}_v injective?
Medium
Not attempted
5
What is dim((R3))\dim((\mathbb{R}^3)^{**})?
Easy
Not attempted
6
The annihilator of a subspace WVW \subseteq V is:
Medium
Not attempted
7
If dim(V)=n\dim(V) = n and dim(W)=k\dim(W) = k, what is dim(W0)\dim(W^0)?
Hard
Not attempted
8
Is VVV \cong V^*?
Hard
Not attempted
9
If ϕV\phi \in V^* and ϕ0\phi \neq 0, what is dim(kerϕ)\dim(\ker \phi)?
Medium
Not attempted
10
The kernel of a nonzero linear functional is called:
Easy
Not attempted
11
For the dual map TT^*, we have ker(T)=?\ker(T^*) = ?
Hard
Not attempted
12
If {e1,e2,e3}\{e_1^*, e_2^*, e_3^*\} is the dual basis to {e1,e2,e3}\{e_1, e_2, e_3\}, then (e1+e2)(e1+e2+e3)=?(e_1^* + e_2^*)(e_1 + e_2 + e_3) = ?
Medium
Not attempted

Frequently Asked Questions

What's a linear functional?

A linear map from V to the base field F. It assigns a scalar to each vector, linearly. Examples: evaluation at a point, integration, trace of a matrix.

Why is V ≅ V** 'natural' but V ≅ V* is not?

The isomorphism V → V** via v ↦ ev_v doesn't depend on any choices—it's defined the same way for all vector spaces. But V → V* requires choosing a basis (or an inner product). 'Natural' means 'functorial' in category theory.

What's the dual basis used for?

It gives coordinates! If {e₁,...,eₙ} is a basis and {e₁*,...,eₙ*} is dual, then v = Σeᵢ*(v)eᵢ. The functionals eᵢ* extract the i-th coordinate.

How do annihilators relate to solving equations?

W⁰ consists of all linear constraints satisfied by W. If W is the solution space of Ax = 0, then W⁰ is spanned by the rows of A (in a sense).

What happens to duals in infinite dimensions?

V* can be much larger than V! The algebraic dual may not be useful; instead, we use continuous duals in functional analysis, where V* consists only of continuous linear functionals.

What is the geometric meaning of a linear functional?

A nonzero linear functional φ defines a family of parallel hyperplanes: the level sets {v : φ(v) = c} for various constants c. The kernel φ⁻¹(0) is the hyperplane through the origin.

How does the dual map T* relate to the transpose matrix?

When we represent T by a matrix A with respect to chosen bases, the dual map T* is represented by the transpose Aᵀ with respect to the dual bases. This is why T* is sometimes called the 'transpose' of T.

What is the double annihilator (W⁰)⁰?

For finite-dimensional V, the double annihilator (W⁰)⁰ in V** corresponds to W under the natural isomorphism V ≅ V**. So (W⁰)⁰ 'is' W in a precise sense.

Why do we care about dual spaces?

Dual spaces are essential in: (1) defining coordinates, (2) linear programming and optimization (duality theory), (3) differential geometry (cotangent spaces), (4) quantum mechanics (bra-ket notation), (5) functional analysis.

Is every subspace of V* an annihilator?

Yes! For finite-dimensional V, every subspace U ⊆ V* equals W⁰ for some W ⊆ V. Specifically, U = (U⁰)⁰ where U⁰ is taken in V.