MathIsimple
π
θ
Δ
ε
Course 3
Theory
6-7 hours

Utility Theory and Risk Preferences

Expected utility theory, risk aversion, and optimal decision-making under uncertainty

Learning Objectives

  • Understand von Neumann-Morgenstern expected utility theory and its axiomatic foundation
  • Master the concepts of risk aversion, risk neutrality, and risk seeking
  • Derive and apply Arrow-Pratt measures of absolute and relative risk aversion
  • Calculate certainty equivalents and risk premiums for various utility functions
  • Apply utility theory to portfolio choice and insurance decisions

1. Preferences Under Certainty

We begin with the simpler case of preferences over certain outcomes, which provides the foundation for understanding preferences under uncertainty.

Axiom 1.1: Completeness

For any two outcomes xx and yy, either xyx \succeq y (x is weakly preferred to y), or yxy \succeq x, or both.

This says the agent can always compare any two options.

Axiom 1.2: Transitivity

If xyx \succeq y and yzy \succeq z, then xzx \succeq z.

This ensures consistency in rankings and rules out preference cycles.

Theorem 1.1: Utility Representation Theorem (Certainty)

If preferences \succeq satisfy completeness and transitivity (and continuity), then there exists a utility function u:XRu: X \to \mathbb{R} such that:

xy    u(x)u(y)x \succeq y \iff u(x) \geq u(y)

Moreover, uu is unique up to positive affine transformation: if vv also represents \succeq, then v=au+bv = au + b for some a>0a > 0 and bb.

Remark 1.1: Ordinal vs Cardinal Utility

Under certainty, utility is ordinal - only the ranking matters, not the magnitude of utility differences. We can apply any increasing transformation without changing preferences.

Under uncertainty (expected utility), utility becomes cardinal - the magnitudes matter because we take expectations. Only affine transformations preserve expected utility preferences.

2. von Neumann-Morgenstern Expected Utility Theory

Definition 2.1: Lottery

A lottery (or risky prospect) LL is a probability distribution over outcomes. For finite outcomes x1,,xn{x_1, \ldots, x_n} with probabilities p1,,pn{p_1, \ldots, p_n}:

L=(x1,p1;x2,p2;;xn,pn)L = (x_1, p_1; x_2, p_2; \ldots; x_n, p_n)

where pi0p_i \geq 0 and i=1npi=1\sum_{i=1}^n p_i = 1.

Axiom 2.1: Independence Axiom

For any lotteries LL, MM, NN and α(0,1)\alpha \in (0,1):

LM    αL+(1α)NαM+(1α)NL \succeq M \iff \alpha L + (1-\alpha)N \succeq \alpha M + (1-\alpha)N

This says preferences between LL and MM are unaffected by mixing both with a common lottery NN.

Axiom 2.2: Continuity (Archimedean)

If LMNL \succ M \succ N, then there exist α,β(0,1)\alpha, \beta \in (0,1) such that:

αL+(1α)NMβL+(1β)N\alpha L + (1-\alpha)N \succ M \succ \beta L + (1-\beta)N

This rules out infinitely preferred or infinitely dispreferred outcomes.

Theorem 2.1: von Neumann-Morgenstern Representation

If preferences over lotteries satisfy completeness, transitivity, continuity, and independence, then there exists a utility function uu such that lottery LL is preferred to lottery MM if and only if:

EL[u]>EM[u]\mathbb{E}_L[u] > \mathbb{E}_M[u]

For lottery L=(x1,p1;;xn,pn)L = (x_1, p_1; \ldots; x_n, p_n):

EL[u]=i=1npiu(xi)\mathbb{E}_L[u] = \sum_{i=1}^n p_i u(x_i)

Moreover, uu is unique up to positive affine transformation.

Proof of VNM Representation (Sketch):

Step 1: Normalize utility by setting u(xbest)=1u(x_{best}) = 1 and u(xworst)=0u(x_{worst}) = 0.

Step 2: For any outcome xx, by continuity, there exists p[0,1]p \in [0,1] such that:

xpxbest+(1p)xworstx \sim p x_{best} + (1-p)x_{worst}

Define u(x)=pu(x) = p.

Step 3: For lottery L=(x1,p1;;xn,pn)L = (x_1, p_1; \ldots; x_n, p_n), let u(xi)=qiu(x_i) = q_i. By independence:

Li=1npi[qixbest+(1qi)xworst]L \sim \sum_{i=1}^n p_i[q_i x_{best} + (1-q_i)x_{worst}]
=(i=1npiqi)xbest+(1i=1npiqi)xworst= \left(\sum_{i=1}^n p_i q_i\right) x_{best} + \left(1 - \sum_{i=1}^n p_i q_i\right)x_{worst}

Therefore u(L)=i=1npiqi=i=1npiu(xi)=EL[u]u(L) = \sum_{i=1}^n p_i q_i = \sum_{i=1}^n p_i u(x_i) = \mathbb{E}_L[u].

Example 2.1: The St. Petersburg Paradox

A fair coin is tossed repeatedly until heads appears. If heads first appears on toss nn, you receive $2n\$2^n.

Expected value:

E[X]=n=1(12)n×2n=n=11=\mathbb{E}[X] = \sum_{n=1}^\infty \left(\frac{1}{2}\right)^n \times 2^n = \sum_{n=1}^\infty 1 = \infty

Despite infinite expected value, people typically pay only $10-$25 to play. Why?

Using utility u(w)=ln(w)u(w) = \ln(w) with initial wealth w0=100w_0 = 100:

E[u]=n=1(12)nln(100+2n)\mathbb{E}[u] = \sum_{n=1}^\infty \left(\frac{1}{2}\right)^n \ln(100 + 2^n)

This sum converges! The certainty equivalent solves ln(CE)=E[u]\ln(CE) = \mathbb{E}[u], yielding a finite willingness to pay.

This paradox motivated Bernoulli (1738) to propose utility theory.

3. Risk Attitudes and Arrow-Pratt Measures

Definition 3.1: Risk Aversion

An agent with utility uu is risk-averse if for any lottery LL:

u(E[L])>E[u(L)]u(\mathbb{E}[L]) > \mathbb{E}[u(L)]

By Jensen's inequality, this holds if and only if uu is strictly concave: u<0u'' < 0.

Definition 3.2: Risk Neutrality and Risk Seeking
  • Risk-neutral: u(E[L])=E[u(L)]u(\mathbb{E}[L]) = \mathbb{E}[u(L)] for all LL. Equivalently, uu is linear: u=0u'' = 0.
  • Risk-seeking: u(E[L])<E[u(L)]u(\mathbb{E}[L]) < \mathbb{E}[u(L)] for all LL. Equivalently, uu is convex: u>0u'' > 0.
Definition 3.3: Certainty Equivalent

The certainty equivalent CECE of lottery LL is the certain amount satisfying:

u(CE)=E[u(L)]u(CE) = \mathbb{E}[u(L)]

For risk-averse agents: CE<E[L]CE < \mathbb{E}[L]. The difference is the risk premium:

π=E[L]CE\pi = \mathbb{E}[L] - CE
Theorem 3.1: Arrow-Pratt Coefficient of Absolute Risk Aversion

The coefficient of absolute risk aversion is:

A(w)=u(w)u(w)A(w) = -\frac{u''(w)}{u'(w)}

For a small fair gamble ϵ~\tilde{\epsilon} with E[ϵ~]=0\mathbb{E}[\tilde{\epsilon}] = 0 and variance σ2\sigma^2, the risk premium is approximately:

π12A(w)σ2\pi \approx \frac{1}{2}A(w)\sigma^2
Proof of Risk Premium Approximation:

Consider wealth ww and gamble ϵ~\tilde{\epsilon}. Taylor expand around ww:

u(w+ϵ~)u(w)+u(w)ϵ~+12u(w)ϵ~2u(w + \tilde{\epsilon}) \approx u(w) + u'(w)\tilde{\epsilon} + \frac{1}{2}u''(w)\tilde{\epsilon}^2

Taking expectations (using E[ϵ~]=0\mathbb{E}[\tilde{\epsilon}] = 0, E[ϵ~2]=σ2\mathbb{E}[\tilde{\epsilon}^2] = \sigma^2):

E[u(w+ϵ~)]u(w)+12u(w)σ2\mathbb{E}[u(w + \tilde{\epsilon})] \approx u(w) + \frac{1}{2}u''(w)\sigma^2

The certainty equivalent satisfies u(CE)=E[u(w+ϵ~)]u(CE) = \mathbb{E}[u(w + \tilde{\epsilon})]. Taylor expanding u(CE)u(w)+u(w)(CEw)u(CE) \approx u(w) + u'(w)(CE - w):

u(w)+u(w)(CEw)u(w)+12u(w)σ2u(w) + u'(w)(CE - w) \approx u(w) + \frac{1}{2}u''(w)\sigma^2

Therefore:

CEwu(w)2u(w)σ2CE - w \approx \frac{u''(w)}{2u'(w)}\sigma^2

Since π=E[w+ϵ~]CE=wCE\pi = \mathbb{E}[w + \tilde{\epsilon}] - CE = w - CE:

πu(w)2u(w)σ2=12A(w)σ2\pi \approx -\frac{u''(w)}{2u'(w)}\sigma^2 = \frac{1}{2}A(w)\sigma^2
Definition 3.4: Coefficient of Relative Risk Aversion

The coefficient of relative risk aversion is:

R(w)=wu(w)u(w)=wA(w)R(w) = -\frac{w u''(w)}{u'(w)} = w \cdot A(w)

This measures risk aversion in proportional terms, useful for comparing agents with different wealth levels.

Example 3.1: Common Utility Functions and Their Risk Aversion

1. Exponential (CARA): u(w)=eawu(w) = -e^{-aw}

u(w)=aeaw,u(w)=a2eawu'(w) = ae^{-aw}, \quad u''(w) = -a^2e^{-aw}
A(w)=a2eawaeaw=a(constant!)A(w) = \frac{a^2e^{-aw}}{ae^{-aw}} = a \quad (\text{constant!})
R(w)=aw(increasing in w)R(w) = aw \quad (\text{increasing in } w)

CARA = Constant Absolute Risk Aversion

2. Power (CRRA): u(w)=w1γ1γu(w) = \frac{w^{1-\gamma}}{1-\gamma}

u(w)=wγ,u(w)=γwγ1u'(w) = w^{-\gamma}, \quad u''(w) = -\gamma w^{-\gamma-1}
A(w)=γwγ1wγ=γwA(w) = \frac{\gamma w^{-\gamma-1}}{w^{-\gamma}} = \frac{\gamma}{w}
R(w)=γ(constant!)R(w) = \gamma \quad (\text{constant!})

CRRA = Constant Relative Risk Aversion. Special case: γ=1\gamma = 1 gives u(w)=ln(w)u(w) = \ln(w).

3. Quadratic: u(w)=wb2w2u(w) = w - \frac{b}{2}w^2

u(w)=1bw,u(w)=bu'(w) = 1 - bw, \quad u''(w) = -b
A(w)=b1bw(increasing in w)A(w) = \frac{b}{1-bw} \quad (\text{increasing in } w)
R(w)=bw1bwR(w) = \frac{bw}{1-bw}

Quadratic utility implies mean-variance preferences but has the unrealistic feature of decreasing marginal utility.

Proposition 3.1: Comparing Risk Aversion

Agent 1 with utility u1u_1 is more risk-averse than agent 2 with utility u2u_2 if and only if:

A1(w)A2(w)for all wA_1(w) \geq A_2(w) \quad \text{for all } w

Equivalently, u1=g(u2)u_1 = g(u_2) for some concave increasing function gg.

Example 3.2: Calculating Certainty Equivalent

An investor with wealth w=100w = 100 and utility u(w)=ln(w)u(w) = \ln(w) faces a 50-50 gamble: win $20 or lose $20.

Expected value: E[w~]=0.5(120)+0.5(80)=100\mathbb{E}[\tilde{w}] = 0.5(120) + 0.5(80) = 100

Expected utility:

E[u]=0.5ln(120)+0.5ln(80)=ln(120×80)=ln(9600)ln(97.98)\mathbb{E}[u] = 0.5\ln(120) + 0.5\ln(80) = \ln(\sqrt{120 \times 80}) = \ln(\sqrt{9600}) \approx \ln(97.98)

Certainty equivalent: CECE satisfies:

ln(CE)=ln(97.98)    CE97.98\ln(CE) = \ln(97.98) \implies CE \approx 97.98

Risk premium:

π=10097.98=2.02\pi = 100 - 97.98 = 2.02

The investor would pay up to $2.02 to avoid this risk!

4. Applications to Portfolio Choice and Insurance

Proposition 4.1: Optimal Portfolio with Risk-Free and Risky Asset

Consider an agent with wealth WW, allocating fraction α\alpha to a risky asset with return r~\tilde{r} and (1α)(1-\alpha) to a risk-free asset with return rfr_f.

Terminal wealth: W~=W[1+αr~+(1α)rf]\tilde{W} = W[1 + \alpha \tilde{r} + (1-\alpha)r_f]

The optimal α\alpha^* maximizes E[u(W~)]\mathbb{E}[u(\tilde{W})]. First-order condition:

E[u(W~)(r~rf)]=0\mathbb{E}[u'(\tilde{W})(\tilde{r} - r_f)] = 0
Example 4.1: Portfolio Choice with CARA Utility

With u(W)=eaWu(W) = -e^{-aW} and r~N(μ,σ2)\tilde{r} \sim N(\mu, \sigma^2), the optimal allocation is:

α=μrfaσ2\alpha^* = \frac{\mu - r_f}{a\sigma^2}

Key insights:

  • Higher risk aversion aa leads to lower allocation to risky asset
  • Higher expected excess return (μrf)(\mu - r_f) leads to higher allocation
  • Higher variance σ2\sigma^2 leads to lower allocation
  • Allocation is independent of wealth (CARA property)
Proposition 4.2: Insurance Demand

An agent with wealth WW faces potential loss LL with probability pp. Insurance costs λpL\lambda pL (where λ1\lambda \geq 1 is the loading factor) to fully cover the loss.

For actuarially fair insurance (λ=1\lambda = 1), a risk-averse agent fully insures. For λ>1\lambda > 1, partial insurance is optimal.

Remark 4.1: Empirical Evidence on Risk Aversion

Estimates of relative risk aversion coefficient γ\gamma:

  • Laboratory experiments: γ[0.5,2]\gamma \in [0.5, 2]
  • Household portfolio data: γ[1,5]\gamma \in [1, 5]
  • Asset pricing (equity premium puzzle): γ>30\gamma > 30 needed

The wide range suggests context-dependent risk preferences and possible violations of expected utility theory.

Key Takeaways

  • 1.von Neumann-Morgenstern axioms provide foundations for expected utility maximization
  • 2.Risk aversion corresponds to concave utility (u'' < 0); most people are risk-averse
  • 3.Arrow-Pratt measures quantify risk aversion: ARA for absolute, RRA for relative
  • 4.Risk premium equals the cost of eliminating risk, proportional to variance and risk aversion
  • 5.CRRA utility is empirically realistic; CARA utility simplifies many portfolio problems
  • 6.Utility theory explains insurance demand and portfolio allocation patterns

Frequently Asked Questions

Why can't we just use expected value to make decisions?

The St. Petersburg Paradox shows that expected value alone leads to absurd conclusions. People value outcomes non-linearly - the utility of $2 million is not twice the utility of $1 million. Expected utility theory accounts for this by using a concave utility function.

What does it mean to be risk-averse?

A risk-averse person prefers a certain outcome to a risky lottery with the same expected value. Mathematically, this corresponds to a concave utility function (u'' < 0). Most people exhibit risk aversion due to diminishing marginal utility of wealth.

How is certainty equivalent different from expected value?

Expected value is the probability-weighted average of payoffs. Certainty equivalent is the guaranteed amount that gives the same utility as the risky lottery. For risk-averse agents, CE < EV; the difference is the risk premium they'd pay to avoid risk.

What's the difference between absolute and relative risk aversion?

Absolute risk aversion (ARA) measures how risk aversion changes with wealth level in absolute terms. Relative risk aversion (RRA) measures it in percentage terms. Empirical evidence suggests constant relative risk aversion (CRRA) is realistic for most people.

Why are the von Neumann-Morgenstern axioms important?

These axioms provide conditions under which preferences can be represented by expected utility. If an agent's preferences satisfy these axioms (completeness, transitivity, continuity, independence), then there exists a utility function representing those preferences.

Practice Quiz

Utility Theory and Risk Preferences
12
Questions
0
Correct
0%
Accuracy
1
If utility function is u(w)=ln(w)u(w) = \ln(w), what is the utility of wealth w=100w = 100?
Easy
Not attempted
2
Which utility function exhibits constant relative risk aversion (CRRA)?
Medium
Not attempted
3
An agent with u(w)=wu(w) = \sqrt{w} faces a 50-50 gamble: win 400orlose400 or lose 0. Current wealth is $100. What is the expected utility?
Medium
Not attempted
4
If u(w)=e0.01wu(w) = -e^{-0.01w}, what is the Arrow-Pratt coefficient of absolute risk aversion?
Hard
Not attempted
5
An agent is indifferent between \50forsureanda5050lotteryof for sure and a 50-50 lottery of \00 or \110$. The agent is:
Easy
Not attempted
6
For utility u(w)=w0.5u(w) = w^{0.5}, what is the coefficient of relative risk aversion?
Hard
Not attempted
7
The St. Petersburg Paradox involves a gamble with:
Medium
Not attempted
8
Which axiom states that preferences don't change when mixed with a common outcome?
Medium
Not attempted
9
If current wealth is \100,utilityis, utility is u(w) = \ln(w),andafaircoinflipwins, and a fair coin flip wins \2020 or loses \20$, what is the certainty equivalent?
Hard
Not attempted
10
A risk-neutral agent has utility function:
Easy
Not attempted
11
For u(w)=1wu(w) = -\frac{1}{w}, the agent is:
Medium
Not attempted
12
Insurance demand is primarily driven by:
Easy
Not attempted