MathIsimple

Probability Theory – Problem 48: prove that for , .\\

Question

Let X=X1,X2,X = X_1, X_2, \dots be independent and identically distributed random variables.\\ (1) If μ=EX>0\mu = E X > 0, prove that for α<1\alpha < 1, limnP(Xnnα)=1\lim\limits_{n \to \infty} P(X_n \ge n^{\alpha}) = 1.\\ (2) If μ=EX=0\mu = E X = 0 and EX2<+E X^2 < +\infty, compute limnP(Xnnα)\lim\limits_{n \to \infty} P(X_n \ge n^{\alpha}).

Step-by-step solution

Step 1. Establish the asymptotic behavior of partial sums via the Law of Large Numbers. Since X1,X2,X_1,X_2,\dots are i.i.d. with EX=μ>0\mathbb{E}X = \mu > 0, by the Law of Large Numbers we have limnSnn=μ\lim\limits_{n \to \infty} \frac{S_n}{n} = \mu almost surely. This means that for any ε(0,μ)\varepsilon \in (0, \mu), there exists a positive integer N0N_0 such that for n>N0n > N_0, Snn>με\frac{S_n}{n} > \mu - \varepsilon almost surely, i.e., Sn>n(με)S_n > n(\mu - \varepsilon) almost surely.

Step 2. Analyze the order-of-magnitude relationship between nαn^\alpha and n(με)n(\mu - \varepsilon). Since α<1\alpha < 1, we have 1α>01 - \alpha > 0, so n1α=nnαn^{1 - \alpha} = \frac{n}{n^\alpha} \to \infty as nn \to \infty. For a fixed ε(0,μ)\varepsilon \in (0, \mu), when nn is sufficiently large, n1α>1μεn^{1 - \alpha} > \frac{1}{\mu - \varepsilon}; multiplying both sides by nαn^\alpha yields n(με)>nαn(\mu - \varepsilon) > n^\alpha.

Step 3. Derive the probability limit. By Steps 1 and 2, for sufficiently large nn we have Sn>n(με)>nαS_n > n(\mu - \varepsilon) > n^\alpha almost surely, so P(Snnα)P(Sn>n(με))\mathbb{P}(S_n \geq n^\alpha) \geq \mathbb{P}(S_n > n(\mu - \varepsilon)). Moreover, the Strong Law of Large Numbers implies convergence in probability, i.e., limnP(Snnμ<ε)=1\lim\limits_{n \to \infty} \mathbb{P}\left( \left| \frac{S_n}{n} - \mu \right| < \varepsilon \right) = 1, and therefore limnP(Sn>n(με))=1\lim\limits_{n \to \infty} \mathbb{P}(S_n > n(\mu - \varepsilon)) = 1. Combined with the upper bound of 1 for probabilities, we obtain limnP(Snnα)=1\lim\limits_{n \to \infty} \mathbb{P}(S_n \geq n^\alpha) = 1.

We continue with the partial sums Sn=X1++XnS_n = X_1 + \cdots + X_n and analyze the probability limit using the Central Limit Theorem. Given EX=0\mathbb{E}X = 0 and EX2=σ2<\mathbb{E}X^2 = \sigma^2 < \infty, by the i.i.d. Central Limit Theorem, SnndN(0,σ2)\frac{S_n}{\sqrt{n}} \stackrel{d}{\to} N(0, \sigma^2) (convergence in distribution), where N(0,σ2)N(0, \sigma^2) denotes the normal distribution with mean 0 and variance σ2\sigma^2, and Φ(x)=P(N(0,1)x)\Phi(x) = \mathbb{P}(N(0,1) \leq x) is the standard normal distribution function.

Rewriting the target probability as P(Snnα)=P(Snnnα12)\mathbb{P}(S_n \geq n^\alpha) = \mathbb{P}\left( \frac{S_n}{\sqrt{n}} \geq n^{\alpha - \frac{1}{2}} \right), let tn=nα12t_n = n^{\alpha - \frac{1}{2}} and consider three cases according to the limit of tnt_n:

- When α>12\alpha > \frac{1}{2}: α12>0\alpha - \frac{1}{2} > 0, so tnt_n \to \infty as nn \to \infty. By the tail behavior of the normal distribution, Φ(x)1\Phi(x) \to 1 as xx \to \infty, hence P(Snntn)=1P(Snntn)1Φ()=0\mathbb{P}\left( \frac{S_n}{\sqrt{n}} \geq t_n \right) = 1 - \mathbb{P}\left( \frac{S_n}{\sqrt{n}} \leq t_n \right) \to 1 - \Phi(\infty) = 0.

- When α=12\alpha = \frac{1}{2}: tn=n0=1t_n = n^0 = 1. By the definition of convergence in distribution, limnP(Snn1)=Φ(1σ)\lim\limits_{n \to \infty} \mathbb{P}\left( \frac{S_n}{\sqrt{n}} \leq 1 \right) = \Phi\left( \frac{1}{\sigma} \right), so limnP(Snn)=1Φ(1σ)\lim\limits_{n \to \infty} \mathbb{P}(S_n \geq \sqrt{n}) = 1 - \Phi\left( \frac{1}{\sigma} \right).

- When α<12\alpha < \frac{1}{2}: α12<0\alpha - \frac{1}{2} < 0, so tn0t_n \to 0 as nn \to \infty. By the continuity property of convergence in distribution, limnP(Snn0)=Φ(0)=12\lim\limits_{n \to \infty} \mathbb{P}\left( \frac{S_n}{\sqrt{n}} \leq 0 \right) = \Phi(0) = \frac{1}{2}, hence P(Snntn)1Φ(0)=12\mathbb{P}\left( \frac{S_n}{\sqrt{n}} \geq t_n \right) \to 1 - \Phi(0) = \frac{1}{2}.

Final answer

(1) QED. (2) The limiting results are as follows: - If α>12\alpha > \frac{1}{2}, then 0; - If α=12\alpha = \frac{1}{2}, then 1Φ(1EX2)1 - \Phi\left( \frac{1}{\sqrt{\mathbb{E}X^2}} \right) (where Φ\Phi denotes the standard normal distribution function); - If α<12\alpha < \frac{1}{2}, then 12\frac{1}{2}.

Marking scheme

The following rubric is designed for this problem and its official solution. Note that although the original problem statement may contain notational ambiguity (the problem is phrased in terms of XnX_n, while the solution treats partial sums SnS_n), this rubric is written entirely according to the logic of the official solution (i.e., analyzing the limiting behavior of the partial sums SnS_n).


1. Checkpoints (max 7 pts total)

Part (1): Application of the Law of Large Numbers (3 pts)

  • Invoking the Law of Large Numbers [additive]: State that Snnμ\frac{S_n}{n} \to \mu (almost surely or in probability) or that Snnμn0\frac{S_n - n\mu}{n} \to 0. (1 pt)
  • Order-of-magnitude comparison and bounding [additive]: Use α<1\alpha < 1 and μ>0\mu > 0 to show that for sufficiently large nn, nαn<μ\frac{n^\alpha}{n} < \mu (or nα<n(με)n^\alpha < n(\mu - \varepsilon)), thereby establishing that SnS_n exceeds nαn^\alpha. (1 pt)
  • Part (1) conclusion [additive]: Combine the above steps to conclude limnP(Snnα)=1\lim\limits_{n \to \infty} P(S_n \ge n^{\alpha}) = 1. (1 pt)

Part (2): Central Limit Theorem and case analysis (4 pts)

  • CLT reformulation and standardization [additive]: Invoke the Central Limit Theorem SnndN(0,σ2)\frac{S_n}{\sqrt{n}} \xrightarrow{d} N(0, \sigma^2) and transform the target probability into the form P(Snnnα1/2)P\left( \frac{S_n}{\sqrt{n}} \ge n^{\alpha - 1/2} \right). (1 pt)
  • Case 1: α>1/2\alpha > 1/2 [additive]: Identify that the threshold nα1/2+n^{\alpha - 1/2} \to +\infty, yielding a probability limit of 0. (1 pt)
  • Case 2: α<1/2\alpha < 1/2 [additive]: Identify that the threshold nα1/20n^{\alpha - 1/2} \to 0, yielding a probability limit of 1Φ(0)=1/21 - \Phi(0) = \textbf{1/2}. (1 pt)
  • Case 3: α=1/2\alpha = 1/2 [additive]: Identify that the threshold is the constant 1, yielding a probability limit of 1Φ(1/σ)1 - \Phi(1/\sigma) or equivalently Φ(1/σ)\Phi(-1/\sigma). (1 pt)
  • *Note: The result must explicitly involve σ\sigma. If the answer is written as 1Φ(1)1-\Phi(1) (implicitly assuming σ=1\sigma=1) without a general justification, no credit is awarded for this checkpoint.*

Total (max 7)


2. Zero-credit items

  • Merely copying the given hypotheses (e.g., XiX_i are i.i.d., μ>0\mu > 0, etc.).
  • Merely stating the general formulas of the Law of Large Numbers or the Central Limit Theorem without substituting nαn^\alpha or performing any problem-specific manipulation.
  • In Part (1), asserting the result equals 1 by intuition alone without providing a proof.
  • In Part (2), giving a single blanket guess without performing the required case analysis.

3. Deductions

  • Symbolic/logical error: If, during the limit computation, a quantity depending on nn (such as nα1/2n^{\alpha-1/2}) is erroneously treated as a constant, causing a logical gap in the conclusion, deduct 1 point.
  • Missing essential constant: In Part (2), if the origin or definition of σ\sigma is not stated (even though the problem implicitly defines Var(X)=σ2\mathrm{Var}(X)=\sigma^2, the student should use the symbol σ\sigma explicitly), resulting in σ\sigma being absent or dimensionally incorrect in the final expression, deduct 1 point (no double penalty if credit was already denied at the corresponding checkpoint).
  • Logical gap: In Part (1), if Chebyshev's inequality is used but the student does not address whether the variance exists (the problem only assumes a finite first moment in Part (1); the finite second moment is given only in Part (2)), the argument may be accepted if logically coherent, but if an undefined second moment is used without justification, deduct 1 point.
  • Misinterpretation: If the student strictly interprets the problem literally and computes P(Xnnα)P(X_n \ge n^\alpha) for a single random variable rather than P(Snnα)P(S_n \ge n^\alpha), since this contradicts the official solution's intent of testing limit theorems and typically leads to a divergent or trivially zero result, award at most 0--1 sympathy points for that part; primary credit is determined by the official solution's approach.
Ask AI ✨