Hölder’s Inequality

This scene widens Cauchy–Schwarz to general exponents. The key is that the two exponents come as a matched pair.

Multiply two sequences term by term and add them up: even that total has a ceiling. The ceiling is the product of the two sequences' norms. With both exponents equal to 2, it is exactly Cauchy–Schwarz. The key step is Young's inequality, which trades a product for shares of a sum. The precise formulas are below.

For example, at a 🏪 shop you multiply each item's price by its quantity and add everything up. That total never exceeds the product of the price list's size and the quantity list's size.

∑k=1n∣akbk∣≤(∑k=1n∣ak∣p)1/p(∑k=1n∣bk∣q)1/q\sum_{k=1}^{n} |a_k b_k| \le \left(\sum_{k=1}^{n} |a_k|^p\right)^{1/p} \left(\sum_{k=1}^{n} |b_k|^q\right)^{1/q}
ab≤app+bqq(Young)ab \le \frac{a^p}{p} + \frac{b^q}{q} \quad \text{(Young)}

Examples & Exercises

For conjugate exponents 1/p+1/q=11/p + 1/q = 1 (1<p,q<∞1 < p, q < \infty), prove Young's inequality ab≤app+bqqab \le \frac{a^p}{p} + \frac{b^q}{q} (a,b≥0a, b \ge 0) completely, using the concavity of log⁡\log.

ab≤app+bqq,equality  ⟺  ap=bqab \le \frac{a^p}{p} + \frac{b^q}{q}, \qquad \text{equality} \iff a^p = b^q
p=2p = 2, n=8n = 8: Young's inequality feeds each term akbk≤ak22+bk22a_k b_k \le \frac{a_k^2}{2} + \frac{b_k^2}{2}, and summing gives Hölder (Cauchy–Schwarz).
Show proof
  1. If a=0a = 0 or b=0b = 0 both sides are trivial (0≤0 \le the right side), so take a,b>0a, b > 0.

    Then ab=exp⁡(log⁡a+log⁡b)=exp⁡(1plog⁡(ap)+1qlog⁡(bq))ab = \exp(\log a + \log b) = \exp\left(\frac{1}{p}\log(a^p) + \frac{1}{q}\log(b^q)\right).

    Since log⁡\log is concave, the weighted Jensen inequality log⁡(Xp+Yq)≥1plog⁡X+1qlog⁡Y\log\left(\frac{X}{p} + \frac{Y}{q}\right) \ge \frac{1}{p}\log X + \frac{1}{q}\log Y (X,Y>0X, Y > 0) holds.

  2. With X=apX = a^p, Y=bqY = b^q this gives 1plog⁡(ap)+1qlog⁡(bq)≤log⁡(app+bqq)\frac{1}{p}\log(a^p) + \frac{1}{q}\log(b^q) \le \log\left(\frac{a^p}{p} + \frac{b^q}{q}\right). Applying the monotone exp⁡\exp to both sides, exp⁡(1plog⁡(ap)+1qlog⁡(bq))=ab≤app+bqq\exp\left(\frac{1}{p}\log(a^p) + \frac{1}{q}\log(b^q)\right) = ab \le \frac{a^p}{p} + \frac{b^q}{q} — Young's inequality proved.

  3. Equality case: log⁡\log is strictly concave, so for a,b>0a, b > 0 Jensen gives equality only when X=YX = Y, i.e. ap=bqa^p = b^q.

    Verify the zero cases directly as well: if a=0a = 0 then the left side is ab=0ab = 0 and the inequality reads 0≤bqq0 \le \frac{b^q}{q}, with equality only when bq=0b^q = 0, i.e. b=0b = 0 — exactly what ap=bqa^p = b^q (namely 0=bq0 = b^q) asserts; the case b=0b = 0 is symmetric.

    Hence in all cases equality holds if and only if ap=bqa^p = b^q.

    This equality condition becomes Hölder's equality case in problem 3 below.

Derive Hölder's inequality ∑k=1n∣akbk∣≤(∑∣ak∣p)1/p(∑∣bk∣q)1/q\sum_{k=1}^{n} |a_k b_k| \le \left(\sum |a_k|^p\right)^{1/p}\left(\sum |b_k|^q\right)^{1/q} completely from Young's inequality by the normalization argument.

∑AkBk≤∑(Akpp+Bkqq)=1p+1q=1\sum A_k B_k \le \sum\left(\frac{A_k^p}{p} + \frac{B_k^q}{q}\right) = \frac{1}{p} + \frac{1}{q} = 1
p=3p = 3 (q=1.5q = 1.5), n=8n = 8: left side H8≈2.7179H_8 \approx 2.7179, right side ≈4.245\approx 4.245 — the gap is positive and the inequality holds.
Show proof
  1. If ∥a∥p=0\|a\|_p = 0 then every ak=0a_k = 0 and both sides are 0; likewise for ∥b∥q=0\|b\|_q = 0.

    So assume ∥a∥p,∥b∥q>0\|a\|_p, \|b\|_q > 0.

    Define the normalized sequences Ak=∣ak∣/∥a∥pA_k = |a_k|/\|a\|_p, Bk=∣bk∣/∥b∥qB_k = |b_k|/\|b\|_q; then ∑Akp=1\sum A_k^p = 1 and ∑Bkq=1\sum B_k^q = 1.

  2. Apply Young's inequality to each kk: AkBk≤Akpp+BkqqA_k B_k \le \frac{A_k^p}{p} + \frac{B_k^q}{q}. Summing over k=1,…,nk = 1, \dots, n gives ∑AkBk≤1p∑Akp+1q∑Bkq=1p+1q=1\sum A_k B_k \le \frac{1}{p}\sum A_k^p + \frac{1}{q}\sum B_k^q = \frac{1}{p} + \frac{1}{q} = 1.

  3. Multiplying both sides by ∥a∥p∥b∥q\|a\|_p\|b\|_q gives ∑∣akbk∣=∥a∥p∥b∥q∑AkBk≤∥a∥p∥b∥q\sum |a_k b_k| = \|a\|_p\|b\|_q \sum A_k B_k \le \|a\|_p\|b\|_q — Hölder's inequality proved.

    The case p=q=2p = q = 2 is Cauchy–Schwarz.

    Sliding pp in the scene shows how this right side inflates and deflates.

Prove the exact equality condition in Hölder's inequality: equality holds if and only if either ∥a∥p∥b∥q=0\|a\|_p \|b\|_q = 0 (one of a,ba, b is the zero sequence, so both sides are 00), or there exists a constant C>0C > 0 with ∣ak∣p=C ∣bk∣q|a_k|^p = C\,|b_k|^q for all kk.

equality  ⟺  [∥a∥p∥b∥q=0] or [∃ C>0: ∣ak∣p=C ∣bk∣q ∀k]\text{equality} \iff \Big[\|a\|_p \|b\|_q = 0\Big] \ \text{or}\ \Big[\exists\, C > 0:\ |a_k|^p = C\,|b_k|^q \ \forall k\Big]
p=2p = 2, n=8n = 8: ak=1/ka_k = 1/k is not proportional to the constant sequence bk=1b_k = 1, so the gap is nonzero — showing why the equality condition fails.
Show proof
  1. Separate the degenerate case first.

    If ∥a∥p∥b∥q=0\|a\|_p \|b\|_q = 0 then one of a,ba, b is the zero sequence, so ∑∣akbk∣=0\sum |a_k b_k| = 0 and the right side is also 00 — equality holds automatically.

    Note: with b=0b = 0 but a≠0a \ne 0, this equality holds, yet no constant — not even C≥0C \ge 0, let alone C>0C > 0 — satisfies ∣ak∣p=C∣bk∣q|a_k|^p = C|b_k|^q (the right side is identically 0 while some ∣ak∣p>0|a_k|^p > 0).

    That is why the first branch of the statement is indispensable.

    In both directions below, the degenerate case is settled by this paragraph, and the proportional branch is treated under ∥a∥p,∥b∥q>0\|a\|_p, \|b\|_q > 0.

  2. (⇒)(\Rightarrow) Assume ∥a∥p,∥b∥q>0\|a\|_p, \|b\|_q > 0 and that equality holds overall.

    In problem 2's proof the inequality happened in exactly one place: Young's inequality AkBk≤Akpp+BkqqA_k B_k \le \frac{A_k^p}{p} + \frac{B_k^q}{q} applied to each term.

    Equality gives ∑kAkBk=1\sum_k A_k B_k = 1, while ∑k(Akpp+Bkqq)=1p∑Akp+1q∑Bkq=1\sum_k \left(\frac{A_k^p}{p} + \frac{B_k^q}{q}\right) = \frac{1}{p}\sum A_k^p + \frac{1}{q}\sum B_k^q = 1 is an identity, so if any single term were strict, the summed inequality would be strict — hence equality holds for every kk.

    By problem 1's equality condition, Akp=BkqA_k^p = B_k^q for every kk; unwinding the normalization gives ∣ak∣p∥a∥pp=∣bk∣q∥b∥qq\frac{|a_k|^p}{\|a\|_p^p} = \frac{|b_k|^q}{\|b\|_q^q} — i.e. ∣ak∣p=C∣bk∣q|a_k|^p = C|b_k|^q with C=∥a∥pp/∥b∥qq>0C = \|a\|_p^p/\|b\|_q^q > 0 (both norms are positive) independent of kk.

  3. (⇐)(\Leftarrow) Conversely, assume one of the two branches.

    If the degenerate branch ∥a∥p∥b∥q=0\|a\|_p \|b\|_q = 0 holds, the first paragraph already verified equality with both sides 00 — this also covers the C=0C = 0 case: if ∣ak∣p=0⋅∣bk∣q|a_k|^p = 0 \cdot |b_k|^q for all kk, then a=0a = 0 and the first branch applies with no division by any norm.

    For the proportional branch, assume ∣ak∣p=C∣bk∣q|a_k|^p = C|b_k|^q for all kk and some C>0C > 0.

    If ∥b∥q=0\|b\|_q = 0 then b=0b = 0 and proportionality forces a=0a = 0 as well, returning to the degenerate branch; if ∥a∥p=0\|a\|_p = 0 then a=0a = 0, again the degenerate branch.

    In the remaining case ∥a∥p,∥b∥q>0\|a\|_p, \|b\|_q > 0, division by the norms is legitimate: summing the proportionality over kk forces C=∥a∥pp/∥b∥qqC = \|a\|_p^p/\|b\|_q^q, and after normalization Akp=∣ak∣p∥a∥pp=∣bk∣q∥b∥qq=BkqA_k^p = \frac{|a_k|^p}{\|a\|_p^p} = \frac{|b_k|^q}{\|b\|_q^q} = B_k^q, so by problem 1's equality condition every Young's inequality is an equality: AkBk=Akpp+BkqqA_k B_k = \frac{A_k^p}{p} + \frac{B_k^q}{q}.

    Summing over kk gives ∑kAkBk=1p∑kAkp+1q∑kBkq=1p+1q=1\sum_k A_k B_k = \frac{1}{p}\sum_k A_k^p + \frac{1}{q}\sum_k B_k^q = \frac{1}{p} + \frac{1}{q} = 1, i.e. ∑k∣akbk∣=∥a∥p∥b∥q\sum_k |a_k b_k| = \|a\|_p \|b\|_q — equality in Hölder's inequality.

  4. In the scene, ak=1/ka_k = 1/k and bk=1b_k = 1 have both norms positive but ∣ak∣p|a_k|^p is not constant, so the gap can never be 0 — the gap closing as p→1+p \to 1^+ is a collapse of the right side itself, not proportionality.

3. Sequences