Contraction Mapping Principle

A contraction d(Tx,Ty)≤q d(x,y)d(Tx,Ty) \le q\,d(x,y) (q<1q<1) on a complete metric space has a unique fixed point — the Picard iterates xn+1=Txnx_{n+1} = Tx_n tighten inside the error ball qn1−q∣x1−x0∣\frac{q^n}{1-q}|x_1-x_0|. T(x)=x/2T(x) = x/2 on (0,1](0,1] shows why completeness is essential: a contraction with no fixed point.

d(Tx,Ty)≤q d(x,y),0≤q<1d(Tx,Ty) \le q\,d(x,y), \quad 0 \le q < 1
d(xn,xm)≤qn1−q d(x0,x1),d(xn,x∗)≤qn1−q d(x1,x0)d(x_n,x_m) \le \frac{q^n}{1-q}\,d(x_0,x_1), \qquad d(x_n,x^*) \le \frac{q^n}{1-q}\,d(x_1,x_0)
T(x)=x/2 on (0,1]: contraction, no fixed pointT(x) = x/2 \text{ on } (0,1]: \text{ contraction, no fixed point}

Part of these learning paths

Examples & Exercises

For the Picard iterates xn+1=Txnx_{n+1} = Tx_n of a contraction TT (d(Tx,Ty)≤q d(x,y)d(Tx,Ty) \le q\,d(x,y), q<1q<1), show d(xn,xm)≤qn1−q d(x0,x1)d(x_n,x_m) \le \frac{q^n}{1-q}\,d(x_0,x_1) for m>nm>n, and prove (xn)(x_n) is Cauchy.

d(xk+1,xk+2)≤q d(xk,xk+1)≤qk+1 d(x0,x1)d(x_{k+1},x_{k+2}) \le q\,d(x_k,x_{k+1}) \le q^{k+1}\,d(x_0,x_1)
d(xn,xm)≤∑k=nm−1d(xk,xk+1)≤qn1−q d(x0,x1)d(x_n,x_m) \le \sum_{k=n}^{m-1} d(x_k,x_{k+1}) \le \frac{q^n}{1-q}\,d(x_0,x_1)
n=8n=8: the Cauchy tail bound 2−8≈0.00392^{-8} \approx 0.0039 — every xmx_m with m>8m>8 lands inside it.
Show proof
  1. Squeeze one step at a time: d(xk+1,xk+2)=d(Txk,Txk+1)≤q d(xk,xk+1)d(x_{k+1},x_{k+2}) = d(Tx_k,Tx_{k+1}) \le q\,d(x_k,x_{k+1}), so by induction d(xk,xk+1)≤qk d(x0,x1)d(x_k,x_{k+1}) \le q^k\,d(x_0,x_1) for every kk.
  2. For m>nm>n, chaining the triangle inequality gives d(xn,xm)≤∑k=nm−1d(xk,xk+1)≤(∑k=nm−1qk)d(x0,x1)d(x_n,x_m) \le \sum_{k=n}^{m-1} d(x_k,x_{k+1}) \le \left(\sum_{k=n}^{m-1} q^k\right) d(x_0,x_1). Extending the sum to ∞\infty yields the geometric tail ∑k=n∞qk=qn1−q\sum_{k=n}^{\infty} q^k = \frac{q^n}{1-q}, so d(xn,xm)≤qn1−q d(x0,x1)d(x_n,x_m) \le \frac{q^n}{1-q}\,d(x_0,x_1).
  3. The right side tends to 00 as n→∞n \to \infty, independently of mm, so (xn)(x_n) is Cauchy. With q=1/2q = 1/2 and x0=1x_0 = 1, d(x1,x0)=1/2d(x_1,x_0) = 1/2 makes the bound 2−n2^{-n}; at n=8n = 8 it is 1256≈0.0039\frac{1}{256} \approx 0.0039 — matching the caption's figure.

Show that T(x)=x/2T(x) = x/2 is a contraction with q=1/2q = 1/2 on (0,1](0,1], yet has no fixed point in (0,1](0,1]. This is why completeness is essential.

∣T(x)−T(y)∣=12∣x−y∣,T((0,1])⊂(0,1]|T(x) - T(y)| = \tfrac12|x - y|, \qquad T\big((0,1]\big) \subset (0,1]
x0=1⇒xn=2−n→0∉(0,1]x_0 = 1 \Rightarrow x_n = 2^{-n} \to 0 \notin (0,1]
n=8n=8: x8=2−8≈0.0039x_8 = 2^{-8} \approx 0.0039 — the iterates drain toward the missing limit 00.
Show proof
  1. Since ∣T(x)−T(y)∣=∣x2−y2∣=12∣x−y∣|T(x) - T(y)| = \left|\frac{x}{2} - \frac{y}{2}\right| = \frac12|x - y|, TT is a contraction with q=1/2q = 1/2. And x∈(0,1]x \in (0,1] gives T(x)=x/2∈(0,1/2]⊂(0,1]T(x) = x/2 \in (0, 1/2] \subset (0,1], so TT maps (0,1](0,1] into itself.
  2. A fixed point would satisfy x=x/2x = x/2, i.e. x=0x = 0, but 0∉(0,1]0 \notin (0,1]. Hence TT has no fixed point in (0,1](0,1].
  3. Starting from x0=1x_0 = 1 gives xn=2−nx_n = 2^{-n}: 1,12,14,…1, \frac12, \frac14, \dots. This sequence satisfies the geometric bound from the first problem, so it is Cauchy — but its limit 00 lies outside the space. Without completeness a Cauchy sequence loses its "place to land" and the whole theorem collapses; at n=8n = 8, x8=1256≈0.0039x_8 = \frac{1}{256} \approx 0.0039, matching the caption's figure.

On a complete metric space, derive the error bound d(xn,x∗)≤qn1−q d(x1,x0)d(x_n,x^*) \le \frac{q^n}{1-q}\,d(x_1,x_0) for the fixed point x∗x^* of a contraction, and prove there is at most one fixed point.

d(xn,x∗)=lim⁡m→∞d(xn,xm)≤qn1−q d(x1,x0)d(x_n,x^*) = \lim_{m \to \infty} d(x_n,x_m) \le \frac{q^n}{1-q}\,d(x_1,x_0)
∣x∗−y∗∣=∣Tx∗−Ty∗∣≤q∣x∗−y∗∣⇒x∗=y∗|x^* - y^*| = |Tx^* - Ty^*| \le q|x^* - y^*| \Rightarrow x^* = y^*
n=8n=8: ∣x8−2∣=1/256≈0.0039|x_8 - 2| = 1/256 \approx 0.0039 — matches the bound exactly.
Show proof
  1. Completeness makes the Cauchy sequence (xn)(x_n) converge to a point x∗x^* inside the space. A contraction is continuous since ∣Tx−Ty∣≤q∣x−y∣|Tx - Ty| \le q|x - y|, so Tx∗=T(lim⁡xn)=lim⁡Txn=lim⁡xn+1=x∗Tx^* = T(\lim x_n) = \lim Tx_n = \lim x_{n+1} = x^* — x∗x^* is a fixed point.
  2. Letting m→∞m \to \infty in the first problem's estimate (and d(x1,x0)=d(x0,x1)d(x_1,x_0) = d(x_0,x_1)) gives the error bound d(xn,x∗)≤qn1−q d(x1,x0)d(x_n,x^*) \le \frac{q^n}{1-q}\,d(x_1,x_0). For T(x)=x/2+1T(x) = x/2 + 1 with q=1/2q = 1/2 and x0=1x_0 = 1, the bound is (1/2)81/2⋅12=1256≈0.0039\frac{(1/2)^8}{1/2}\cdot\frac12 = \frac{1}{256} \approx 0.0039, and the actual iterate x8=2−2−8=1.99609375x_8 = 2 - 2^{-8} = 1.99609375 has error ∣x8−2∣=1256|x_8 - 2| = \frac{1}{256}, matching the bound exactly.
  3. Uniqueness: if x∗x^* and y∗y^* are both fixed points, ∣x∗−y∗∣=∣Tx∗−Ty∗∣≤q∣x∗−y∗∣|x^* - y^*| = |Tx^* - Ty^*| \le q|x^* - y^*|. Since q<1q < 1, this forces ∣x∗−y∗∣=0|x^* - y^*| = 0, i.e. x∗=y∗x^* = y^*.

4. Topology