Contraction Mapping Principle

This scene runs the contraction mapping principle. Iterate and watch the points tighten onto one fixed point.

A contraction shrinks every distance by one fixed ratio. Iterating pulls all points toward each other. Every start leads to the same destination. But if the space has a hole, the destination can fall into it.

For example, fold a πŸ—ΊοΈ map in half, then in half again. Each fold shrinks the paper, and all points gather toward one. That point is the fixed point. Tear a hole in the middle, and the gathering point is gone.

d(Tx,Ty)≀q d(x,y),0≀q<1d(Tx,Ty) \le q\,d(x,y), \quad 0 \le q < 1
d(xn,xm)≀qn1βˆ’q d(x0,x1),d(xn,xβˆ—)≀qn1βˆ’q d(x1,x0)d(x_n,x_m) \le \frac{q^n}{1-q}\,d(x_0,x_1), \qquad d(x_n,x^*) \le \frac{q^n}{1-q}\,d(x_1,x_0)
T(x)=x/2Β onΒ (0,1]:Β contraction,Β noΒ fixedΒ pointT(x) = x/2 \text{ on } (0,1]: \text{ contraction, no fixed point}

Part of these learning paths

Examples & Exercises

For the Picard iterates xn+1=Txnx_{n+1} = Tx_n of a contraction TT (d(Tx,Ty)≀q d(x,y)d(Tx,Ty) \le q\,d(x,y), 0≀q<10 \le q < 1), show d(xn,xm)≀qn1βˆ’q d(x0,x1)d(x_n,x_m) \le \frac{q^n}{1-q}\,d(x_0,x_1) for m>nm>n, and prove (xn)(x_n) is Cauchy.

d(xk+1,xk+2)≀q d(xk,xk+1)≀qk+1 d(x0,x1)d(x_{k+1},x_{k+2}) \le q\,d(x_k,x_{k+1}) \le q^{k+1}\,d(x_0,x_1)
d(xn,xm)β‰€βˆ‘k=nmβˆ’1d(xk,xk+1)≀qn1βˆ’q d(x0,x1)d(x_n,x_m) \le \sum_{k=n}^{m-1} d(x_k,x_{k+1}) \le \frac{q^n}{1-q}\,d(x_0,x_1)
n=8n=8: the Cauchy tail bound 2βˆ’8β‰ˆ0.00392^{-8} \approx 0.0039 β€” every xmx_m with m>8m>8 lands inside it.
Show proof
  1. First take q∈[0,1)q \in [0, 1): distances are always β‰₯0\ge 0, so the contraction constant qq β€” a ratio of distances β€” may be taken with qβ‰₯0q \ge 0 (if q<0q < 0 then d(Tx,Ty)≀q d(x,y)≀0d(Tx,Ty) \le q\,d(x,y) \le 0 would force every TxTx to coincide, and in any case the induction multiplying by qq and the geometric tail formula below would break over the sign). Squeeze one step at a time: d(xk+1,xk+2)=d(Txk,Txk+1)≀q d(xk,xk+1)d(x_{k+1},x_{k+2}) = d(Tx_k,Tx_{k+1}) \le q\,d(x_k,x_{k+1}), and since qβ‰₯0q \ge 0 the inequality direction is preserved, so by induction d(xk,xk+1)≀qk d(x0,x1)d(x_k,x_{k+1}) \le q^k\,d(x_0,x_1) for every kk.

  2. For m>nm>n, chaining the triangle inequality gives d(xn,xm)β‰€βˆ‘k=nmβˆ’1d(xk,xk+1)≀(βˆ‘k=nmβˆ’1qk)d(x0,x1)d(x_n,x_m) \le \sum_{k=n}^{m-1} d(x_k,x_{k+1}) \le \left(\sum_{k=n}^{m-1} q^k\right) d(x_0,x_1). Extending the sum to ∞\infty yields the geometric tail βˆ‘k=n∞qk=qn1βˆ’q\sum_{k=n}^{\infty} q^k = \frac{q^n}{1-q}, so d(xn,xm)≀qn1βˆ’q d(x0,x1)d(x_n,x_m) \le \frac{q^n}{1-q}\,d(x_0,x_1).

  3. The right side tends to 00 as nβ†’βˆžn \to \infty, independently of mm, so (xn)(x_n) is Cauchy. With q=1/2q = 1/2 and x0=1x_0 = 1, d(x1,x0)=1/2d(x_1,x_0) = 1/2 makes the bound 2βˆ’n2^{-n}; at n=8n = 8 it is 1256β‰ˆ0.0039\frac{1}{256} \approx 0.0039 β€” matching the caption's figure.

Show that T(x)=x/2T(x) = x/2 is a contraction with q=1/2q = 1/2 on (0,1](0,1], yet has no fixed point in (0,1](0,1].

This is why completeness is essential.

∣T(x)βˆ’T(y)∣=12∣xβˆ’y∣,T((0,1])βŠ‚(0,1]|T(x) - T(y)| = \tfrac12|x - y|, \qquad T\big((0,1]\big) \subset (0,1]
x0=1β‡’xn=2βˆ’nβ†’0βˆ‰(0,1]x_0 = 1 \Rightarrow x_n = 2^{-n} \to 0 \notin (0,1]
n=8n=8: x8=2βˆ’8β‰ˆ0.0039x_8 = 2^{-8} \approx 0.0039 β€” the iterates drain toward the missing limit 00.
Show proof
  1. Since ∣T(x)βˆ’T(y)∣=∣x2βˆ’y2∣=12∣xβˆ’y∣|T(x) - T(y)| = \left|\frac{x}{2} - \frac{y}{2}\right| = \frac12|x - y|, TT is a contraction with q=1/2q = 1/2. And x∈(0,1]x \in (0,1] gives T(x)=x/2∈(0,1/2]βŠ‚(0,1]T(x) = x/2 \in (0, 1/2] \subset (0,1], so TT maps (0,1](0,1] into itself.

  2. A fixed point would satisfy x=x/2x = x/2, i.e. x=0x = 0, but 0βˆ‰(0,1]0 \notin (0,1]. Hence TT has no fixed point in (0,1](0,1].

  3. Starting from x0=1x_0 = 1 gives xn=2βˆ’nx_n = 2^{-n}: 1,12,14,…1, \frac12, \frac14, \dots.

    This sequence satisfies the geometric bound from the first problem, so it is Cauchy β€” but its limit 00 lies outside the space.

    Without completeness a Cauchy sequence loses its "place to land" and the whole theorem collapses; at n=8n = 8, x8=1256β‰ˆ0.0039x_8 = \frac{1}{256} \approx 0.0039, matching the caption's figure.

On a complete metric space, derive the error bound d(xn,xβˆ—)≀qn1βˆ’q d(x1,x0)d(x_n,x^*) \le \frac{q^n}{1-q}\,d(x_1,x_0) for the fixed point xβˆ—x^* of a contraction, and prove there is at most one fixed point.

d(xn,xβˆ—)=lim⁑mβ†’βˆžd(xn,xm)≀qn1βˆ’q d(x1,x0)d(x_n,x^*) = \lim_{m \to \infty} d(x_n,x_m) \le \frac{q^n}{1-q}\,d(x_1,x_0)
d(xβˆ—,yβˆ—)=d(Txβˆ—,Tyβˆ—)≀q d(xβˆ—,yβˆ—)β‡’xβˆ—=yβˆ—d(x^*, y^*) = d(Tx^*, Ty^*) \le q\,d(x^*, y^*) \Rightarrow x^* = y^*
n=8n=8: ∣x8βˆ’2∣=1/256β‰ˆ0.0039|x_8 - 2| = 1/256 \approx 0.0039 β€” matches the bound exactly.
Show proof
  1. Completeness makes the Cauchy sequence (xn)(x_n) converge to a point xβˆ—x^* inside the space. A contraction is continuous since d(Tx,Ty)≀q d(x,y)d(Tx,Ty) \le q\,d(x,y), so Txβˆ—=T(lim⁑xn)=lim⁑Txn=lim⁑xn+1=xβˆ—Tx^* = T(\lim x_n) = \lim Tx_n = \lim x_{n+1} = x^* β€” xβˆ—x^* is a fixed point.

  2. Justification for passing to the limit: the metric is continuous β€” by the reverse triangle inequality, ∣d(xn,xm)βˆ’d(xn,xβˆ—)βˆ£β‰€d(xm,xβˆ—)β†’0\lvert d(x_n,x_m) - d(x_n,x^*)\rvert \le d(x_m, x^*) \to 0 as mβ†’βˆžm \to \infty, so d(xn,xm)β†’d(xn,xβˆ—)d(x_n,x_m) \to d(x_n,x^*).

    Hence letting mβ†’βˆžm \to \infty in the first problem's estimate (and d(x1,x0)=d(x0,x1)d(x_1,x_0) = d(x_0,x_1)) gives the error bound d(xn,xβˆ—)≀qn1βˆ’q d(x1,x0)d(x_n,x^*) \le \frac{q^n}{1-q}\,d(x_1,x_0).

    For T(x)=x/2+1T(x) = x/2 + 1 with q=1/2q = 1/2 and x0=1x_0 = 1, the bound is (1/2)81/2β‹…12=1256β‰ˆ0.0039\frac{(1/2)^8}{1/2}\cdot\frac12 = \frac{1}{256} \approx 0.0039, and the actual iterate x8=2βˆ’2βˆ’8=1.99609375x_8 = 2 - 2^{-8} = 1.99609375 has error ∣x8βˆ’2∣=1256|x_8 - 2| = \frac{1}{256}, matching the bound exactly.

  3. Uniqueness: if xβˆ—x^* and yβˆ—y^* are both fixed points, d(xβˆ—,yβˆ—)=d(Txβˆ—,Tyβˆ—)≀q d(xβˆ—,yβˆ—)d(x^*, y^*) = d(Tx^*, Ty^*) \le q\,d(x^*, y^*). Since q<1q < 1, this forces d(xβˆ—,yβˆ—)=0d(x^*, y^*) = 0, i.e. xβˆ—=yβˆ—x^* = y^*.

5. Topology