Arzelà–Ascoli Theorem

When can we pull a uniformly convergent subsequence out of a family of continuous functions?

Two conditions do the job. First, every function stays inside one πŸ“¦ box. Second, all of them wiggle with similar gentleness. A diagonal argument over the rationals then builds a subsequence. It closes in everywhere at once. The power functions fail the second condition: they turn steep suddenly near 1.

For example, picture 30 πŸ§‘ friends walking across a playground. Everyone must stay inside the fence. Nobody may suddenly sprint. Then you can pick a group whose walks grow alike. One friend sprinting at the end ruins the group.

FβŠ‚C(K)Β relativelyΒ compactF \subset C(K)\ \text{relatively compact}
β€…β€ŠβŸΊβ€…β€ŠuniformlyΒ bounded+equicontinuous\iff \text{uniformly bounded} + \text{equicontinuous}
βˆ₯fakβˆ’fβˆ—βˆ₯∞=1k+2β†’0\|f_{a_k} - f^*\|_\infty = \frac{1}{k+2} \to 0

Part of these learning paths

Examples & Exercises

Let KK be a compact metric space and FβŠ‚C(K)F \subset C(K) relatively compact in the sup norm.

Prove FF is equicontinuous using a finite Ξ΅/3\varepsilon/3-net (hint: each net member is uniformly continuous on the compact KK).

∣f(x)βˆ’f(y)βˆ£β‰€βˆ₯fβˆ’gjβˆ₯∞+∣gj(x)βˆ’gj(y)∣+βˆ₯gjβˆ’fβˆ₯∞<Ξ΅\lvert f(x) - f(y) \rvert \le \lVert f - g_j \rVert_\infty + \lvert g_j(x) - g_j(y) \rvert + \lVert g_j - f \rVert_\infty < \varepsilon
6 members: sup errors 13β†’14β†’15β†’16β†’17β†’18=0.125\frac13 \to \frac14 \to \frac15 \to \frac16 \to \frac17 \to \frac18 = 0.125 β€” a 32\frac32-Lipschitz sequence with ∣akβˆ£β‰€34|a_k| \le \frac34 converging uniformly.
Show proof
  1. Relatively compact implies totally bounded: for any Ξ΅>0\varepsilon > 0 there is a finite Ξ΅/3\varepsilon/3-net {g1,…,gm}\{g_1, \dots, g_m\} of the closure Fβ€Ύ\overline{F}.

    That is, every f∈Ff \in F has some gjg_j with βˆ₯fβˆ’gjβˆ₯∞<Ξ΅/3\lVert f - g_j \rVert_\infty < \varepsilon/3.

    The gjg_j need not lie in FF β€” continuity is all we need.

  2. Each gjg_j is continuous on the compact metric space KK, hence uniformly continuous (Heine–Cantor): there is Ξ΄j>0\delta_j > 0 with ∣gj(x)βˆ’gj(y)∣<Ξ΅/3\lvert g_j(x) - g_j(y) \rvert < \varepsilon/3 whenever d(x,y)<Ξ΄jd(x, y) < \delta_j. Set Ξ΄=min⁑jΞ΄j>0\delta = \min_j \delta_j > 0 β€” this Ξ΄\delta does not depend on ff.

  3. Now take f∈Ff \in F and x,yx, y with d(x,y)<δd(x, y) < \delta.

    Picking gjg_j with βˆ₯fβˆ’gjβˆ₯∞<Ξ΅/3\lVert f - g_j \rVert_\infty < \varepsilon/3, the triangle inequality gives ∣f(x)βˆ’f(y)βˆ£β‰€βˆ£f(x)βˆ’gj(x)∣+∣gj(x)βˆ’gj(y)∣+∣gj(y)βˆ’f(y)∣<Ξ΅/3+Ξ΅/3+Ξ΅/3=Ξ΅\lvert f(x) - f(y) \rvert \le \lvert f(x) - g_j(x) \rvert + \lvert g_j(x) - g_j(y) \rvert + \lvert g_j(y) - f(y) \rvert < \varepsilon/3 + \varepsilon/3 + \varepsilon/3 = \varepsilon.

    Since δ\delta works for every f∈Ff \in F, the family FF is equicontinuous.

  4. In addition, relative compactness gives uniform boundedness (a bounded set has bounded closure): M=sup⁑f∈Fβˆ₯fβˆ₯∞<∞M = \sup_{f \in F} \lVert f \rVert_\infty < \infty. Conversely, on compact KK, pointwise bounded + equicontinuous implies uniformly bounded: cover KK by a finite Ξ΄\delta-net {y1,…,yr}\{y_1, \dots, y_r\} for the equicontinuity modulus at Ξ΅=1\varepsilon = 1; each xx is Ξ΄\delta-close to some yiy_i, so ∣f(x)βˆ£β‰€βˆ£f(yi)∣+1≀max⁑isup⁑f∣f(yi)∣+1\lvert f(x) \rvert \le \lvert f(y_i) \rvert + 1 \le \max_i \sup_f \lvert f(y_i) \rvert + 1.

Let KK be a compact metric space, {xk}\{x_k\} a countable dense subset of KK, and (fn)(f_n) a sequence in C(K)C(K) with sup⁑nβˆ₯fnβˆ₯βˆžβ‰€M\sup_n \lVert f_n \rVert_\infty \le M.

Construct, by the diagonal argument, a subsequence converging at every xkx_k.

n(1)βŠƒn(2)βŠƒβ‹―(nestedΒ indexΒ sequences),mj=nj(j)Β (diagonal)n^{(1)} \supset n^{(2)} \supset \cdots \quad \text{(nested index sequences)}, \qquad m_j = n^{(j)}_j \ \text{(diagonal)}
6 members: amplitudes ak=12+(βˆ’1)kk+2a_k = \frac12 + \frac{(-1)^k}{k+2} oscillate toward 12\frac12 through 16,34,310,23,514,58\frac16, \frac34, \frac{3}{10}, \frac23, \frac{5}{14}, \frac58 β€” the way diagonal extraction fishes out such an oscillating sequence.
Show proof
  1. A compact metric space is separable (take the union of finite 1/r1/r-nets).

    Now look at (fn)(f_n).

    For each kk, the scalar sequence (fn(xk))n(f_n(x_k))_n is trapped in [βˆ’M,M][-M, M], so by Bolzano–Weierstrass it has a convergent subsequence.

  2. Build nested index sequences: choose n1(1)<n2(1)<β‹―n^{(1)}_1 < n^{(1)}_2 < \cdots so that fnj(1)(x1)f_{n^{(1)}_j}(x_1) converges, and inductively choose n(k)n^{(k)} as a subsequence of n(kβˆ’1)n^{(k-1)} with fnj(k)(xk)f_{n^{(k)}_j}(x_k) convergent. Fixing kk, every later stage refines n(k)n^{(k)}, so convergence at x1,…,xkx_1, \dots, x_k is preserved.

  3. Set the diagonal mj=nj(j)m_j = n^{(j)}_j. First, (mj)(m_j) is strictly increasing: writing ni(j+1)=nΟƒ(j)(i)(j)n^{(j+1)}_i = n^{(j)}_{\sigma^{(j)}(i)} with the strictly increasing refinement map Οƒ(j):Nβ†’N\sigma^{(j)}: \mathbb{N} \to \mathbb{N}, we get mj+1=nj+1(j+1)=nΟƒ(j)(j+1)(j)>nj(j)=mjm_{j+1} = n^{(j+1)}_{j+1} = n^{(j)}_{\sigma^{(j)}(j+1)} > n^{(j)}_j = m_j (since Οƒ(j)(j+1)β‰₯j+1>j\sigma^{(j)}(j+1) \ge j+1 > j β€” a strictly increasing map satisfies Οƒ(i)β‰₯i\sigma(i) \ge i, with equality for the identity refinement).

  4. Fix kk.

    For each jβ‰₯kj \ge k, mj=nj(j)m_j = n^{(j)}_j is a term of (ni(k))(n^{(k)}_i), so write mj=nij(k)m_j = n^{(k)}_{i_j}.

    The nested composition ψk(j)=Οƒ(k)βˆ˜β‹―βˆ˜Οƒ(jβˆ’1)(j)\psi_k(j) = \sigma^{(k)} \circ \cdots \circ \sigma^{(j-1)}(j) gives ij=ψk(j)i_j = \psi_k(j), and strictly increasing composition preserves strict increase, yielding the index inequality ij+1=ψk(j+1)>ψk(j)=iji_{j+1} = \psi_k(j+1) > \psi_k(j) = i_j.

    Hence the tail (mj)jβ‰₯k=(nij(k))jβ‰₯k(m_j)_{j \ge k} = (n^{(k)}_{i_j})_{j \ge k} is a subsequence of (ni(k))(n^{(k)}_i), and fmj(xk)f_{m_j}(x_k) is a subsequence of the convergent sequence (fni(k)(xk))i(f_{n^{(k)}_i}(x_k))_i, so it converges.

    Since kk was arbitrary, (fmj)(f_{m_j}) converges at every xkx_k β€” pointwise convergence on the dense set.

  5. Note: only pointwise boundedness was used here. Upgrading this pointwise convergence to uniform convergence on all of KK is the job of equicontinuity, carried out by the Ξ΅/3\varepsilon/3 argument in the next problem.

Let (fn)βŠ‚C(K)(f_n) \subset C(K) be equicontinuous and pointwise bounded (KK compact metric), converging pointwise on a countable dense set {xk}\{x_k\}.

Prove by the Ξ΅/3\varepsilon/3 argument that the convergence is uniform on all of KK, and deduce as a corollary that (xn)(x^n) has no uniformly convergent subsequence on [0,1][0,1].

∣fp(x)βˆ’fq(x)βˆ£β‰€Ξ΅3+Ξ΅3+Ξ΅3=Ξ΅(p,qβ‰₯N,Β uniformlyΒ Cauchy)\lvert f_p(x) - f_q(x) \rvert \le \tfrac{\varepsilon}{3} + \tfrac{\varepsilon}{3} + \tfrac{\varepsilon}{3} = \varepsilon \quad (p, q \ge N,\ \text{uniformly Cauchy)}
xnβ†’{0x∈[0,1)1x=1(discontinuousΒ pointwiseΒ limit)x^n \to \begin{cases} 0 & x \in [0, 1) \\ 1 & x = 1 \end{cases} \quad \text{(discontinuous pointwise limit)}
6 members: βˆ₯fakβˆ’fβˆ—βˆ₯∞=1k+2β†’0\lVert f_{a_k} - f^* \rVert_\infty = \frac{1}{k+2} \to 0 β€” equicontinuity spreading convergence from the dense set to the whole interval.
Show proof
  1. Given Ξ΅>0\varepsilon > 0, equicontinuity yields Ξ΄>0\delta > 0: d(x,y)<Ξ΄d(x, y) < \delta implies ∣fn(x)βˆ’fn(y)∣<Ξ΅/3\lvert f_n(x) - f_n(y) \rvert < \varepsilon/3 for every nn. Since KK is compact, finitely many points xk1,…,xkrx_{k_1}, \dots, x_{k_r} from the dense set {xk}\{x_k\} form a Ξ΄\delta-net of KK.

  2. At the finitely many net points, the pointwise convergence of (fn)(f_n) itself becomes "uniform": each (fn(xki))(f_n(x_{k_i})) converges, hence is Cauchy, so choose NN so large that p,qβ‰₯Np, q \ge N gives ∣fp(xki)βˆ’fq(xki)∣<Ξ΅/3\lvert f_p(x_{k_i}) - f_q(x_{k_i}) \rvert < \varepsilon/3 for every ii (a finite intersection of tails).

  3. For arbitrary x∈Kx \in K, pick xkix_{k_i} with d(x,xki)<δd(x, x_{k_i}) < \delta.

    By the triangle inequality, for p,qβ‰₯Np, q \ge N, ∣fp(x)βˆ’fq(x)βˆ£β‰€βˆ£fp(x)βˆ’fp(xki)∣+∣fp(xki)βˆ’fq(xki)∣+∣fq(xki)βˆ’fq(x)∣<Ξ΅/3+Ξ΅/3+Ξ΅/3=Ξ΅\lvert f_p(x) - f_q(x) \rvert \le \lvert f_p(x) - f_p(x_{k_i}) \rvert + \lvert f_p(x_{k_i}) - f_q(x_{k_i}) \rvert + \lvert f_q(x_{k_i}) - f_q(x) \rvert < \varepsilon/3 + \varepsilon/3 + \varepsilon/3 = \varepsilon.

    Hence (fn)(f_n) itself is uniformly Cauchy, so (fn)(f_n) converges uniformly by completeness of C(K)C(K).

  4. This completes (⟸\Longleftarrow): pointwise bounded + equicontinuous implies uniformly bounded (as noted in the first problem).

    Also, applying the diagonal extraction of the previous problem to any sequence gives a subsequence converging on the dense set, and applying steps 1–3 to that subsequence shows it converges uniformly.

    Hence every sequence has a uniformly convergent subsequence, so by sequential compactness in metric spaces the set is relatively compact.

  5. Corollary: (xn)(x^n) has no uniformly convergent subsequence on [0,1][0,1].

    Its pointwise limit is discontinuous β€” 0 on [0,1)[0,1), 1 at x=1x = 1. If some subsequence converged uniformly, its limit would be continuous (a uniform limit of continuous functions) and would have to equal the pointwise limit β€” contradiction.

    So {xn}\{x^n\} is not equicontinuous at x=1x = 1, and not totally bounded either: the subsequence x4kx^{4^k} is 7/167/16-separated β€” for a=4k<4β„“=ba = 4^k < 4^\ell = b, at the witness point x=2βˆ’1/ax = 2^{-1/a} we have xa=1/2x^a = 1/2 and xb=2βˆ’b/a≀2βˆ’4=1/16x^b = 2^{-b/a} \le 2^{-4} = 1/16, so βˆ₯xaβˆ’xbβˆ₯∞β‰₯1/2βˆ’1/16=7/16=0.4375β‰₯0.4\lVert x^a - x^b \rVert_\infty \ge 1/2 - 1/16 = 7/16 = 0.4375 \ge 0.4.

    (Not every distinct pair is this far apart: βˆ₯xβˆ’x2βˆ₯∞=1/4\lVert x - x^2 \rVert_\infty = 1/4.)

6. Approximation