Weierstrass Approximation Theorem
Can polynomials alone imitate every continuous function on an interval?
A Bernstein polynomial averages the function's values near each point. As the degree grows, the average concentrates near that point. So the polynomial follows even the bumpy corners. The proof's fine estimates are only sketched.
For example, think of replacing a slope with a πͺ staircase. The finer the steps, the smaller the gap anywhere you measure. Raising the degree presses the polynomial onto the whole function at once.
B n ( f ) ( x ) = β k = 0 n f ββ£ ( k n ) ( n k ) x k ( 1 β x ) n β k B_n(f)(x) = \sum_{k=0}^{n} f\!\left(\frac{k}{n}\right) \binom{n}{k} x^k (1-x)^{n-k} B n β ( f ) ( x ) = k = 0 β n β f ( n k β ) ( k n β ) x k ( 1 β x ) n β k
f β C [ 0 , 1 ] β
β βΉ β
β β₯ B n ( f ) β f β₯ β β 0 f \in C[0,1] \implies \|B_n(f) - f\|_\infty \to 0 f β C [ 0 , 1 ] βΉ β₯ B n β ( f ) β f β₯ β β β 0
Part of these learning paths
Examples & Exercises
Prove that B n ( 1 ) = 1 B_n(1) = 1 B n β ( 1 ) = 1 β the constant function is reproduced exactly.
B n ( 1 ) ( x ) = β k = 0 n ( n k ) x k ( 1 β x ) n β k = ( x + ( 1 β x ) ) n = 1 B_n(1)(x) = \sum_{k=0}^{n}\binom{n}{k}x^k(1-x)^{n-k} = (x+(1-x))^n = 1 B n β ( 1 ) ( x ) = k = 0 β n β ( k n β ) x k ( 1 β x ) n β k = ( x + ( 1 β x ) ) n = 1
The constant 1 β the approximant coincides exactly.
Show proof
Since f β‘ 1 f \equiv 1 f β‘ 1 , we have f ( k / n ) = 1 f(k/n) = 1 f ( k / n ) = 1 . Hence B n ( 1 ) ( x ) = β k = 0 n ( n k ) x k ( 1 β x ) n β k B_n(1)(x) = \sum_{k=0}^{n}\binom{n}{k}x^k(1-x)^{n-k} B n β ( 1 ) ( x ) = β k = 0 n β ( k n β ) x k ( 1 β x ) n β k β just the sum of the basis functions.
By the binomial theorem, β k = 0 n ( n k ) x k ( 1 β x ) n β k = ( x + ( 1 β x ) ) n = 1 n = 1 \sum_{k=0}^{n}\binom{n}{k}x^k(1-x)^{n-k} = (x + (1-x))^n = 1^n = 1 β k = 0 n β ( k n β ) x k ( 1 β x ) n β k = ( x + ( 1 β x ) ) n = 1 n = 1 .
So B n ( 1 ) ( x ) = 1 B_n(1)(x) = 1 B n β ( 1 ) ( x ) = 1 for every x x x and every n n n β zero error. The constant is not approximated; it is reproduced.
Prove that B n ( x ) = x B_n(x) = x B n β ( x ) = x for n β₯ 1 n \ge 1 n β₯ 1 .
β k = 0 n k n ( n k ) x k ( 1 β x ) n β k = x \sum_{k=0}^{n}\frac{k}{n}\binom{n}{k}x^k(1-x)^{n-k} = x k = 0 β n β n k β ( k n β ) x k ( 1 β x ) n β k = x
The identity β reproduced exactly too.
Show proof
Setup: fix an integer n β₯ 1 n \ge 1 n β₯ 1 (for n = 0 n = 0 n = 0 the values f ( k / n ) f(k/n) f ( k / n ) involve division by zero). The target function is f ( t ) = t f(t) = t f ( t ) = t , so f ( k / n ) = k / n f(k/n) = k/n f ( k / n ) = k / n .
For k β₯ 1 k \geq 1 k β₯ 1 , k ( n k ) = n ( n β 1 k β 1 ) k\binom{n}{k} = n\binom{n-1}{k-1} k ( k n β ) = n ( k β 1 n β 1 β ) (the k = 0 k = 0 k = 0 term vanishes since k n = 0 \frac{k}{n} = 0 n k β = 0 ).
Substituting gives B n ( x ) ( x ) = β k = 1 n k n ( n k ) x k ( 1 β x ) n β k = x β j = 0 n β 1 ( n β 1 j ) x j ( 1 β x ) n β 1 β j B_n(x)(x) = \sum_{k=1}^{n}\frac{k}{n}\binom{n}{k}x^k(1-x)^{n-k} = x\sum_{j=0}^{n-1}\binom{n-1}{j}x^j(1-x)^{n-1-j} B n β ( x ) ( x ) = β k = 1 n β n k β ( k n β ) x k ( 1 β x ) n β k = x β j = 0 n β 1 β ( j n β 1 β ) x j ( 1 β x ) n β 1 β j (setting j = k β 1 j = k-1 j = k β 1 ).
By the binomial theorem the inner sum is ( x + ( 1 β x ) ) n β 1 = 1 (x+(1-x))^{n-1} = 1 ( x + ( 1 β x ) ) n β 1 = 1 , so B n ( x ) ( x ) = x B_n(x)(x) = x B n β ( x ) ( x ) = x β the identity is also reproduced exactly for every n β₯ 1 n \ge 1 n β₯ 1 .
Prove that the uniform limit of continuous functions is continuous (the Ξ΅ / 3 \varepsilon/3 Ξ΅ /3 argument).
β£ f ( x ) β f ( x 0 ) β£ β€ β£ f β f N β£ + β£ f N ( x ) β f N ( x 0 ) β£ + β£ f N β f β£ < Ξ΅ |f(x)-f(x_0)| \le |f-f_N| + |f_N(x)-f_N(x_0)| + |f_N-f| < \varepsilon β£ f ( x ) β f ( x 0 β ) β£ β€ β£ f β f N β β£ + β£ f N β ( x ) β f N β ( x 0 β ) β£ + β£ f N β β f β£ < Ξ΅
n = 40 n = 40 n = 40 β even the kink is nearly matched.
Show proof
Let x 0 β [ a , b ] x_0 \in [a,b] x 0 β β [ a , b ] be arbitrary and let Ξ΅ > 0 \varepsilon > 0 Ξ΅ > 0 be given. Since f N β f f_N \to f f N β β f uniformly, pick N N N with β₯ f N β f β₯ β < Ξ΅ 3 \lVert f_N - f\rVert_\infty < \frac{\varepsilon}{3} β₯ f N β β f β₯ β β < 3 Ξ΅ β .
Since f N f_N f N β is continuous at x 0 x_0 x 0 β , pick Ξ΄ > 0 \delta > 0 Ξ΄ > 0 such that β£ x β x 0 β£ < Ξ΄ \lvert x - x_0\rvert < \delta β£ x β x 0 β β£ < Ξ΄ implies β£ f N ( x ) β f N ( x 0 ) β£ < Ξ΅ 3 \lvert f_N(x) - f_N(x_0)\rvert < \frac{\varepsilon}{3} β£ f N β ( x ) β f N β ( x 0 β )β£ < 3 Ξ΅ β .
By the triangle inequality, β£ f ( x ) β f ( x 0 ) β£ β€ β£ f β f N β£ + β£ f N ( x ) β f N ( x 0 ) β£ + β£ f N β f β£ < Ξ΅ 3 + Ξ΅ 3 + Ξ΅ 3 = Ξ΅ \lvert f(x) - f(x_0)\rvert \leq \lvert f - f_N\rvert + \lvert f_N(x) - f_N(x_0)\rvert + \lvert f_N - f\rvert < \frac{\varepsilon}{3} + \frac{\varepsilon}{3} + \frac{\varepsilon}{3} = \varepsilon β£ f ( x ) β f ( x 0 β )β£ β€ β£ f β f N β β£ + β£ f N β ( x ) β f N β ( x 0 β )β£ + β£ f N β β f β£ < 3 Ξ΅ β + 3 Ξ΅ β + 3 Ξ΅ β = Ξ΅ β so f f f is continuous at x 0 x_0 x 0 β . Since x 0 β [ a , b ] x_0 \in [a,b] x 0 β β [ a , b ] was arbitrary, f f f is continuous on all of [ a , b ] [a,b] [ a , b ] .
(This is also why the uniform norm β₯ β
β₯ β \lVert\cdot\rVert_\infty β₯ β
β₯ β β makes C [ 0 , 1 ] C[0,1] C [ 0 , 1 ] a closed space.)
6. Approximation