Double Sequences and Iterated Limits

This scene is about double sequences. Watch the values am,na_{m,n} on a grid, and see how the row-wise and column-wise limits split apart. The double limit lets both indices grow together. An iterated limit sends one index first, then the other. Swapping the order can change the answer. And even when both iterated limits agree, the double limit may not exist. For example, reading a πŸ“‹ table row by row is not the same as reading it column by column. Change the reading order, and you can land on a completely different conclusion.

am,nβ†’Lβ€…β€ŠβŸΊβ€…β€Šβˆ€Ξ΅>0Β βˆƒN:m,n>Nβ€…β€ŠβŸΉβ€…β€Šβˆ£am,nβˆ’L∣<Ξ΅a_{m,n} \to L \iff \forall \varepsilon > 0\ \exists N : m, n > N \implies |a_{m,n} - L| < \varepsilon
lim⁑mlim⁑nam,nvslim⁑nlim⁑mam,n\lim_m \lim_n a_{m,n} \quad \text{vs} \quad \lim_n \lim_m a_{m,n}

Examples & Exercises

For the double sequence am,n=mm+na_{m,n} = \frac{m}{m+n}, prove completely: (i) For each fixed mm, lim⁑nβ†’βˆžam,n=0\lim_{n\to\infty} a_{m,n} = 0, so the iterated limit lim⁑mβ†’βˆžlim⁑nβ†’βˆžam,n=0\lim_{m\to\infty}\lim_{n\to\infty} a_{m,n} = 0. (ii) For each fixed nn, lim⁑mβ†’βˆžam,n=1\lim_{m\to\infty} a_{m,n} = 1, so the iterated limit lim⁑nβ†’βˆžlim⁑mβ†’βˆžam,n=1\lim_{n\to\infty}\lim_{m\to\infty} a_{m,n} = 1. (iii) Nevertheless the double limit lim⁑m,nβ†’βˆžam,n\lim_{m,n\to\infty} a_{m,n} (the Pringsheim limit) does not exist.

lim⁑nβ†’βˆžmm+n=0(mΒ fixed),lim⁑mβ†’βˆžmm+n=1(nΒ fixed)\lim_{n\to\infty} \frac{m}{m+n} = 0 \quad (m \text{ fixed}), \qquad \lim_{m\to\infty} \frac{m}{m+n} = 1 \quad (n \text{ fixed})
ak,k=12,ak,k2=11+k→0a_{k,k} = \frac{1}{2}, \qquad a_{k,k^2} = \frac{1}{1+k} \to 0
am,n=mm+na_{m,n} = \frac{m}{m+n}: every row limit is 00, every column limit is 11 β€” and the diagonal sits at 12\frac{1}{2} forever.
Show proof
  1. (i) Fix mm. Since m+n>nm + n > n, 0<am,n=mm+n<mn0 < a_{m,n} = \frac{m}{m+n} < \frac{m}{n}. Given Ξ΅>0\varepsilon > 0, take N>mΞ΅N > \frac{m}{\varepsilon}. For n>Nn > N, mn<Ξ΅\frac{m}{n} < \varepsilon, so ∣am,nβˆ’0∣<Ξ΅|a_{m,n} - 0| < \varepsilon. Hence lim⁑nβ†’βˆžam,n=0\lim_{n\to\infty} a_{m,n} = 0 for every mm, and since the inner limit is the constant 00, lim⁑mβ†’βˆžlim⁑nβ†’βˆžam,n=lim⁑mβ†’βˆž0=0\lim_{m\to\infty}\lim_{n\to\infty} a_{m,n} = \lim_{m\to\infty} 0 = 0.
  2. (ii) Fix nn. Since am,n=mm+n=1βˆ’nm+na_{m,n} = \frac{m}{m+n} = 1 - \frac{n}{m+n}, ∣am,nβˆ’1∣=nm+n<nm|a_{m,n} - 1| = \frac{n}{m+n} < \frac{n}{m}. Given Ξ΅>0\varepsilon > 0, take N>nΞ΅N > \frac{n}{\varepsilon}. For m>Nm > N, nm<Ξ΅\frac{n}{m} < \varepsilon, so ∣am,nβˆ’1∣<Ξ΅|a_{m,n} - 1| < \varepsilon. Hence lim⁑mβ†’βˆžam,n=1\lim_{m\to\infty} a_{m,n} = 1 for every nn, and lim⁑nβ†’βˆžlim⁑mβ†’βˆžam,n=lim⁑nβ†’βˆž1=1\lim_{n\to\infty}\lim_{m\to\infty} a_{m,n} = \lim_{n\to\infty} 1 = 1.
  3. (iii) Suppose a double limit LL existed. For Ξ΅=18\varepsilon = \frac{1}{8} there is NN with ∣am,nβˆ’L∣<18|a_{m,n} - L| < \frac{1}{8} whenever m,n>Nm, n > N. At the diagonal points (k,k)(k, k) with k>Nk > N, ak,k=kk+k=12a_{k,k} = \frac{k}{k+k} = \frac{1}{2}, so ∣12βˆ’L∣<18\left|\frac{1}{2} - L\right| < \frac{1}{8}, giving L>38L > \frac{3}{8}. At the points (k,k2)(k, k^2) with k>max⁑(N,8)k > \max(N, 8), ak,k2=kk+k2=11+k<19<18a_{k,k^2} = \frac{k}{k+k^2} = \frac{1}{1+k} < \frac{1}{9} < \frac{1}{8}, and ∣ak,k2βˆ’L∣<18|a_{k,k^2} - L| < \frac{1}{8}, giving L<18+18=14L < \frac{1}{8} + \frac{1}{8} = \frac{1}{4}. Since 14<38\frac{1}{4} < \frac{3}{8}, the two conclusions collide. Hence no double limit exists. Remark: the mere fact that the iterated limits in (i) and (ii) differ already forces this, by the contrapositive of the theorem in Problem 2.

Prove the following theorem completely. If a double sequence am,na_{m,n} converges to LL in the Pringsheim sense (for every Ξ΅>0\varepsilon > 0 there is NN with ∣am,nβˆ’L∣<Ξ΅|a_{m,n} - L| < \varepsilon whenever m,n>Nm, n > N), and for each fixed mm the inner limit bm=lim⁑nβ†’βˆžam,nb_m = \lim_{n\to\infty} a_{m,n} exists, then lim⁑mβ†’βˆžbm=L\lim_{m\to\infty} b_m = L. Conclude: when the double limit exists and both iterated limits exist, both iterated limits equal the double limit.

m,n>Nβ€…β€ŠβŸΉβ€…β€Šβˆ£am,nβˆ’L∣<Ξ΅2,∣bmβˆ’Lβˆ£β‰€Ξ΅2<Ξ΅(m>N)m, n > N \implies |a_{m,n} - L| < \frac{\varepsilon}{2}, \qquad |b_m - L| \le \frac{\varepsilon}{2} < \varepsilon \quad (m > N)
am,n=(βˆ’1)nma_{m,n} = \frac{(-1)^n}{m}: the double limit is 00, and in the order where the inner limits exist the iterated limit is 00 too β€” exactly as the theorem predicts.
Show proof
  1. Fix Ξ΅>0\varepsilon > 0. Applying the definition of the double limit with Ξ΅2\frac{\varepsilon}{2} gives an NN such that m,n>Nβ€…β€ŠβŸΉβ€…β€Šβˆ£am,nβˆ’L∣<Ξ΅2m, n > N \implies |a_{m,n} - L| < \frac{\varepsilon}{2}.
  2. Now fix m>Nm > N. For every n>Nn > N, ∣am,nβˆ’L∣<Ξ΅2|a_{m,n} - L| < \frac{\varepsilon}{2}. We show ∣bmβˆ’Lβˆ£β‰€Ξ΅2|b_m - L| \le \frac{\varepsilon}{2}. Suppose instead ∣bmβˆ’L∣>Ξ΅2|b_m - L| > \frac{\varepsilon}{2}, and put Ξ΄=∣bmβˆ’Lβˆ£βˆ’Ξ΅2>0\delta = |b_m - L| - \frac{\varepsilon}{2} > 0. Since am,nβ†’bma_{m,n} \to b_m as nβ†’βˆžn \to \infty, for all large nn (in particular some n>Nn > N) we have ∣am,nβˆ’bm∣<Ξ΄|a_{m,n} - b_m| < \delta. Then ∣am,nβˆ’L∣β‰₯∣bmβˆ’Lβˆ£βˆ’βˆ£am,nβˆ’bm∣>∣bmβˆ’Lβˆ£βˆ’Ξ΄=Ξ΅2|a_{m,n} - L| \ge |b_m - L| - |a_{m,n} - b_m| > |b_m - L| - \delta = \frac{\varepsilon}{2}, contradicting the previous step. Hence ∣bmβˆ’Lβˆ£β‰€Ξ΅2<Ξ΅|b_m - L| \le \frac{\varepsilon}{2} < \varepsilon.
  3. That is, ∣bmβˆ’L∣<Ξ΅|b_m - L| < \varepsilon for every m>Nm > N. Since Ξ΅>0\varepsilon > 0 was arbitrary, lim⁑mβ†’βˆžbm=L\lim_{m\to\infty} b_m = L: that is, lim⁑mβ†’βˆžlim⁑nβ†’βˆžam,n=L\lim_{m\to\infty}\lim_{n\to\infty} a_{m,n} = L. The symmetric argument shows that if lim⁑mβ†’βˆžam,n\lim_{m\to\infty} a_{m,n} exists for each nn, then lim⁑nβ†’βˆžlim⁑mβ†’βˆžam,n=L\lim_{n\to\infty}\lim_{m\to\infty} a_{m,n} = L. Therefore, when the double limit exists and both iterated limits exist, all three agree.

For the double sequence am,n=(βˆ’1)nma_{m,n} = \frac{(-1)^n}{m}, prove completely: (i) The double limit lim⁑m,nβ†’βˆžam,n=0\lim_{m,n\to\infty} a_{m,n} = 0 exists. (ii) But for each fixed mm, lim⁑nβ†’βˆžam,n\lim_{n\to\infty} a_{m,n} does not exist, so the iterated limit lim⁑mβ†’βˆžlim⁑nβ†’βˆžam,n\lim_{m\to\infty}\lim_{n\to\infty} a_{m,n} does not exist. (iii) The other iterated limit lim⁑nβ†’βˆžlim⁑mβ†’βˆžam,n\lim_{n\to\infty}\lim_{m\to\infty} a_{m,n} does exist and equals 00.

∣am,n∣=1m,am,2j=1m,am,2j+1=βˆ’1m|a_{m,n}| = \frac{1}{m}, \qquad a_{m,2j} = \frac{1}{m}, \qquad a_{m,2j+1} = -\frac{1}{m}
am,n=(βˆ’1)nma_{m,n} = \frac{(-1)^n}{m}: each row oscillates between Β±1m\pm\frac{1}{m} forever, but the amplitude itself dies to 00 as the row index grows.
Show proof
  1. (i) For all m,nm, n, ∣am,nβˆ’0∣=∣(βˆ’1)n∣m=1m|a_{m,n} - 0| = \frac{|(-1)^n|}{m} = \frac{1}{m} β€” no dependence on nn at all. Given Ξ΅>0\varepsilon > 0, take N>1Ξ΅N > \frac{1}{\varepsilon}. If m>Nm > N (whatever nn is), then ∣am,n∣=1m<1N<Ξ΅|a_{m,n}| = \frac{1}{m} < \frac{1}{N} < \varepsilon. Hence am,nβ†’0a_{m,n} \to 0 in the Pringsheim sense.
  2. (ii) Fix mm. At even n=2jn = 2j, am,n=1ma_{m,n} = \frac{1}{m}; at odd n=2j+1n = 2j+1, am,n=βˆ’1ma_{m,n} = -\frac{1}{m}. Suppose a limit b=lim⁑nβ†’βˆžam,nb = \lim_{n\to\infty} a_{m,n} existed. For Ξ΅0=12m>0\varepsilon_0 = \frac{1}{2m} > 0 there is N0N_0 with ∣am,nβˆ’b∣<Ξ΅0|a_{m,n} - b| < \varepsilon_0 for all n>N0n > N_0. Choosing an even n>N0n > N_0 gives ∣1mβˆ’b∣<12m\left|\frac{1}{m} - b\right| < \frac{1}{2m}; choosing an odd n>N0n > N_0 gives βˆ£βˆ’1mβˆ’b∣<12m\left|-\frac{1}{m} - b\right| < \frac{1}{2m}. By the triangle inequality, 2m=∣(1mβˆ’b)+(b+1m)βˆ£β‰€βˆ£1mβˆ’b∣+βˆ£βˆ’1mβˆ’b∣<12m+12m=1m\frac{2}{m} = \left|\left(\frac{1}{m} - b\right) + \left(b + \frac{1}{m}\right)\right| \le \left|\frac{1}{m} - b\right| + \left|-\frac{1}{m} - b\right| < \frac{1}{2m} + \frac{1}{2m} = \frac{1}{m} β€” the false inequality 2m<1m\frac{2}{m} < \frac{1}{m}. This contradiction shows lim⁑nβ†’βˆžam,n\lim_{n\to\infty} a_{m,n} does not exist. Since this holds for every mm, the iterated limit lim⁑mβ†’βˆžlim⁑nβ†’βˆžam,n\lim_{m\to\infty}\lim_{n\to\infty} a_{m,n} does not exist.
  3. (iii) For fixed nn, ∣am,n∣=1mβ†’0|a_{m,n}| = \frac{1}{m} \to 0 as mβ†’βˆžm \to \infty, so lim⁑mβ†’βˆžam,n=0\lim_{m\to\infty} a_{m,n} = 0 for every nn. Hence lim⁑nβ†’βˆžlim⁑mβ†’βˆžam,n=lim⁑nβ†’βˆž0=0\lim_{n\to\infty}\lim_{m\to\infty} a_{m,n} = \lim_{n\to\infty} 0 = 0, matching the double limit in (i). There is no conflict with the theorem of Problem 2: it only speaks about an order in which the inner limits exist, and here they exist in just one order.

3. Sequences