The Cauchy Product

How do the terms pair up when two series are multiplied?

Each product term gathers pairs along a diagonal of the lattice, as in the formula below. If one side converges absolutely, the product lands on the product of the sums. If both converge only conditionally, the diagonal sums can collapse.

For example, picture πŸ“¦ boxes in a grid, picked up one diagonal at a time. If the boxes shrink fast enough, the basket's total settles down.

cn=βˆ‘k=0nakbnβˆ’kc_n = \sum_{k=0}^{n} a_k b_{n-k}
βˆ‘βˆ£an∣<∞,Β βˆ‘bn=BΒ β‡’Β βˆ‘cn=AB\sum |a_n| < \infty,\ \sum b_n = B\ \Rightarrow\ \sum c_n = AB

Examples & Exercises

Prove Mertens' theorem: if βˆ‘an\sum a_n converges absolutely to AA and βˆ‘bn\sum b_n converges to BB, then the Cauchy product cn=βˆ‘k=0nakbnβˆ’kc_n = \sum_{k=0}^{n} a_k b_{n-k} satisfies βˆ‘cn=AB\sum c_n = AB.

CN=βˆ‘n=0Ncn=βˆ‘k=0NakBNβˆ’k,BM=βˆ‘m=0MbmC_N = \sum_{n=0}^{N} c_n = \sum_{k=0}^{N} a_k B_{N-k},\qquad B_M = \sum_{m=0}^{M} b_m
CNβˆ’AB=(ANβˆ’A)Bβˆ’βˆ‘k=0NakRNβˆ’k,RM=Bβˆ’BMβ†’0C_N - AB = (A_N - A)B - \sum_{k=0}^{N} a_k R_{N-k},\qquad R_M = B - B_M \to 0
βˆ£βˆ‘k=0Nβˆ’Mβˆ’1akRNβˆ’kβˆ£β‰€Ξ΅βˆ‘k=0∞∣ak∣\left|\sum_{k=0}^{N-M-1} a_k R_{N-k}\right| \leq \varepsilon \sum_{k=0}^{\infty} |a_k|
n=12n = 12, ak=bk=1/k!a_k = b_k = 1/k!: C12β‰ˆ7.3890546C_{12} \approx 7.3890546 and A12B12β‰ˆ7.3890561A_{12}B_{12} \approx 7.3890561 β€” the two sequences climb to e2e^2 together, with c12=212/12!β‰ˆ8.55Γ—10βˆ’6c_{12} = 2^{12}/12! \approx 8.55 \times 10^{-6}.
Show proof
  1. Write AN,BN,CNA_N, B_N, C_N for the partial sums.

    In CN=βˆ‘n=0Nβˆ‘k=0nakbnβˆ’kC_N = \sum_{n=0}^{N}\sum_{k=0}^{n} a_k b_{n-k}, substituting m=nβˆ’km = n-k turns each term into akbma_k b_m with k+m≀Nk + m \leq N, so reordering the finite sum gives CN=βˆ‘k=0Nak(βˆ‘m=0Nβˆ’kbm)=βˆ‘k=0NakBNβˆ’kC_N = \sum_{k=0}^{N} a_k \left(\sum_{m=0}^{N-k} b_m\right) = \sum_{k=0}^{N} a_k B_{N-k}.

    This rearrangement is legal because the sum is finite.

  2. With the remainder RM=Bβˆ’BMβ†’0R_M = B - B_M \to 0, BNβˆ’k=Bβˆ’RNβˆ’kB_{N-k} = B - R_{N-k}, so CN=ANBβˆ’βˆ‘k=0NakRNβˆ’kC_N = A_N B - \sum_{k=0}^{N} a_k R_{N-k}, hence CNβˆ’AB=(ANβˆ’A)Bβˆ’βˆ‘k=0NakRNβˆ’kC_N - AB = (A_N - A)B - \sum_{k=0}^{N} a_k R_{N-k}. The first term tends to 00 because ANβ†’AA_N \to A.

  3. Control the second term.

    Absolute convergence gives Ξ±=βˆ‘k=0∞∣ak∣<∞\alpha = \sum_{k=0}^{\infty} |a_k| < \infty.

    Given Ρ>0\varepsilon > 0, pick MM with ∣Rm∣<Ρ|R_m| < \varepsilon for m>Mm > M.

    Only for N>MN > M (all sufficiently large NN) split the sum at k=Nβˆ’Mk = N-M: on the head, ∣RNβˆ’k∣<Ξ΅|R_{N-k}| < \varepsilon, so βˆ£βˆ‘k=0Nβˆ’Mβˆ’1akRNβˆ’kβˆ£β‰€Ξ΅Ξ±\left|\sum_{k=0}^{N-M-1} a_k R_{N-k}\right| \leq \varepsilon \alpha.

  4. The tail has only M+1M+1 terms (for N>MN > M).

    The correct bound is βˆ£βˆ‘k=Nβˆ’MNakRNβˆ’kβˆ£β‰€(max⁑0≀m≀M∣Rm∣)β‹…βˆ‘k=Nβˆ’MN∣ak∣\left|\sum_{k=N-M}^{N} a_k R_{N-k}\right| \leq \left(\max_{0 \leq m \leq M} |R_m|\right) \cdot \sum_{k=N-M}^{N} |a_k| β€” a sum of products needs the sum of ∣ak∣|a_k|, not a single max⁑∣ak∣\max |a_k|.

    For fixed MM, βˆ‘k=Nβˆ’MN∣akβˆ£β‰€βˆ‘k>Nβˆ’M∣akβˆ£β†’0\sum_{k=N-M}^{N} |a_k| \le \sum_{k > N-M} |a_k| \to 0 as Nβ†’βˆžN \to \infty (the tail of the absolutely convergent βˆ‘βˆ£ak∣\sum |a_k|), so the tail tends to 00.

    Hence lim sup⁑Nβ†’βˆžβˆ£βˆ‘k=0NakRNβˆ’kβˆ£β‰€Ξ΅Ξ±\limsup_{N \to \infty} \left|\sum_{k=0}^{N} a_k R_{N-k}\right| \leq \varepsilon \alpha, and Ξ΅\varepsilon was arbitrary, so the sum tends to 00.

  5. Both terms tend to 00, so CNβˆ’ABβ†’0C_N - AB \to 0, i.e. βˆ‘cn=AB\sum c_n = AB. The crux was the Ρα\varepsilon \alpha step: the absolutely convergent βˆ‘βˆ£ak∣\sum |a_k| crushes the tail βˆ‘akRNβˆ’k\sum a_k R_{N-k} so that RNβˆ’kR_{N-k} is uniformly small β€” the conditionally convergent bb side alone cannot do this (see the counterexample in problem 3).

Show that the Cauchy product of the exponential series βˆ‘k=0∞1/k!=e\sum_{k=0}^{\infty} 1/k! = e with itself is e2e^2: prove cn=βˆ‘k=0n1k!(nβˆ’k)!=2nn!c_n = \sum_{k=0}^{n} \frac{1}{k!(n-k)!} = \frac{2^n}{n!} by the binomial theorem, and justify βˆ‘cn=e2\sum c_n = e^2 via Mertens' theorem.

cn=βˆ‘k=0n1k!(nβˆ’k)!=1n!βˆ‘k=0n(nk)=2nn!c_n = \sum_{k=0}^{n} \frac{1}{k!(n-k)!} = \frac{1}{n!} \sum_{k=0}^{n} \binom{n}{k} = \frac{2^n}{n!}
βˆ‘n=0∞cn=βˆ‘n=0∞2nn!=e2\sum_{n=0}^{\infty} c_n = \sum_{n=0}^{\infty} \frac{2^n}{n!} = e^2
n=10n = 10: c10=210/10!β‰ˆ2.82Γ—10βˆ’4c_{10} = 2^{10}/10! \approx 2.82 \times 10^{-4}, C10β‰ˆ7.3889947C_{10} \approx 7.3889947, A10B10β‰ˆ7.3890560A_{10}B_{10} \approx 7.3890560 β€” the Cauchy-product partial sums and the product of partial sums approach e2e^2 together.
Show proof
  1. With ak=bk=1/k!a_k = b_k = 1/k!, the Cauchy-product term is cn=βˆ‘k=0n1k!β‹…1(nβˆ’k)!c_n = \sum_{k=0}^{n} \frac{1}{k!} \cdot \frac{1}{(n-k)!}. Multiplying and dividing by n!n! gives 1k!(nβˆ’k)!=1n!(nk)\frac{1}{k!(n-k)!} = \frac{1}{n!} \binom{n}{k}, so cn=1n!βˆ‘k=0n(nk)c_n = \frac{1}{n!} \sum_{k=0}^{n} \binom{n}{k}.

  2. By the binomial theorem (1+1)n=βˆ‘k=0n(nk)(1+1)^n = \sum_{k=0}^{n} \binom{n}{k}, the inner sum is 2n2^n, so cn=2nn!c_n = \frac{2^n}{n!}. The Cauchy-product series is therefore βˆ‘n=0∞cn=βˆ‘n=0∞2nn!\sum_{n=0}^{\infty} c_n = \sum_{n=0}^{\infty} \frac{2^n}{n!}, which is the exponential series at x=2x = 2, summing to e2e^2.

  3. This computation is legitimate because the exponential series converges absolutely: the ratio test gives 1/(k+1)!1/k!=1k+1β†’0\frac{1/(k+1)!}{1/k!} = \frac{1}{k+1} \to 0, so Mertens' theorem (problem 1) applies and yields βˆ‘cn=eβ‹…e=e2\sum c_n = e \cdot e = e^2 β€” the series version of the exponent law e1β‹…e1=e2e^1 \cdot e^1 = e^2.

Put ak=bk=(βˆ’1)kk+1a_k = b_k = \frac{(-1)^k}{\sqrt{k+1}}.

Both series βˆ‘ak\sum a_k, βˆ‘bk\sum b_k converge, but show ∣cn∣β‰₯2(n+1)n+2β‰₯1|c_n| \geq \frac{2(n+1)}{n+2} \geq 1 to prove the Cauchy product βˆ‘cn\sum c_n diverges.

(Hint: AM-GM.)

∣cn∣=βˆ‘k=0n1(k+1)(nβˆ’k+1)β‰₯(n+1)β‹…2n+2β‰₯1|c_n| = \sum_{k=0}^{n} \frac{1}{\sqrt{(k+1)(n-k+1)}} \geq (n+1)\cdot\frac{2}{n+2} \geq 1
(k+1)(nβˆ’k+1)≀((k+1)+(nβˆ’k+1)2)2=(n+22)2(k+1)(n-k+1) \leq \left(\frac{(k+1)+(n-k+1)}{2}\right)^2 = \left(\frac{n+2}{2}\right)^2
cnβ†’ΜΈ0βŸΉβˆ‘cnΒ divergesc_n \not\to 0 \quad\Longrightarrow\quad \sum c_n \text{ diverges}
n=20n = 20: ∣c20βˆ£β‰ˆ2.516872β‰₯1.909091β‰₯1|c_{20}| \approx 2.516872 \geq 1.909091 \geq 1, so cnβ†’ΜΈ0c_n \not\to 0. C20β‰ˆ1.627909C_{20} \approx 1.627909 drifts and A20B20β‰ˆ0.507955A_{20}B_{20} \approx 0.507955 does not settle either.
Show proof
  1. First, both factor series converge: ak=(βˆ’1)kk+1a_k = \frac{(-1)^k}{\sqrt{k+1}} alternates in sign and 1k+1\frac{1}{\sqrt{k+1}} decreases monotonically to 00, so Leibniz's test applies. But βˆ‘βˆ£ak∣=βˆ‘1k+1\sum |a_k| = \sum \frac{1}{\sqrt{k+1}} is a pp-series with p=12p = \frac12, hence diverges β€” the convergence is conditional.

  2. The Cauchy-product term is cn=βˆ‘k=0n(βˆ’1)kk+1β‹…(βˆ’1)nβˆ’knβˆ’k+1=(βˆ’1)nβˆ‘k=0n1(k+1)(nβˆ’k+1)c_n = \sum_{k=0}^{n} \frac{(-1)^k}{\sqrt{k+1}} \cdot \frac{(-1)^{n-k}}{\sqrt{n-k+1}} = (-1)^n \sum_{k=0}^{n} \frac{1}{\sqrt{(k+1)(n-k+1)}}, so ∣cn∣=βˆ‘k=0n1(k+1)(nβˆ’k+1)|c_n| = \sum_{k=0}^{n} \frac{1}{\sqrt{(k+1)(n-k+1)}}.

  3. By AM-GM, (k+1)(nβˆ’k+1)≀((k+1)+(nβˆ’k+1)2)2=(n+22)2(k+1)(n-k+1) \leq \left(\frac{(k+1)+(n-k+1)}{2}\right)^2 = \left(\frac{n+2}{2}\right)^2.

    Hence each summand 1(k+1)(nβˆ’k+1)β‰₯2n+2\frac{1}{\sqrt{(k+1)(n-k+1)}} \geq \frac{2}{n+2}, and with n+1n+1 summands, ∣cn∣β‰₯(n+1)β‹…2n+2=2(n+1)n+2|c_n| \geq (n+1)\cdot\frac{2}{n+2} = \frac{2(n+1)}{n+2}.

    Since 2(n+1)n+2β‰₯1\frac{2(n+1)}{n+2} \geq 1 for nβ‰₯0n \geq 0, ∣cn∣β‰₯1|c_n| \geq 1 (in fact ∣cnβˆ£β†’Ο€|c_n| \to \pi: the sum is a Riemann sum for ∫01dxx(1βˆ’x)=Ο€\int_0^1 \frac{dx}{\sqrt{x(1-x)}} = \pi; numerically ∣c100βˆ£β‰ˆ2.85|c_{100}| \approx 2.85, ∣c400βˆ£β‰ˆ3.00|c_{400}| \approx 3.00, approaching Ο€\pi).

  4. Since ∣cn∣β‰₯1|c_n| \geq 1, cnβ†’ΜΈ0c_n \not\to 0, and the nn-th term test gives that βˆ‘cn\sum c_n diverges. Two convergent series can have a divergent Cauchy product β€” absolute convergence of one factor in Mertens' theorem (problem 1) is not a removable hypothesis but an essential one.

8. Power Series