Skip to article frontmatterSkip to article content
Site not loading correctly?

This may be due to an incorrect BASE_URL configuration. See the MyST Documentation for reference.

2.2 Geometric Series

Geometric series appear frequently in time series analysis, particularly when working with ARMA models and spectral analysis. Understanding their properties is essential for many derivations in this course.

Finite Geometric Series

Let S=x+x2+x3++xN=n=1NxnS = x + x^{2} + x^{3} + \ldots + x^{N} = \sum_{n=1}^{N}x^{n}. This is known as a geometric progression.

Now consider xSxS:

xS=x2+x3+x4++xN+1=n=2N+1xnxS = x^{2} + x^{3} + x^{4} + \ldots + x^{N+1} = \sum_{n=2}^{N+1}x^{n}

Subtracting these:

(1x)S=SxS=(x+x2+x3++xN)(x2+x3+x4++xN+1)=xxN+1=x(1xN)\begin{split} (1-x)S &= S - xS\\ &= (x + x^{2} + x^{3} + \ldots + x^{N}) - (x^{2} + x^{3} + x^{4} + \ldots + x^{N+1})\\ &= x - x^{N+1}\\ &= x(1-x^{N}) \end{split}

Therefore:

S=x1xN1xfor x1.S = x\frac{1-x^{N}}{1-x} \quad \text{for } x \neq 1.

Infinite Geometric Series

Eq. (3) is exact for any x1x \neq 1. We can divide its applications into two cases:

Case 1: If x>1|x| > 1, the series will diverge as NN approaches infinity.

Case 2: For x<1|x| < 1, we have limNx(1xN)=x\lim_{N\to\infty}x(1- x^N) = x. Thus we arrive at:

limNn=1Nxn=x1xfor x<1\lim_{N\to\infty}\sum_{n=1}^{N}x^{n} = \frac{x}{1-x} \quad \text{for } |x| < 1

And starting from n=0n=0, limN(1xN)=1\lim_{N\to\infty}(1- x^N) = 1, yielding:

limNn=0Nxn=11xfor x<1,x0\lim_{N\to\infty}\sum_{n=0}^{N}x^{n} = \frac{1}{1-x} \quad \text{for } |x|<1, x\neq0

The value of Eq. (7) for x=0x=0 depends on our definition of 00, which in different contexts may be either undefined or defined as 1.

We can derive several related infinite sums from the basic formula:

Alternating Series

n=1(1)nxn=n=1(x)n=x1(x)=x1+x\sum_{n=1}^{\infty}(-1)^n x^{n} = \sum_{n=1}^{\infty}(-x)^{n} = \frac{-x}{1-(-x)} = \frac{-x}{1+x}

Even Powers

n=1x2n=n=1(x2)n=x21x2\sum_{n=1}^{\infty}x^{2n} = \sum_{n=1}^{\infty}(x^2)^{n} = \frac{x^2}{1-x^2}

We will come back to Eq.s (6) and (7) throughout the course of this book.