Goertzel algorithm

The Goertzel algorithm is a technique in digital signal processing (DSP) for efficient evaluation of the individual terms of the discrete Fourier transform (DFT). It is useful in certain practical applications, such as recognition of dual-tone multi-frequency signaling (DTMF) tones produced by the push buttons of the keypad of a traditional analog telephone. The algorithm was first described by Gerald Goertzel in 1958. ^[1]

Like the DFT, the Goertzel algorithm analyses one selectable frequency component from a discrete signal. ^{[2] [3] [4]} Unlike direct DFT calculations, the Goertzel algorithm applies a single real-valued coefficient at each iteration, using real-valued arithmetic for real-valued input sequences. For covering a full spectrum (except when using for continuous stream of data where coefficients are reused for subsequent calculations, which has computational complexity equivalent of sliding DFT), the Goertzel algorithm has a higher order of complexity than fast Fourier transform (FFT) algorithms, but for computing a small number of selected frequency components, it is more numerically efficient. The simple structure of the Goertzel algorithm makes it well suited to small processors and embedded applications.

The Goertzel algorithm can also be used "in reverse" as a sinusoid synthesis function, which requires only 1 multiplication and 1 subtraction per generated sample. ^[5]

The algorithm

The main calculation in the Goertzel algorithm has the form of a digital filter, and for this reason the algorithm is often called a Goertzel filter. The filter operates on an input sequence ${\displaystyle x[n]}$ in a cascade of two stages with a parameter ${\displaystyle \omega _{0}}$, giving the frequency to be analysed, normalised to radians per sample.

The first stage calculates an intermediate sequence, ${\displaystyle s[n]}$:

${\displaystyle s[n]=x[n]+2\cos(\omega _{0})s[n-1]-s[n-2].}$

(1)

The second stage applies the following filter to ${\displaystyle s[n]}$, producing output sequence ${\displaystyle y[n]}$:

${\displaystyle y[n]=s[n]-e^{-j\omega _{0}}s[n-1].}$

(2)

The first filter stage can be observed to be a second-order IIR filter with a direct-form structure. This particular structure has the property that its internal state variables equal the past output values from that stage. Input values ${\displaystyle x[n]}$ for ${\displaystyle n<0}$ are presumed all equal to 0. To establish the initial filter state so that evaluation can begin at sample ${\displaystyle x[0]}$, the filter states are assigned initial values ${\displaystyle s[-2]=s[-1]=0}$. To avoid aliasing hazards, frequency ${\displaystyle \omega _{0}}$ is often restricted to the range 0 to π (see Nyquist–Shannon sampling theorem); using a value outside this range is not meaningless, but is equivalent to using an aliased frequency inside this range, since the exponential function is periodic with a period of 2π in ${\displaystyle \omega _{0}}$.

The second-stage filter can be observed to be a FIR filter, since its calculations do not use any of its past outputs.

Z-transform methods can be applied to study the properties of the filter cascade. The Z transform of the first filter stage given in equation (1) is

${\displaystyle {\begin{aligned}{\frac {S(z)}{X(z)}}&={\frac {1}{1-2\cos(\omega _{0})z^{-1}+z^{-2}}}\\&={\frac {1}{(1-e^{+j\omega _{0}}z^{-1})(1-e^{-j\omega _{0}}z^{-1})}}.\end{aligned}}}$

(3)

The Z transform of the second filter stage given in equation (2) is

${\displaystyle {\frac {Y(z)}{S(z)}}=1-e^{-j\omega _{0}}z^{-1}.}$

(4)

The combined transfer function of the cascade of the two filter stages is then

${\displaystyle {\begin{aligned}{\frac {S(z)}{X(z)}}{\frac {Y(z)}{S(z)}}={\frac {Y(z)}{X(z)}}&={\frac {(1-e^{-j\omega _{0}}z^{-1})}{(1-e^{+j\omega _{0}}z^{-1})(1-e^{-j\omega _{0}}z^{-1})}}\\&={\frac {1}{1-e^{+j\omega _{0}}z^{-1}}}.\end{aligned}}}$

(5)

This can be transformed back to an equivalent time-domain sequence, and the terms unrolled back to the first input term at index ${\displaystyle n=0}$:^{[ citation needed ]}

${\displaystyle {\begin{aligned}y[n]&=x[n]+e^{+j\omega _{0}}y[n-1]\\&=\sum _{k=-\infty }^{n}x[k]e^{+j\omega _{0}(n-k)}\\&=e^{j\omega _{0}n}\sum _{k=0}^{n}x[k]e^{-j\omega _{0}k}\qquad {\text{since }}\forall k<0,x[k]=0.\end{aligned}}}$

(6)

Numerical stability

It can be observed that the poles of the filter's Z transform are located at ${\displaystyle e^{+j\omega _{0}}}$ and ${\displaystyle e^{-j\omega _{0}}}$, on a circle of unit radius centered on the origin of the complex Z-transform plane. This property indicates that the filter process is marginally stable and vulnerable to numerical-error accumulation when computed using low-precision arithmetic and long input sequences. ^[6] A numerically stable version was proposed by Christian Reinsch. ^[7]

DFT computations

For the important case of computing a DFT term, the following special restrictions are applied.

• The filtering terminates at index ${\displaystyle n=N}$, where ${\displaystyle N}$ is the number of terms in the input sequence of the DFT.
• The frequencies chosen for the Goertzel analysis are restricted to the special form

${\displaystyle \omega _{0}=2\pi {\frac {k}{N}}.}$

(7)

• The index number ${\displaystyle k}$ indicating the "frequency bin" of the DFT is selected from the set of index numbers

${\displaystyle k\in \{0,1,2,...,N-1\}.}$

(8)

Making these substitutions into equation (6) and observing that the term ${\displaystyle e^{+j2\pi k}=1}$, equation (6) then takes the following form:

${\displaystyle y[N]=\sum _{n=0}^{N}x[n]e^{-j2\pi {\frac {nk}{N}}}.}$

(9)

We can observe that the right side of equation (9) is extremely similar to the defining formula for DFT term ${\displaystyle X[k]}$, the DFT term for index number ${\displaystyle k}$, but not exactly the same. The summation shown in equation (9) requires ${\displaystyle N+1}$ input terms, but only ${\displaystyle N}$ input terms are available when evaluating a DFT. A simple but inelegant expedient is to extend the input sequence ${\displaystyle x[n]}$ with one more artificial value ${\displaystyle x[N]=0}$. ^[8] We can see from equation (9) that the mathematical effect on the final result is the same as removing term ${\displaystyle x[N]}$ from the summation, thus delivering the intended DFT value.

However, there is a more elegant approach that avoids the extra filter pass. From equation (1), we can note that when the extended input term ${\displaystyle x[N]=0}$ is used in the final step,

${\displaystyle s[N]=2\cos(\omega _{0})s[N-1]-s[N-2].}$

(10)

Thus, the algorithm can be completed as follows:

• terminate the IIR filter after processing input term ${\displaystyle x[N-1]}$,
• apply equation (10) to construct ${\displaystyle s[N]}$ from the prior outputs ${\displaystyle s[N-1]}$ and ${\displaystyle s[N-2]}$,
• apply equation (2) with the calculated ${\displaystyle s[N]}$ value and with ${\displaystyle s[N-1]}$ produced by the final direct calculation of the filter.

The last two mathematical operations are simplified by combining them algebraically:

${\displaystyle {\begin{aligned}y[N]&=s[N]-e^{-j2\pi {\frac {k}{N}}}s[N-1]\\&=(2\cos(\omega _{0})s[N-1]-s[N-2])-e^{-j2\pi {\frac {k}{N}}}s[N-1]\\&=e^{j2\pi {\frac {k}{N}}}s[N-1]-s[N-2].\end{aligned}}}$

(11)

Note that stopping the filter updates at term ${\displaystyle N-1}$ and immediately applying equation (2) rather than equation (11) misses the final filter state updates, yielding a result with incorrect phase. ^[9]

The particular filtering structure chosen for the Goertzel algorithm is the key to its efficient DFT calculations. We can observe that only one output value ${\displaystyle y[N]}$ is used for calculating the DFT, so calculations for all the other output terms are omitted. Since the FIR filter is not calculated, the IIR stage calculations ${\displaystyle s[0],s[1]}$, etc. can be discarded immediately after updating the first stage's internal state.

This seems to leave a paradox: to complete the algorithm, the FIR filter stage must be evaluated once using the final two outputs from the IIR filter stage, while for computational efficiency the IIR filter iteration discards its output values. This is where the properties of the direct-form filter structure are applied. The two internal state variables of the IIR filter provide the last two values of the IIR filter output, which are the terms required to evaluate the FIR filter stage.

Applications

Power-spectrum terms

Examining equation (6), a final IIR filter pass to calculate term ${\displaystyle y[N]}$ using a supplemental input value ${\displaystyle x[N]=0}$ applies a complex multiplier of magnitude 1 to the previous term ${\displaystyle y[N-1]}$. Consequently, ${\displaystyle y[N]}$ and ${\displaystyle y[N-1]}$ represent equivalent signal power. It is equally valid to apply equation (11) and calculate the signal power from term ${\displaystyle y[N]}$ or to apply equation (2) and calculate the signal power from term ${\displaystyle y[N-1]}$. Both cases lead to the following expression for the signal power represented by DFT term ${\displaystyle X[k]}$:

${\displaystyle {\begin{aligned}X[k]\,X'[k]&=y[N]\,y'[N]=y[N-1]\,y'[N-1]\\&=s^{2}[N-1]+s^{2}[N-2]-2\cos \left(2\pi {\frac {k}{N}}\right)\,s[N-1]\,s[N-2].\end{aligned}}}$

(12)

In the pseudocode below, the real-valued input data is stored in the array x and the variables sprev and sprev2 temporarily store output history from the IIR filter. Nterms is the number of samples in the array, and Kterm corresponds to the frequency of interest, multiplied by the sampling period.

Nterms defined here Kterm selected here ω = 2 × π × Kterm / Nterms; coeff := 2 × cos(ω)  sprev := 0 sprev2 := 0 for each index n in range 0 to Nterms-1 do     s := x[n] + coeff × sprev - sprev2     sprev2 := sprev     sprev := s end  power := sprev2 + sprev22 - (coeff × sprev × sprev2)

It is possible ^[10] to organise the computations so that incoming samples are delivered singly to a software object that maintains the filter state between updates, with the final power result accessed after the other processing is done.

Single DFT term with real-valued arithmetic

The case of real-valued input data arises frequently, especially in embedded systems where the input streams result from direct measurements of physical processes. When the input data are real-valued, the filter internal state variables sprev and sprev2 can be observed also to be real-valued, consequently, no complex arithmetic is required in the first IIR stage. Optimizing for real-valued arithmetic typically is as simple as applying appropriate real-valued data types for the variables.

After the calculations using input term ${\displaystyle x[N-1]}$, and filter iterations are terminated, equation (11) must be applied to evaluate the DFT term. The final calculation uses complex-valued arithmetic, but this can be converted into real-valued arithmetic by separating real and imaginary terms:

${\displaystyle {\begin{aligned}c_{r}&=\cos(2\pi {\tfrac {k}{N}}),\\c_{i}&=\sin(2\pi {\tfrac {k}{N}}),\\y[N]&=c_{r}s[N-1]-s[N-2]+jc_{i}s[N-1].\end{aligned}}}$

(13)

Comparing to the power-spectrum application, the only difference are the calculation used to finish:

(Same IIR filter calculations as in the signal power implementation) XKreal = sprev * cr - sprev2; XKimag = sprev * ci; 

Phase detection

This application requires the same evaluation of DFT term ${\displaystyle X[k]}$, as discussed in the previous section, using a real-valued or complex-valued input stream. Then the signal phase can be evaluated as

${\displaystyle \phi =\tan ^{-1}{\frac {\Im (X[k])}{\Re (X[k])}},}$

(14)

taking appropriate precautions for singularities, quadrant, and so forth when computing the inverse tangent function.

Complex signals in real arithmetic

Since complex signals decompose linearly into real and imaginary parts, the Goertzel algorithm can be computed in real arithmetic separately over the sequence of real parts, yielding ${\displaystyle y_{\text{r}}[n]}$, and over the sequence of imaginary parts, yielding ${\displaystyle y_{\text{i}}[n]}$. After that, the two complex-valued partial results can be recombined:

${\displaystyle y[n]=y_{\text{r}}[n]+jy_{\text{i}}[n].}$

(15)

Computational complexity

• According to computational complexity theory, computing a set of ${\displaystyle M}$ DFT terms using ${\displaystyle M}$ applications of the Goertzel algorithm on a data set with ${\displaystyle N}$ values with a "cost per operation" of ${\displaystyle K}$ has complexity ${\displaystyle O(KNM)}$.

To compute a single DFT bin ${\displaystyle X(f)}$ for a complex input sequence of length ${\displaystyle N}$, the Goertzel algorithm requires ${\displaystyle 2N}$ multiplications and ${\displaystyle 4\ N}$ additions/subtractions within the loop, as well as 4 multiplications and 4 final additions/subtractions, for a total of ${\displaystyle 2N+4}$ multiplications and ${\displaystyle 4N+4}$ additions/subtractions. This is repeated for each of the ${\displaystyle M}$ frequencies.

• In contrast, using an FFT on a data set with ${\displaystyle N}$ values has complexity ${\displaystyle O(KN\log _{2}(N))}$.

This is harder to apply directly because it depends on the FFT algorithm used, but a typical example is a radix-2 FFT, which requires ${\displaystyle 2\log _{2}(N)}$ multiplications and ${\displaystyle 3\log _{2}(N)}$ additions/subtractions per DFT bin, for each of the ${\displaystyle N}$ bins.

In the complexity order expressions, when the number of calculated terms ${\displaystyle M}$ is smaller than ${\displaystyle \log N}$, the advantage of the Goertzel algorithm is clear. But because FFT code is comparatively complex, the "cost per unit of work" factor ${\displaystyle K}$ is often larger for an FFT, and the practical advantage favours the Goertzel algorithm even for ${\displaystyle M}$ several times larger than ${\displaystyle \log _{2}(N)}$.

As a rule-of-thumb for determining whether a radix-2 FFT or a Goertzel algorithm is more efficient, adjust the number of terms ${\displaystyle N}$ in the data set upward to the nearest exact power of 2, calling this ${\displaystyle N_{2}}$, and the Goertzel algorithm is likely to be faster if

${\displaystyle M\leq {\frac {5N_{2}}{6N}}\log _{2}(N_{2})}$

FFT implementations and processing platforms have a significant impact on the relative performance. Some FFT implementations ^[11] perform internal complex-number calculations to generate coefficients on-the-fly, significantly increasing their "cost K per unit of work." FFT and DFT algorithms can use tables of pre-computed coefficient values for better numerical efficiency, but this requires more accesses to coefficient values buffered in external memory, which can lead to increased cache contention that counters some of the numerical advantage.

Both algorithms gain approximately a factor of 2 efficiency when using real-valued rather than complex-valued input data. However, these gains are natural for the Goertzel algorithm but will not be achieved for the FFT without using certain algorithm variants ^{[ which? ]} specialised for transforming real-valued data.

See also

• Bluestein's FFT algorithm (chirp-Z)
• Frequency-shift keying (FSK)
• Phase-shift keying (PSK)

References

1. Goertzel, G. (January 1958), "An Algorithm for the Evaluation of Finite Trigonometric Series", American Mathematical Monthly, 65 (1): 34–35, doi:10.2307/2310304, JSTOR   2310304
2. Mock, P. (March 21, 1985), "Add DTMF Generation and Decoding to DSP-μP Designs" (PDF), EDN, ISSN   0012-7515 ; also found in DSP Applications with the TMS320 Family, Vol. 1, Texas Instruments, 1989.
3. Chen, Chiouguey J. (June 1996), Modified Goertzel Algorithm in DTMF Detection Using the TMS320C80 DSP (PDF), Application Report, Texas Instruments, SPRA066
4. Schmer, Gunter (May 2000), DTMF Tone Generation and Detection: An Implementation Using the TMS320C54x (PDF), Application Report, Texas Instruments, SPRA096a
5. Cheng, Eric; Hudak, Paul (January 2009), Audio Processing and Sound Synthesis in Haskell (PDF), archived from the original (PDF) on 2017-03-28
6. Gentleman, W. M. (1 February 1969). "An error analysis of Goertzel's (Watt's) method for computing Fourier coefficients". The Computer Journal. 12 (2): 160–164. doi: 10.1093/comjnl/12.2.160 .
7. Stoer, J.; Bulirsch, R. (2002), Introduction to Numerical Analysis, Springer, ISBN   9780387954523
8. "Goertzel's Algorithm". Cnx.org. 2006-09-12. Retrieved 2014-02-03.
9. "Electronic Engineering Times | Connecting the Global Electronics Community". EE Times. Retrieved 2014-02-03.
10. Elmenreich, Wilfried (August 25, 2011). "Efficiently detecting a frequency using a Goertzel filter" . Retrieved 16 September 2014.
11. Press; Flannery; Teukolsky; Vetterling (2007), "Chapter 12", Numerical Recipes, The Art of Scientific Computing, Cambridge University Press

Further reading

• Proakis, J. G.; Manolakis, D. G. (1996), Digital Signal Processing: Principles, Algorithms, and Applications, Upper Saddle River, NJ: Prentice Hall, pp. 480–481, Bibcode:1996dspp.book.....P

External links

• Goertzel Algorithm at the Wayback Machine (archived 2018-06-28)
• A DSP algorithm for frequency analysis
• The Goertzel Algorithm by Kevin Banks