Goertzel algorithm

From Wikipedia, the free encyclopedia

The Goertzel algorithm is a Digital Signal Processing (DSP) technique that provides a means for efficient evaluation of individual terms of the Discrete Fourier Transform (DFT), thus making it useful in certain practical applications, such as recognition of DTMF tones produced by the buttons pushed on a telephone keypad. The algorithm was first described by Gerald Goertzel in 1958.[1]

Like the DFT, the Goertzel algorithm analyses one selectable frequency component from a discrete signal.[2][3][4] Unlike direct DFT calculations, the Goertzel algorithm applies a single real-valued coefficient at each iteration, using real-valued arithmetic for real-valued input sequences. For covering a full spectrum, the Goertzel algorithm has a higher order of complexity than Fast Fourier Transform (FFT) algorithms; but for computing a small number of selected frequency components, it is more numerically efficient. The simple structure of the Goertzel algorithm makes it well suited to small processors and embedded applications, though not limited to these.

The Goertzel algorithm can also be used "in reverse" as a sinusoid synthesis function, which requires only 1 multiplication and 1 subtraction per generated sample.[5]

The algorithm

The main calculation in the Goertzel algorithm has the form of a digital filter, and for this reason the algorithm is often called a Goertzel filter. The filter operates on an input sequence, x(n), in a cascade of two stages with a parameter, \omega , giving the frequency to be analysed, normalised to cycles per sample.

The first stage calculates an intermediate sequence, s(n):

(1) s(n)=x(n)+2\cos(2\pi \omega )s(n-1)-s(n-2)

The second stage applies the following filter to s(n), producing output sequence y(n).

(2) y(n)=s(n)-e^{{-2\pi i\omega }}s(n-1) [citation needed]

The first filter stage can be observed to be a second-order IIR filter with a direct form structure. This particular structure has the property that its internal state variables equal the past output values from that stage. Input values x(n) for n<0 are presumed all equal to 0. [citation needed] To establish the initial filter state so that evaluation can begin at sample x(0), the filter states are assigned initial values s(-2)=s(-1)=0. [citation needed] To avoid aliasing hazards, frequency \omega is often restricted to the range 0 to 1/2 (see Nyquist-Shannon sampling theorem), but the results are mathematically valid outside of this range.

The second stage filter can be observed to be a FIR filter, since its calculations do not use any of its past outputs.

Z transform methods can be applied to study the properties of the filter cascade. The Z transform of the first filter stage given in equation (1) is:

(3) {\frac  {S(z)}{X(z)}}={\frac  {1}{1-2\cos(2\pi \omega )z^{{-1}}+z^{{-2}}}}={\frac  {1}{(1-e^{{+2\pi i\omega }}z^{{-1}})(1-e^{{-2\pi i\omega }}z^{{-1}})}}.

The Z transform of the second filter stage given in equation (2) is:

(4) {\frac  {Y(z)}{S(z)}}=1-e^{{-2\pi i\omega }}z^{{-1}}

The combined transfer function of the cascade of the two filter stages is then

(5) {\frac  {S(z)}{X(z)}}{\frac  {Y(z)}{S(z)}}={\frac  {Y(z)}{X(z)}}={\frac  {(1-e^{{-2\pi i\omega }}z^{{-1}})}{(1-e^{{+2\pi i\omega }}z^{{-1}})(1-e^{{-2\pi i\omega }}z^{{-1}})}}={\frac  {1}{1-e^{{+2\pi i\omega }}z^{{-1}}}}.

This can be transformed back to an equivalent time domain sequence, and the terms unrolled back to the first input term at index n=0.

(6) {\begin{aligned}y(n)&=x(n)+e^{{+2\pi i\omega }}y(n-1)\\&=\sum _{{k=-\infty }}^{{n}}x(k)e^{{+2\pi i\omega (n-k)}}\\&=e^{{+2\pi i\omega n}}\sum _{{k=0}}^{{n}}x(k)e^{{-2\pi i\omega k}}\end{aligned}} [citation needed]

It can be observed that the poles of the filter's Z transform are located at e^{{+2\pi i\omega }} and e^{{-2\pi i\omega }}, on a circle of unit radius centered on the origin of the complex Z transform plane. This property indicates that the filter process is marginally stable and potentially vulnerable to numerical error accumulation when computed using low-precision arithmetic and long input sequences.

DFT computations

For the important case of computing a DFT term, the following special restrictions are applied.

  • the filtering terminates at index n=N where N is the number of terms in the input sequence of the DFT
  • the frequencies chosen for the Goertzel analysis are restricted to the special form
(7) \omega ={\frac  {K}{N}}
  • the index number K indicating the "frequency bin" of the DFT is selected from the set of index numbers
(8) K\epsilon \{0,1,2,...,N-1\}

Making these substitutions into equation (6), and observing that the term e^{{-2\pi iK}}=1.0, equation (6) then takes the following form.

(9) y(N)=\sum _{{k=0}}^{{N}}x(k)e^{{-2\pi i{\frac  {kK}{N}}}}

We can observe that the right side of equation (9) is extremely similar to the defining formula for DFT term X(K), the DFT term for index number K, but not exactly the same. The summation shown in equation (9) requires N+1 input terms, but only N input terms are available when evaluating a DFT. A simple but inelegant expedient is to extend the input sequence x with one more artificial value x(N)=0.[6] We can see from equation (9), the mathematical effect on the final result is the same as removing term x(N) from the summation, thus delivering the intended DFT value.

However, there is a more elegant approach that avoids the extra filter pass. From equation (1), we can note that when the extended input term x(N)=0 is used in the final step,

(10) s(N)=2\cos(2\pi \omega )s(N-1)-s(N-2)

Thus, the algorithm can be completed as follows:

  • terminate the IIR filter after processing input term x(N-1)
  • apply equation (10) to construct s(N) from the prior outputs s(N-1) and s(N-2)
  • apply equation (2) with the calculated s(N) value, and with s(N-1) produced by the final direct calculation of the filter.

The last two mathematical operations are simplified by combining them algebraically.

(11) {\begin{aligned}y(N)\quad &=s(N)-e^{{-2\pi i{\frac  {K}{N}}}}s(N-1)\quad \\&=(2\cos(2\pi \omega )s(N-1)-s(N-2))-e^{{-2\pi i{\frac  {K}{N}}}}s(N-1)\\&=e^{{2\pi i{\frac  {K}{N}}}}s(N-1)-s(N-2)\end{aligned}}

Note that stopping the filter updates at term N-1 and immediately applying equation (2) rather than equation (11) misses the final filter state updates, yielding a result with incorrect phase.[7]

The particular filtering structure chosen for the Goertzel algorithm is the key to its efficient DFT calculations. We can observe that only one output value y(N) is used for calculating the DFT, so calculations for all the other output terms are omitted. Since the FIR filter is not calculated, the IIR stage calculations s(0),s(1), etc. can be discarded immediately after updating the first stage's internal state.

This seems to leave a paradox: to complete the algorithm, the FIR filter stage must be evaluated once using the final two outputs from the IIR filter stage, while for computational efficiency the IIR filter iteration discards its output values. This is where the properties of the direct-form filter structure are applied. The two internal state variables of the IIR filter provide the last two values of the IIR filter output, which are the terms required to evaluate the FIR filter stage.

Applications

Power spectrum terms

Examining equation (6), a final IIR filter pass to calculate term s(N) using a supplemental input value x(N)=0 applies a complex multiplier of magnitude 1.0 to the previous term s(N-1). Consequently, s(N) and s(N-1) represent equivalent signal power. It is equally valid to apply equation (11) and calculate the signal power from term y(N), or to apply equation (2) and calculate the signal power from term y(N-1). Both cases lead to the following expression for the signal power represented by DFT term X(K).

(12) {\begin{aligned}X(K)X'(K)&=y(N)\ y'(N)=y(N-1)\ y'(N-1)\\&=s(N-1)^{2}+s(N-2)^{2}-2cos(2\pi {\frac  {K}{N}})\ s(N-1)\ s(N-2)\end{aligned}}

In the pseudocode below, the variables sprev and sprev2 temporarily store output history from the IIR filter, while x[n] is an indexed element of the array x which stores the input.

Nterms defined here
Kterm selected here
ω = 2 * π * Kterm / Nterms;
ωr = cos(ω);
ωi = sin(ω);
coeff = 2 * ωr;

sprev = 0;
sprev2 = 0;
for each index n in range 0 to Nterms-1
  s = x[n] + coeff * sprev - sprev2;
  sprev2 = sprev;
  sprev = s;
end

power = sprev2*sprev2 + sprev*sprev - coeff*sprev*sprev2 ;

It is possible to organise the computations so that incoming samples are delivered singly to a software object that maintains the filter state between updates, with the final power result accessed after the other processing is done.

Single DFT term with real-valued arithmetic

The case of real-valued input data arises frequently, especially in embedded systems where the input streams result from direct measurements of physical processes. Comparing to the illustration in the previous section, when the input data are real-valued, the filter internal state variables sprev and sprev2 can be observed also to be real-valued, consequently, no complex arithmetic is required in the first IIR stage. Optimizing for real-valued arithmetic typically is as simple as applying appropriate real-valued data types for the variables.

After the calculations using input term x(N-1), and filter iterations are terminated, equation (11) must be applied to evaluate the DFT term. The final calculation uses complex-valued arithmetic, but this can be converted into real-valued arithmetic by separating real and imaginary terms.

(13) {\begin{aligned}\omega _{r}&=cos(2\pi {\frac  {K}{N}})\\\omega _{i}&=sin(2\pi {\frac  {K}{N}})\\y(N)&=(\omega _{r}\ s(N-1)-s(N-2))+i(\omega _{i}\ s(N-1))\end{aligned}}

Comparing to the power spectrum application, the only difference is the calculation used to finish.

(Same IIR filter calculations as in the signal power implementation)
XKreal = sprev * ωr - sprev2;
XKimag = sprev * ωi;

Phase detection

This application requires the same evaluation of DFT term X(K), as discussed in the previous section, using a real-valued or complex-valued input stream. Then the signal phase can be evaluated as:

(14) \phi =\tan ^{{-1}}{\frac  {\Im (X(K))}{\Re (X(K))}}

taking appropriate precautions for singularities, quadrant, and so forth when computing the inverse tangent function.

Complex signals in real arithmetic

Since complex signals decompose linearly into real and imaginary parts, the Goertzel algorithm can be computed in real arithmetic separately over the sequence of real parts, yielding y_{r}(n); and over the sequence of imaginary parts, yielding y_{i}(n). After that, the two complex-valued partial results can be recombined:

(15) y(n)=y_{r}(n)+i\ y_{i}(n)

Computational complexity

To compute a single DFT bin X(\omega ) for a complex input sequence of length N, the Goertzel algorithm requires 2N multiplications and 4\ N additions/subtractions within the loop, as well as 4 multiplications and 4 final additions/subtractions, for a total of 2N+4 multiplications and 4N+4 additions/subtractions. This is repeated for each of the M frequencies.
  • In contrast, using an FFT on a data set with N values has complexity O(KN\log N). [citation needed]
This is harder to apply directly because it depends on the FFT algorithm used, but a typical [citation needed] example is a radix-2 FFT, which requires 2\log _{2}N multiplications and 3\log _{2}N additions/subtractions per DFT bin, for each of the N bins. [citation needed]

In the complexity order expressions, when the number of calculated terms M is smaller than \log N, the advantage of the Goertzel algorithm is clear. But because FFT code is comparatively very complex, [citation needed] the "cost per unit of work" factor K is often much larger [citation needed] for an FFT, and the practical advantage favours the Goertzel algorithm more than the complexity expressions indicate.

As a rule-of-thumb for determining whether a radix-2 FFT or a Goertzel algorithm is more efficient, adjust the number of terms N in the data set upward to the nearest exact power of 2, calling this N_{2}, and the Goertzel algorithm is likely to be faster if

M\leq {\frac  {5N_{2}}{6N}}\log _{2}N_{2} [citation needed]

FFT implementations and processing platforms have a significant impact on the relative performance. Some FFT implementations[8] perform internal complex-number calculations to generate coefficients on-the-fly, significantly increasing their "cost K per unit of work." FFT and DFT algorithms can use tables of pre-computed coefficient values for better numerical efficiency, but this requires more accesses to coefficient values buffered in external memory, which can lead to increased cache contention that counters some of the numerical advantage. [citation needed]

Both algorithms [citation needed] gain approximately a factor of 2 efficiency [citation needed] when using real-valued rather than complex-valued input data. However, these gains are natural for the Goertzel algorithm but will not be achieved for the FFT without using certain algorithm variants specialised for transforming real-valued data.

See also

References

  1. Goertzel, G. (January 1958), "An Algorithm for the Evaluation of Finite Trigonometric Series", American Mathematical Monthly 65 (1): 3435, doi:10.2307/2310304 
  2. Mock (1985)
  3. Chen (1996)
  4. Schmer (2000)
  5. http://cs-www.cs.yale.edu/c2/images/uploads/AudioProc-TR.pdf
  6. "Goertzel's Algorithm". Cnx.org. 2006-09-12. Retrieved 2014-02-03. 
  7. "Electronic Engineering Times | Connecting the Global Electronics Community". EE Times. Retrieved 2014-02-03. 
  8. Press; Flannery; Teukolsky; Vetterling (2007), "Chapter 12", Numerical Recipes, The Art of Scientific Computing, Cambridge University Press 

External links

This article is issued from Wikipedia. The text is available under the Creative Commons Attribution/Share Alike; additional terms may apply for the media files.