Arithmetic complexity of the discrete Fourier transform
From Wikipedia, the free encyclopedia
See Fast Fourier transform#Bounds on complexity and operation counts for a general summary of this issue.
[edit] Bounds on the multiplicative complexity of FFT
In his PhD thesis in 1987 [1], Michael Heidman focus on the arithmetic theory of complexity for a Discrete Fourier transform (DFT) and hit upon remarkable results. Among them, a lower bound for the multiplicative (floating-point) complexity required to compute discrete transforms, which is presented below. Let us denote by MDFT(N) the minimal multiplicative complexity for the exact computing a DFT of blocklength N [2].
Theorem (Heidman). For a given piei where pi, i=1,...,m are distinct primes and ei, i=1,...,m are positive integers, it follows then
where φ(.) is the Euler's totient function function, gcd(.,.) denotes the greatest common divisor and lcm(.,.) is the least common multiple.
Proof. See [1, page 98].
The application of this theorem for several values of N yields the complexities shown on the table. The difference between pointed complexities is striking. A further point to be observed is the fact that some people believe that Fast Fourier transform (FFT, Cooley-Tukey) is a close-to-optimum algorithm for computing a DFT. This minimal complexity is the same as that one required for the Discrete Hartley transform (DHT) of the same blocklength.
-
- Table I - Minimal multiplicative complexity (expressed as the number of floating-point multiplications) required for computing a DFT for a few selected blocklengths.
N | 2 | 3 | 4 | 5 | 6 | 8 | 12 | 16 | 24 | 32 | 48 | 64 | 128 | 256 |
definition | 4 | 9 | 16 | 25 | 36 | 64 | 144 | 256 | 576 | 1024 | 2304 | 4096 | 16384 | 65536 |
FFT | 2 | * | 8 | * | * | 24 | * | 64 | * | 160 | * | 384 | 896 | 2048 |
MDFT(N) | 0 | 1 | 0 | 4 | 2 | 2 | 4 | 10 | 12 | 32 | 38 | 84 | 198 | 438 |
Recently, a new fast Fourier transform algorithm was introduced [3,4], which is based on a multilayer Hadamard decomposition so as to evaluate a DFT via a Discrete Hartley Transform (DHT), which achieve the minimal floating-point multiplicative complexity for blocklengths until N=24.
[edit] References
- [1] M.T. Heidman, Multiplicative Complexity, Convolution and the DFT, Springer-Verlag, 1988.
- [2] M.T. Heideman and C. Sidney Burrus, 1986, On the number of multiplications necessary to compute a length-2n DFT, IEEE Trans. Acoust. Speech. Sig. Proc., vol.34: pp.91-95.
- [3] H.M. de Oliveira, R.J.S. Cintra, R.M.C. Souza, Multilevel Hadamard Decomposition of Discrete Hartley Transforms, In: Annals of the Brazilian Symposium on Telecommunications, XVIII Simpósio Brasileiro de Telecomunicações, Gramado, RS. Brazil, 2000.
- [4] Ibdem, A Factorization Scheme for Discrete Hartley Transform Matrices, In: International Conference on System Engineering, Comm. and Inform. Technologies, Proc. of the ICSECIT (Int. Conf. on System Engineering, Comm. and Info. Technol.). Punta Arenas, 2001. http://www2.ee.ufpe.br/codec/1_01.pdf