Noise reduction

For the reduction of a sound's volume, see soundproofing. For the noise reduction of machinery and products, see noise control.

Noise reduction is the process of removing noise from a signal.

All recording devices, both analog and digital, have traits that make them susceptible to noise. Noise can be random or white noise with no coherence, or coherent noise introduced by the device's mechanism or processing algorithms.

In electronic recording devices, a major form of noise is hiss caused by random electrons that, heavily influenced by heat, stray from their designated path. These stray electrons influence the voltage of the output signal and thus create detectable noise.

In the case of photographic film and magnetic tape, noise (both visible and audible) is introduced due to the grain structure of the medium. In photographic film, the size of the grains in the film determines the film's sensitivity, more sensitive film having larger sized grains. In magnetic tape, the larger the grains of the magnetic particles (usually ferric oxide or magnetite), the more prone the medium is to noise.

To compensate for this, larger areas of film or magnetic tape may be used to lower the noise to an acceptable level.

In audio

Noise reduction example
Example of noise reduction using Audacity with 0 dB, 5 dB, 12 dB, and 30 dB reduction, 150 Hz frequency smoothing, and 0.15 seconds attack/decay time.
Problems playing this file? See media help.

When using analog tape recording technology, they may exhibit a type of noise known as tape hiss. This is related to the particle size and texture used in the magnetic emulsion that is sprayed on the recording media, and also to the relative tape velocity across the tape heads.

Four types of noise reduction exist: single-ended pre-recording, single-ended hiss reduction, single-ended surface noise reduction, and codec or dual-ended systems. Single-ended pre-recording systems (such as Dolby HX Pro) work to affect the recording medium at the time of recording. Single-ended hiss reduction systems (such as DNL or DNR) work to reduce noise as it occurs, including both before and after the recording process as well as for live broadcast applications. Single-ended surface noise reduction (such as CEDAR and the earlier SAE 5000A and Burwen TNE 7000) is applied to the playback of phonograph records to attenuate the sound of scratches, pops, and surface non-linearities. Dual-ended systems (such as Dolby B, Dolby C, Dolby S, dbx Type I and dbx Type II, High Com and High Com II as well as Toshiba's adres and JVC's ANRS) have a pre-emphasis process applied during recording and then a de-emphasis process applied at playback.

Dolby and dbx noise reduction system

While there are dozens of different kinds of noise reduction, the first widely used audio noise reduction technique was developed by Ray Dolby in 1966. Intended for professional use, Dolby Type A was an encode/decode system in which the amplitude of frequencies in four bands was increased during recording (encoding), then decreased proportionately during playback (decoding). The Dolby B system (developed in conjunction with Henry Kloss) was a single band system designed for consumer products. In particular, when recording quiet parts of an audio signal, the frequencies above 1 kHz would be boosted. This had the effect of increasing the signal to noise ratio on tape up to 10 dB depending on the initial signal volume. When it was played back, the decoder reversed the process, in effect reducing the noise level by up to 10 dB. The Dolby B system, while not as effective as Dolby A, had the advantage of remaining listenable on playback systems without a decoder.

Dbx was the competing analog noise reduction system developed by David E. Blackmer, founder of dbx laboratories.[1] It used a root-mean-squared (RMS) encode/decode algorithm with the noise-prone high frequencies boosted, and the entire signal fed through a 2:1 compander. Dbx operated across the entire audible bandwidth and unlike Dolby B was unusable as an open ended system. However it could achieve up to 30 dB of noise reduction.

Since Analog video recordings use frequency modulation for the luminance part (composite video signal in direct colour systems), which keeps the tape at saturation level, audio style noise reduction is unnecessary.

Dynamic noise limiter and dynamic noise reduction

Dynamic noise limiter (DNL) is an audio noise reduction system originally introduced by Philips in 1971 for use on cassette decks. Its circuitry is also based on a single chip.[2]

It was further developed into dynamic noise reduction (DNR) by National Semiconductor to reduce noise levels on long-distance telephony.[3] First sold in 1981, DNR is frequently confused with the far more common Dolby noise reduction system.[4] However, unlike Dolby and dbx Type I & Type II noise reduction systems, DNL and DNR are playback-only signal processing systems that do not require the source material to first be encoded, and they can be used together with other forms of noise reduction.[5]

Because DNL and DNR are non-complementary, meaning they do not require encoded source material, they can be used to remove background noise from any audio signal, including magnetic tape recordings and FM radio broadcasts, reducing noise by as much as 10 dB.[6] They can be used in conjunction with other noise reduction systems, provided that they are used prior to applying DNR to prevent DNR from causing the other noise reduction system to mistrack.

The Telefunken High Com integrated circuit U401BR could be utilized to work as a Dolby B–compatible DNR-style expander as well.[7]

One of DNR's first widespread applications was in the GM Delco car stereo systems in U.S. GM cars introduced in 1984.[8] It was also used in factory car stereos in Jeep vehicles in the 1980s, such as the Cherokee XJ. Today, DNR, DNL, and similar systems are most commonly encountered as a noise reduction system in microphone systems.[9]

Other approaches

A second class of algorithms work in the time-frequency domain using some linear or non-linear filters that have local characteristics and are often called time-frequency filters.[10] Noise can therefore be also removed by use of spectral editing tools, which work in this time-frequency domain, allowing local modifications without affecting nearby signal energy. This can be done manually by using the mouse with a pen that has a defined time-frequency shape. This is done much like in a paint program drawing pictures. Another way is to define a dynamic threshold for filtering noise, that is derived from the local signal, again with respect to a local time-frequency region. Everything below the threshold will be filtered, everything above the threshold, like partials of a voice or "wanted noise", will be untouched. The region is typically defined by the location of the signal Instantaneous Frequency,[11] as most of the signal energy to be preserved is concentrated about it.

Modern digital sound (and picture) recordings no longer need to worry about tape hiss so analog style noise reduction systems are not necessary. However, an interesting twist is that dither systems actually add noise to a signal to improve its quality.

Software programs

Most general purpose voice editing software will have one or more noise reduction functions (Audacity, WavePad, etc.). Special purpose noise reduction software programs include Gnome Wave Cleaner, Sony Creative Noise Reduction, SoliCall Pro, Voxengo Redunoise and X-OOM Music Clean.

In images

Images taken with both digital cameras and conventional film cameras will pick up noise from a variety of sources. Further use of these images will often require that the noise be (partially) removed – for aesthetic purposes as in artistic work or marketing, or for practical purposes such as computer vision.

Types

In salt and pepper noise (sparse light and dark disturbances), pixels in the image are very different in color or intensity from their surrounding pixels; the defining characteristic is that the value of a noisy pixel bears no relation to the color of surrounding pixels. Generally this type of noise will only affect a small number of image pixels. When viewed, the image contains dark and white dots, hence the term salt and pepper noise. Typical sources include flecks of dust inside the camera and overheated or faulty CCD elements.

In Gaussian noise, each pixel in the image will be changed from its original value by a (usually) small amount. A histogram, a plot of the amount of distortion of a pixel value against the frequency with which it occurs, shows a normal distribution of noise. While other distributions are possible, the Gaussian (normal) distribution is usually a good model, due to the central limit theorem that says that the sum of different noises tends to approach a Gaussian distribution.

In either case, the noise at different pixels can be either correlated or uncorrelated; in many cases, noise values at different pixels are modeled as being independent and identically distributed, and hence uncorrelated.

Removal

Tradeoffs

In selecting a noise reduction algorithm, one must weigh several factors:

Chroma and luminance noise separation

In real-world photographs, the highest spatial-frequency detail consists mostly of variations in brightness ("luminance detail") rather than variations in hue ("chroma detail"). Since any noise reduction algorithm should attempt to remove noise without sacrificing real detail from the scene photographed, one risks a greater loss of detail from luminance noise reduction than chroma noise reduction simply because most scenes have little high frequency chroma detail to begin with. In addition, most people find chroma noise in images more objectionable than luminance noise; the colored blobs are considered "digital-looking" and unnatural, compared to the grainy appearance of luminance noise that some compare to film grain. For these two reasons, most photographic noise reduction algorithms split the image detail into chroma and luminance components and apply more noise reduction to the former.

Most dedicated noise-reduction computer software allows the user to control chroma and luminance noise reduction separately.

Linear smoothing filters

One method to remove noise is by convolving the original image with a mask that represents a low-pass filter or smoothing operation. For example, the Gaussian mask comprises elements determined by a Gaussian function. This convolution brings the value of each pixel into closer harmony with the values of its neighbors. In general, a smoothing filter sets each pixel to the average value, or a weighted average, of itself and its nearby neighbors; the Gaussian filter is just one possible set of weights.

Smoothing filters tend to blur an image, because pixel intensity values that are significantly higher or lower than the surrounding neighborhood would "smear" across the area. Because of this blurring, linear filters are seldom used in practice for noise reduction; they are, however, often used as the basis for nonlinear noise reduction filters.

Anisotropic diffusion

Main article: Anisotropic diffusion

Another method for removing noise is to evolve the image under a smoothing partial differential equation similar to the heat equation, which is called anisotropic diffusion. With a spatially constant diffusion coefficient, this is equivalent to the heat equation or linear Gaussian filtering, but with a diffusion coefficient designed to detect edges, the noise can be removed without blurring the edges of the image.

Non-local means

Main article: Non-local means

Another approach for removing noise is based on non-local averaging of all the pixels in an image. In particular, the amount of weighting for a pixel is based on the degree of similarity between a small patch centered around that pixel and the small patch centered around the pixel being de-noised.

Nonlinear filters

A median filter is an example of a non-linear filter and, if properly designed, is very good at preserving image detail. To run a median filter:

  1. consider each pixel in the image
  2. sort the neighbouring pixels into order based upon their intensities
  3. replace the original value of the pixel with the median value from the list

A median filter is a rank-selection (RS) filter, a particularly harsh member of the family of rank-conditioned rank-selection (RCRS) filters;[12] a much milder member of that family, for example one that selects the closest of the neighboring values when a pixel's value is external in its neighborhood, and leaves it unchanged otherwise, is sometimes preferred, especially in photographic applications.

Median and other RCRS filters are good at removing salt and pepper noise from an image, and also cause relatively little blurring of edges, and hence are often used in computer vision applications.

Wavelet transform

The main aim of an image denoising algorithm is to achieve both noise reduction and feature preservation. In this context, wavelet-based methods are of particular interest. In the wavelet domain, the noise is uniformly spread throughout coefficients while most of the image information is concentrated in a few large ones.[13] Therefore, the first wavelet-based denoising methods were based on thresholding of detail subbands coefficients.[14] However, most of the wavelet thresholding methods suffer from the drawback that the chosen threshold may not match the specific distribution of signal and noise components at different scales and orientations.

To address these disadvantages, non-linear estimators based on Bayesian theory have been developed. In the Bayesian framework, it has been recognized that a successful denoising algorithm can achieve both noise reduction and feature preservation if it employs an accurate statistical description of the signal and noise components.[13]

Statistical methods

Statistical methods for image denoising exist as well, though they are infrequently used as they are computationally demanding. For Gaussian noise, one can model the pixels in a greyscale image as auto-normally distributed, where each pixel's "true" greyscale value is normally distributed with mean equal to the average greyscale value of its neighboring pixels and a given variance.

Let \delta_i denote the pixels adjacent to the ith pixel. Then the conditional distribution of the greyscale intensity (on a [0,1] scale) at the ith node is:

\mathbb{P}(x(i) = c|x(j) \forall j \in \delta i) \propto e^{-\frac{\beta}{2 \lambda} \sum_{j \in \delta i} (c - x(j))^2}

for a chosen parameter \beta \ge 0 and variance \lambda . One method of denoising that uses the auto-normal model uses the image data as a Bayesian prior and the auto-normal density as a likelihood function, with the resulting posterior distribution offering a mean or mode as a denoised image.[15]

Software programs

Most general purpose image and photo editing software will have one or more noise reduction functions (median, blur, despeckle, etc.). Special purpose noise reduction software programs include Topaz DeNoise, DFine, Neat Image, Noiseless, Noiseware, Grain Surgery, Noise Ninja, DenoiseMyImage, Smart Image Denoiser, G'MIC(through the -denoise command), and pnmnlfilt (nonlinear filter) found in the open source Netpbm tools. General purpose image and photo editing software including noise reduction functions include Adobe Photoshop, GIMP, PhotoImpact, Paint Shop Pro, Helicon Filter, and Darktable.[16]

See also

General noise issues

Audio

Video

Similar problems

References

  1. ↑ Hoffman, F. (2004), Encyclopedia of Recorded Sound 1 (revised ed.), Taylor & Francis
  2. ↑ "Noise Reduction". Audiotools.com. 2013-11-10.
    http://freespace.virgin.net/ljmayes.mal/comp/philips.htm[]
  3. ↑ "Dynamic Noise Reduction". ComPol Inc.
  4. ↑ http://www.national.com/company/pressroom/history80.html[]
  5. ↑ http://www.triadspeakers.com/education_avterms.html[]
  6. ↑ http://www.national.com/pf/LM/LM1894.html[]
  7. ↑ "HIGH COM - The HIGH COM broadband compander utilizing the integrated circuit U 401 BR" (PDF). AEG-Telefunken.
  8. ↑ Ed Gunyo. "Evolution of the Riviera - 1983 the 20th Anniversary". Riviera Owners Association. Originally published in The Riview Vol. 21, No. 6 September/October 2005.
  9. ↑ http://www.hellodirect.com/catalog/Product.jhtml?PRODID=11127&CATID=15295[]
  10. ↑ B. Boashash, editor, Time-Frequency Signal Analysis and Processing – A Comprehensive Reference, Elsevier Science, Oxford, 2003; ISBN 0-08-044335-4
  11. ↑ B. Boashash, "Estimating and Interpreting the Instantaneous Frequency of a Signal-Part I: Fundamentals", Proceedings of the IEEE, Vol. 80, No. 4, pp. 519–538, April 1992, doi:10.1109/5.135376
  12. ↑ Puyin Liu and Hongxing Li (2004). Fuzzy Neural Network Theory and Application. World Scientific. ISBN 981-238-786-2.
  13. 1 2 M. Forouzanfar, H. Abrishami-Moghaddam, and S. Ghadimi, "Locally adaptive multiscale Bayesian method for image denoising based on bivariate normal inverse Gaussian distributions", International Journal of Wavelets, Multiresolution and Information Processing, vol. 6, Issue 4, pp. 653–64, July 2008.
  14. ↑ Mallat, S.: A Wavelet Tour of Signals Processing. Academic Press, London (1998)
  15. ↑ Julian Besag (1986). "On the Statistical Analysis of Dirty Pictures". Journal of the Royal Statistical Society. Series B (Methodological) 48 (3): 259–302.
  16. ↑ jo (2012-12-11). "profiling sensor and photon noise .. and how to get rid of it.". darktable.

External links

This article is issued from Wikipedia - version of the Monday, February 01, 2016. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.