Sample-based synthesis

Sample-based synthesis is a form of audio synthesis that can be contrasted to either subtractive synthesis or additive synthesis. The principal difference with sample-based synthesis is that the seed waveforms are sampled sounds or instruments instead of fundamental waveforms such as sine and saw waves used in other types of synthesis.

Advantages of sample-based synthesis

Sample-based synthesis' principal advantage over other methods of digital synthesis such as physical modelling synthesis or additive synthesis is that processing power requirements are much lower. This is because most of the nuances of the sound models are contained in the pre-recorded samples rather than calculated in real-time.

In a contrast to analog synthesizers, the circuitry does not have to be duplicated to allow more voices to be played at once. Therefore the polyphony of sample-based machines is generally a lot higher. A downside is, however, that in order to include more detail, multiple samples might need to be played back at once (a trumpet might include a breath noise, a growl, and a looping soundwave used for continuous play). This reduces the polyphony again, as sample-based synthesizers rate their polyphony based on the number of multi-samples that can be played back simultaneously.

Multisampling

A sample-based synthesizer's ability to reproduce the nuances of natural instruments is determined primarily by its library of sampled sounds. In the earlier days of sample-based synthesis, computer memory was expensive and samples had to be as short and as few as possible. This was achieved by looping a part of the sample (often a single wave), and then using a volume envelope curve to make the sound fade away. An amplifying stage would translate key velocity into gain so that harder playing would translate into louder playback. In some cases key velocity also modulates the attack time of the instrument, leading to a faster attack for loud passages.

As memory became cheaper, it became possible to use multisampling; instead of a single recording of an instrument being played back faster or slower to reproduce other pitches, the original instrument could be sampled at regular intervals to cover regions of several adjacent notes (called "splits") or for every note. This provides a more natural progression from the lower to the higher registers; lower notes don't sound dull, and higher notes don't sound unnaturally bright. It is also possible to sample the same note at several different levels of intensity, reflecting the fact that both volume and timbre change with playing style. For instance, when sampling a piano, 3 samples per key can be made; soft, medium and with force. Every possible volume in between can be made by amplifying and blending the samples.

For sample-based models of instruments like the Rhodes piano, this multisampling is very important. The timbre of the Rhodes changes drastically from left to right on the keyboard, and it varies greatly depending on the force with which the key is struck. The lower registers "bark", while the higher range has a more bell-like sound. The bark will be more distinct if the keys are struck with force. For the model to be sufficiently expressive, it is therefore necessary that multisamples be made across both pitch and force of playing.

History

Before digital recording became practical, instruments such as the phonogene (1950s) and the Mellotron (1960s) used analog tape decks to play back sampled sounds.

When sample-based synthesis was first developed, most affordable consumer synthesizers could not record arbitrary samples, but instead formed timbres by combining pre-recorded samples from ROM before routing the result through analog or digital filters. These synthesizers and their more complex descendants are often referred to as ROMplers.

Sample-based instruments have been used since the Computer Music Melodian, the CMI Fairlight and the NED Synclavier. These instruments were way ahead of their time and were correspondingly expensive. The first recording using a sampling synthesizer was Stevie Wonder's "Secret Life of Plants" (1976) which used the Melodian to create complex melodies and rhythms from sampled sounds from nature. The first tune Wonder recorded was "The First Garden" where he used a sampled bird chirp as the lead sound in the song. More affordable sample-based synthesizers available for the masses with the introduction of the Roland D-50 and the Korg M1, which surfaced in the late eighties. The M1 also introduced the "workstation" concept.

The concept has made it into hi-end sound cards for the Multimedia PC, under the (incorrect) name of 'wavetable synthesis'.

Sampling synthesizers

A more flexible sample-based synthesis design allowing the user to record arbitrary waveforms to form a sound's basic timbre is called a sampler. Early samplers were very expensive, and typically had low sample rates and bit depth, resulting in grainy and aliased sound. Since the mid-1990s, however, samplers have featured specifications at least as good as CDs. By the late 1990s, the huge increases in computer processor speed permitted the widespread development of software synthesizers and software samplers. The vast storage capacity of modern computers was ideally suited to sample-based synthesis, and many samplers have thus migrated to software implementations or been superseded by new software samplers.