Negative feedback
Negative feedback occurs when some function of the output of a system, process, or mechanism is fed back in a manner that tends to reduce the fluctuations in the output, whether caused by changes in the input or by other disturbances.
Whereas positive feedback tends to lead to instability via exponential growth, oscillation or chaotic behavior, negative feedback generally promotes stability. Negative feedback tends to promote a settling to equilibrium, and reduces the effects of perturbations. Negative feedback loops in which just the right amount of correction is applied with optimum timing can be very stable, accurate, and responsive.
Negative feedback is widely used in mechanical and electronic engineering, but it also occurs naturally within living organisms,[1][2] and can be seen in many other fields from chemistry and economics to physical systems such as the climate. General negative feedback systems are studied in control systems engineering.
Examples
Mercury thermostats (circa 1600) using expansion and contraction of columns of mercury in response to temperature changes were used in negative feedback systems to control vents in furnaces, maintaining a steady internal temperature.
In the invisible hand of the market metaphor of economic theory (1776), reactions to price movements provide a feedback mechanism to match supply and demand.
In centrifugal governors (1788), negative feedback is used to maintain a near-constant speed of an engine, irrespective of the load or fuel-supply conditions.
In a Steering engine (1866), power assistance is applied to the rudder with a feedback loop, to maintain the direction set by the steersman.
In servomechanisms, the speed or position of an output, as determined by a sensor, is compared to a set value, and any error is reduced by negative feedback to the input.
In audio amplifiers, negative feedback reduces distortion, minimises the effect of manufacturing variations in component parameters, and compensates for changes in characteristics due to temperature change.
In analog computing feedback around operational amplifiers is used to generate mathematical functions such as addition, subtraction, integration, differentiation, logarithm, and antilog functions.
In a phase locked loop (1932) feedback is used to maintain a generated alternating waveform in a constant phase to a reference signal. In many implementations the generated waveform is the output, but when used as a demodulator in a FM radio receiver, the error feedback voltage serves as the demodulated output signal. If there is a frequency divider between the generated waveform and the phase comparator, the device acts as a frequency multiplier.
In organisms, feedback enables various measures (e.g. body temperature, or blood sugar level) to be maintained within a desired range by homeostatic processes.
History
Negative feedback as a control technique may be seen in the refinements of the water clock introduced by Ktesibios of Alexandria in the 3rd century BCE. Self-regulating mechanisms have existed since antiquity, and were used to maintain a constant level in the reservoirs of water clocks as early as 200 BCE.[3]
Negative feedback was implemented in the 17th Century. Cornelius Drebbel had built thermostatically-controlled incubators and ovens in the early 1600s,[4] and centrifugal governors were used to regulate the distance and pressure between millstones in windmills.[5] James Watt patented a form of governor in 1788 to control the speed of his steam engine, and James Clerk Maxwell in 1868 described "component motions" associated with these governors that lead to a decrease in a disturbance or the amplitude of an oscillation.[6]
The term "feedback" was well established by the 1920s, in reference to a means of boosting the gain of an electronic amplifier.[7] Friis and Jensen described this action as "positive feedback" and made passing mention of a contrasting "negative feed-back action" in 1924.[8] Harold Stephen Black came up with the idea of using negative feedback in electronic amplifiers in 1927, submitted a patent application in 1928,[9] and detailed its use in his paper of 1934, where he defined negative feedback as a type of coupling that reduced the gain of the amplifier, in the process greatly increasing its stability and bandwidth.[10][11]
Karl KΓΌpfmΓΌller published papers on a negative-feedback-based automatic gain control system and a feedback system stability criterion in 1928.[12]
Nyquist and Bode built on Blackβs work to develop a theory of amplifier stability.[11]
Early researchers in the area of cybernetics subsequently generalized the idea of negative feedback to cover any goal-seeking or purposeful behavior.[13]
All purposeful behavior may be considered to require negative feed-back. If a goal is to be attained, some signals from the goal are necessary at some time to direct the behavior.
Cybernetics pioneer Norbert Wiener helped to formalize the concepts of feedback control, defining feedback in general as "the chain of the transmission and return of information",[14] and negative feedback as the case when:
The information fed back to the control center tends to oppose the departure of the controlled from the controlling quantity...(p97)
While the view of feedback as any "circularity of action" helped to keep the theory simple and consistent, Ashby pointed out that, while it may clash with definitions that require a "materially evident" connection, "the exact definition of feedback is nowhere important".[1] Ashby pointed out the limitations of the concept of "feedback":
The concept of 'feedback', so simple and natural in certain elementary cases, becomes artificial and of little use when the interconnections between the parts become more complex...Such complex systems cannot be treated as an interlaced set of more or less independent feedback circuits, but only as a whole. For understanding the general principles of dynamic systems, therefore, the concept of feedback is inadequate in itself. What is important is that complex systems, richly cross-connected internally, have complex behaviors, and that these behaviors can be goal-seeking in complex patterns. (p54)
To reduce confusion, later authors have suggested alternative terms such as degenerative,[15] self-correcting,[16] balancing,[17] or discrepancy-reducing[18] in place of "negative".
Overview
In many physical and biological systems, qualitatively different influences can oppose each other. For example, in biochemistry, one set of chemicals drives the system in a given direction, whereas another set of chemicals drives it in an opposing direction. If one or both of these opposing influences are non-linear, equilibrium point(s) result.
In biology, this process (in general, biochemical) is often referred to as homeostasis; whereas in mechanics, the more common term is equilibrium.
In engineering, mathematics and the physical, and biological sciences, common terms for the points around which the system gravitates include: attractors, stable states, eigenstates/eigenfunctions, equilibrium points, and setpoints.
In control theory, negative refers to the sign of the multiplier in mathematical models for feedback. In delta notation, βΞoutput is added to or mixed into the input. In multivariate systems, vectors help to illustrate how several influences can both partially complement and partially oppose each other.[7]
Some authors, in particular with respect to modelling business systems, use negative to refer to the reduction in difference between the desired and actual behavior of a system.[19][20] In a psychology context, on the other hand, negative refers to the valence of the feedback β attractive versus aversive, or praise versus criticism.[21]
In contrast, positive feedback is feedback in which the system responds so as to increase the magnitude of any particular perturbation, resulting in amplification of the original signal instead of stabilization. Any system in which there is positive feedback together with a gain greater than one will result in a runaway situation. Both positive and negative feedback require a feedback loop to operate.
However, negative feedback systems can still be subject to oscillations. This is caused by the slight delays around any loop. Due to these delays the feedback signal of some frequencies can arrive one half cycle later which will have a similar effect to positive feedback and these frequencies can reinforce themselves and grow over time. This problem is often dealt with by attenuating or changing the phase of the problematic frequencies. Unless the system naturally has sufficient damping, many negative feedback systems have low pass filters or dampers fitted.
Some specific implementations
There are a large number of different examples of negative feedback and some are discussed below.
Error-controlled regulation
One use of feedback is to make a system (say T) self-regulating to minimize the effect of a disturbance (say D). Using a negative feedback loop, a measurement of some variable (for example, a process variable, say E) is subtracted from a required value (the 'set point') to estimate an operational error in system status, which is then used by a regulator (say R) to reduce the gap between the measurement and the required value.[23][24] The regulator modifies the input to the system T according to its interpretation of the error in the status of the system. This error may be introduced by a variety of possible disturbances or 'upsets', some slow and some rapid.[25] The regulation in such systems can range from a simple 'on-off' control to a more complex processing of the error signal.[26]
It may be noted that the physical form of the signals in the system may change from point to point. So, for example, a change in weather may cause a disturbance to the heat input to a house (as an example of the system T) that is monitored by a thermometer as a change in temperature (as an example of an 'essential variable' E), converted by the thermostat (a 'comparator') into an electrical error in status compared to the 'set point' S, and subsequently used by the regulator (containing a 'controller' that commands gas control valves and an ignitor) ultimately to change the heat provided by a furnace (an 'effector') to counter the initial weather-related disturbance in heat input to the house.
Error controlled regulation is typically carried out using a Proportional-Integral-Derivative Controller (PID controller). The regulator signal is derived from a weighted sum of the error signal, integral of the error signal, and derivative of the error signal. The weights of the respective components depend on the application.[27]
Mathematically, the regulator signal is given by:
where
- is the integral time
- is the derivative time
Negative feedback amplifier
The negative feedback amplifier was invented by Harold Stephen Black at Bell Laboratories in 1927, and granted a patent in 1937 (US Patent 2,102,671 "a continuation of application Serial No. 298,155, filed August 8, 1928 ...").[9][28]
- "The patent is 52 pages long plus 35 pages of figures. The first 43 pages amount to a small treatise on feedback amplifiers!"[28]
There are many advantages to feedback in amplifiers.[29] In design, the type of feedback and amount of feedback are carefully selected to weigh and optimize these various benefits.
Though negative feedback has many advantages, amplifiers with feedback can oscillate. See the article on step response. They may even exhibit instability. Harry Nyquist of Bell Laboratories proposed the Nyquist stability criterion and the Nyquist plot that identify stable feedback systems, including amplifiers and control systems.
The figure shows a simplified block diagram of a negative feedback amplifier.
The feedback sets the overall (closed-loop) amplifier gain at a value:
where the approximate value assumes Ξ²A >> 1. This expression shows that a gain greater than one requires Ξ² < 1. Because the approximate gain 1/Ξ² is independent of the open-loop gain A, the feedback is said to 'desensitize' the closed-loop gain to variations in A (for example, due to manufacturing variations between units, or temperature effects upon components), provided only that the gain A is sufficiently large.[31] In this context, the factor (1+Ξ²A) is often called the 'desensitivity factor',[32][33] and in the broader context of feedback effects that include other matters like electrical impedance and bandwidth, the 'improvement factor'.[34]
If the disturbance D is included, the amplifier output becomes:
which shows that the feedback reduces the effect of the disturbance by the 'improvement factor' (1+Ξ² A). The disturbance D might arise from fluctuations in the amplifier output due to noise and nonlinearity (distortion) within this amplifier, or from other noise sources such as power supplies.[35][36]
The difference signal IβΞ²O at the amplifier input is sometimes called the "error signal".[37] According to the diagram, the error signal is:
From this expression, it can be seen that a large 'improvement factor' (or a large loop gain Ξ²A) tends to keep this error signal small.
Although the diagram illustrates the principles of the negative feedback amplifier, modeling a real amplifier as a unilateral forward amplification block and a unilateral feedback block has significant limitations.[38] For methods of analysis that do not make these idealizations, see the article Negative feedback amplifier.
Operational amplifier circuits
The operational amplifier was originally developed as a building block for the construction of analog computers, but is now used almost universally in all kinds of applications including audio equipment and control systems.
Operational amplifier circuits typically employ negative feedback to get a predictable transfer function. Since the open-loop gain of an op-amp is extremely large, a small differential input signal would drive the output of the amplifier to one rail or the other in the absence of negative feedback. A simple example of the use of feedback is the op-amp voltage amplifier shown in the figure.
The idealized model of an operational amplifier assumes that the gain is infinite, the input impedance is infinite, output resistance is zero, and input offset currents and voltages are zero. Such an ideal amplifier draws no current from the resistor divider.[40] Ignoring dynamics (transient effects and propagation delay), the infinite gain of the ideal op-amp means this feedback circuit drives the voltage difference between the two op-amp inputs to zero.[40] Consequently, the voltage gain of the circuit in the diagram, assuming an ideal op amp, is the reciprocal of feedback voltage division ratio Ξ²:
- .
A real op-amp has a high but finite gain A at low frequencies, decreasing gradually at higher frequencies. In addition, it exhibits a finite input impedance and a non-zero output impedance. Although practical op-amps are not ideal, the model of an ideal op-amp often suffices to understand circuit operation at low enough frequencies. As discussed in the previous section, the feedback circuit stabilizes the closed-loop gain and desensitizes the output to fluctuations generated inside the amplifier itself.[41]
Mechanical engineering
An example of the use of negative feedback control is the ballcock control of water level (see diagram). In modern engineering, negative feedback loops are found in fuel injection systems and carburettors. Similar control mechanisms are used in heating and cooling systems, such as those involving air conditioners, refrigerators, or freezers.
Biology and chemistry
Some biological systems exhibit negative feedback such as the baroreflex in blood pressure regulation and erythropoiesis. Many biological process (e.g., in the human anatomy) use negative feedback. Examples of this are numerous, from the regulating of body temperature, to the regulating of blood glucose levels. The disruption of feedback loops can lead to undesirable results: in the case of blood glucose levels, if negative feedback fails, the glucose levels in the blood may begin to rise dramatically, thus resulting in diabetes.
For hormone secretion regulated by the negative feedback loop: when gland X releases hormone X, this stimulates target cells to release hormone Y. When there is an excess of hormone Y, gland X "senses" this and inhibits its release of hormone X. As shown in the figure, most endocrine hormones are controlled by a physiologic negative feedback inhibition loop, such as the glucocorticoids secreted by the adrenal cortex. The hypothalamus secretes corticotropin-releasing hormone (CRH), which directs the anterior pituitary gland to secrete adrenocorticotropic hormone (ACTH). In turn, ACTH directs the adrenal cortex to secrete glucocorticoids, such as cortisol. Glucocorticoids not only perform their respective functions throughout the body but also negatively affect the release of further stimulating secretions of both the hypothalamus and the pituitary gland, effectively reducing the output of glucocorticoids once a sufficient amount has been released.[42]
Self-organization
Self-organization is the capability of certain systems "of organizing their own behavior or structure".[43] There are many possible factors contributing to this capacity, and most often positive feedback is identified as a possible contributor. However, negative feedback also can play a role.[44]
Economics
In economics, automatic stabilisers are government programs that are intended to work as negative feedback to dampen fluctuations in real GDP.
Mainstream economics asserts that the market pricing mechanism operates to match supply and demand, because mismatches between them feed back into the decision-making of suppliers and demanders of goods, altering prices and thereby reducing any discrepancy. However Norbert Wiener wrote in 1948:
- "There is a belief current in many countries and elevated to the rank of an official article of faith in the United States that free competition is itself a homeostatic process... Unfortunately the evidence, such as it is, is against this simple-minded theory."[45]
The notion of economic equilibrium being maintained in this fashion by market forces has also been questioned by numerous heterodox economists such as financier George Soros[46] and World Bank economist Herman Daly.[47]
See also
References
- 1 2 3 W. Ross Ashby (1957). "Chapter 12: The error-controlled regulator". Introduction to cybernetics (PDF). Chapman & Hall Ltd.; Internet (1999). pp. 219β243.
- β Robert E. Ricklefs, Gary Leon Miller (2000). "Β§6.1 Homeostasis depends upon negative feedback". Ecology. Macmillan. p. 92. ISBN 9780716728290.
- β Breedveld, Peter C. "Port-based modeling of mechatronic systems." Mathematics and Computers in Simulation 66.2 (2004): 99-128.
- β "Tierie, Gerrit. Cornelis Drebbel. Amsterdam: HJ Paris, 1932." (PDF). Retrieved 2013-05-03.
- β Hills, Richard L (1996), Power From the Wind, Cambridge University Press
- β Maxwell, James Clerk (1868). "On Governors" (PDF) 16. Proceedings of the Royal Society of London: 270β283 β via Wikimedia.
- 1 2 David A. Mindell (2002). Between Human and Machine : Feedback, Control, and Computing before Cybernetics. Baltimore, MD, USA: Johns Hopkins University Press. ISBN 9780801868955.
- β Friis, H.T., and A.G. Jensen. "High Frequency Amplifiers" Bell System Technical Journal 3 (April 1924):181-205.
- 1 2 James E Brittain (February 2011). "Electrical engineering hall of fame: Harold S Black" (PDF). Proceedings IEEE 99 (2): 351β353. doi:10.1109/jproc.2010.2090997.
- β Black, H.S. (January 1934). "Stabilized Feedback Amplifiers" (PDF). Bell System Tech. J. (American Telephone & Telegraph) 13 (1): 1β18. doi:10.1002/j.1538-7305.1934.tb00652.x. Retrieved January 2, 2013.
- 1 2 Stuart Bennett (1993). "Chapter 3: The electronic negative feedback amplifier". A history of control engineering 1930-1955. Institution of Electrical Engineers. pp. 70 ff. ISBN 9780863412806.
- β C. Bissell (2006). "Karl Kupfmuller, 1928: an early time-domain, closed-loop, stability criterion" (PDF). IEEE Control Systems: 115β116, 126.
- β Rosenblueth, Arturo, Norbert Wiener, and Julian Bigelow. "Behavior, purpose and teleology." Philosophy of science 10.1 (1943): 18-24.
- β Norbert Wiener Cybernetics: Or Control and Communication in the Animal and the Machine. Cambridge, Massachusetts: The Technology Press; New York: John Wiley & Sons, Inc., 1948.
- β Hermann A Haus and Richard B. Adler, Circuit Theory of Linear Noisy Networks, MIT Press, 1959
- β Peter M. Senge (1990). The Fifth Discipline: The Art and Practice of the Learning Organization. New York: Doubleday. p. 424. ISBN 0-385-26094-6.
- β Helen E. Allison, Richard J. Hobbs (2006). Science and Policy in Natural Resource Management: Understanding System Complexity. Cambridge University Press. p. 205. ISBN 9781139458603.
Balancing or negative feedback counteracts and opposes change
- β Charles S. Carver, Michael F. Scheier: On the Self-Regulation of Behavior Cambridge University Press, 2001
- β Arkalgud Ramaprasad (1983). "On The Definition of Feedback". Behavioral Science 28 (1): 4. doi:10.1002/bs.3830280103.
- β John D.Sterman, Business Dynamics: Systems Thinking and Modeling for a Complex World McGraw Hill/Irwin, 2000. ISBN 9780072389159
- β Herold, David M., and Martin M. Greller. "Research Notes. Feedback: The Definition of a Construct" Academy of Management Journal 20.1 (1977): 142-147.
- β Sudheer S Bhagade, Govind Das Nageshwar (2011). Process Dynamics and Control. PHI Learning Pvt. Ltd. pp. 6, 9. ISBN 9788120344051.
- β Charles H. Wilts (1960). Principles of Feedback Control. Addison-Wesley Pub. Co. p. 1.
In a simple feedback system a specific physical quantity is being controlled, and control is brought about by making an actual comparison of this quantity with its desired value and utilizing the difference to reduce the error observed. Such a system is self-correcting in the sense that any deviations from the desired performance are used to produce corrective action.
- β SK Singh (2010). Process Control: Concepts Dynamics And Applications. PHI Learning Pvt. Ltd. p. 222. ISBN 9788120336780.
- β For example, input and load disturbances. See William Y. Svrcek, Donald P. Mahoney, Brent R. Young (2013). A Real-Time Approach to Process Control (3rd ed.). John Wiley & Sons. p. 57. ISBN 9781118684733.
- β Charles D H Williams. "Types of feedback control". Feedback and temperature control. University of Exeter: Physics and astronomy. Retrieved 2014-06-08.
- β Bechhoefer, John. "Feedback for Physicists: A Tutorial Essay On Control". Reviews of Modern Physics (APS Physics) 77 (3): 783β835. doi:10.1103/revmodphys.77.783.
- 1 2 CA Desoer (August 1984). "In Memoriam: Harold Stephen Black". IEEE Transactions on Automatic Control. AC-29 (8).
- β Santiram Kal (2009). "Β§6.3 Advantages of negative feedback amplifiers". Basic electronics: Devices, circuits and its fundamentals. PHI Learning Pvt. Ltd. pp. 193 ff. ISBN 9788120319523.
- β Marc Thomson (2006). "Figure 11-4: Classical single input, single output control loop". Intuitive Analog Circuit Design. Newnes. ISBN 9780080478753.
- β Santiram Kal (2009). "Β§6.3.1 Gain stability". Basic Electronics: Devices, Circuits, and IT Fundamentals. PHI Learning Pvt. Ltd. pp. 193β194. ISBN 9788120319523.
- β Marc T Thompson, p. 309
- β Thomas H Lee, (2004). The Design of CMOS Radio Frequency Circuits (2nd ed.). Cambridge University Press. p. 447. ISBN 9780521835398.
- β Norbert A Malik (1995). "Improvement Factor". Electronic Circuits: Analysis simulation and design. Prentice Hall. p. 671. ISBN 9780023749100.
- β Santiram Kal. "Β§6.3.2 Noise Reduction". Basic Electronics: Devices, Circuits and IT fundamentals. p. 194.
- β SK Bhattacharya. "Β§5.3.3 Effect of feedback on disturbance signal". Linear Control Systems: For Punjab Technical University. ISBN 9788131759523.
- β Muhammad Rashid (2010). Microelectronic Circuits: Analysis & Design (2nd ed.). Cengage Learning. p. 642. ISBN 9780495667728.
- β Wai-Kai Chen (2005). "Chapter 13: General feedback theory". Circuit Analysis and Feedback Amplifier Theory. CRC Press. pp. 13β1. ISBN 9781420037272.
[In a practical amplifier] the forward path may not be strictly unilateral, the feedback path is usually bilateral, and the input and output coupling networks are often complicated.
- β See, for example, Figure 1.4, p. 7 Ideal op amp model in Sergio Franco (2002). Design with operational amplifiers and analog integrated circuits (3rd ed.). McGraw-Hill. ISBN 978-0078028168. or David G Nair, Sergio B Franco (2009). "Figure 16.2: The four possible op-amp configurations". In Wai-Kai Chen, ed. Fundamentals of Circuits and Filters (The Circuits and Filters Handbook, 3rd ed.). CRC Press. pp. 16β2. ISBN 9781420058888.
- 1 2 G. Schitter, A. Rankers (2014). "Β§6.3.4 Linear amplifiers with operational amplifiers". The Design of High Performance Mechatronics. IOS Press. p. 499. ISBN 9781614993681.
- β Walter G Jung (2005). "Noise gain (NG)". Op Amp Applications Handbook. Newnes. pp. 12 ff. ISBN 9780750678445.
- β Raven, PH; Johnson, GB. Biology, Fifth Edition, Boston: Hill Companies, Inc. 1999. page 1058.
- β William R. Uttal (2014). Psychomythics: Sources of Artifacts and Misconceptions in Scientific Psychology. Psychology Press. pp. 95 ff. ISBN 9781135623722.
- β Scott Camazine, Jean-Louis Deneubourg, Nigel R Franks, James Sneyd, Guy Theraulaz, Eric Bonabeau (2003). "Chapter 2: How self-organization works". Self-organization in biological systems. Princeton University Press. pp. 15 ff. ISBN 9780691116242.
- β Cybernetics: Or Control and Communication in the Animal and the Machine p.158
- β Goeroge Soros, The Alchemy of Finance
- β Herman Daly, Steady State Economics
External links
- "Physiological Homeostasis". biology online: answers to your biology questions. Biology-Online.org.