Sensor fusion
Sensor fusion is the combining of sensory data or data derived from sensory data from disparate sources such that the resulting information is in some sense better than would be possible when these sources were used individually. The term better in this case can mean more accurate, more complete, or more dependable, or refer to the result of an emerging view, such as stereoscopic vision (calculation of depth information by combining two-dimensional images from two cameras at slightly different viewpoints).[1][2]
The data sources for a fusion process are not specified to originate from identical sensors. One can distinguish direct fusion, indirect fusion and fusion of the outputs of the former two. Direct fusion is the fusion of sensor data from a set of heterogeneous or homogeneous sensors, soft sensors, and history values of sensor data, while indirect fusion uses information sources like a priori knowledge about the environment and human input.
Sensor fusion is also known as (multi-sensor) Data fusion and is a subset of information fusion.
Examples of sensors
- Radar
- Sonar and other acoustic
- Infra-red / thermal imaging camera
- TV cameras
- Sonobuoys
- Seismic sensors
- Magnetic sensors
- Electronic Support Measures (ESM)
- Phased array
- MEMS
- Accelerometers
- Global Positioning System (GPS)
Sensor fusion algorithms
Sensor fusion is a term that covers a number of methods and algorithms, including:
- Central Limit Theorem
- Kalman filter
- Bayesian networks
- Dempster-Shafer
Example sensor fusion calculations
Two example sensor fusion calculations are illustrated below.
Let and denote two sensor measurements with noise variances and , respectively. One way of obtaining a combined measurement is to apply the Central Limit Theorem, which is also employed within the Fraser-Potter fixed-interval smoother, namely [3]
- ,
where is the variance of the combined estimate. It can be seen that the fused result is simply a linear combination of the two measurements weighted by their respective noise variances.
Another method to fuse together two measurements is to use the optimal Kalman filter. Suppose that the data is generated by a first-order system and let denote the solution of the filter's Riccati equation. By applying Cramer's rule] within the gain calculation it can be found that the filter gain is given by [3]
By inspection, when the first measurement is noise free, the filter ignores the second measurement and vice versa. That is, the combined estimate is weighted by the quality of the measurements.
Centralized versus decentralized
In sensor fusion, centralized versus decentralized refers to where the fusion of the data occurs. In centralized fusion, the clients simply forward all of the data to a central location, and some entity at the central location is responsible for correlating and fusing the data. In decentralized, the clients take full responsibility for fusing the data. "In this case, every sensor or platform can be viewed as an intelligent asset having some degree of autonomy in decision-making."[4]
Multiple combinations of centralized and decentralized systems exist.
Levels
There are several categories or levels of sensor fusion that are commonly used.[5]
- Level 0 – Data alignment
- Level 1 – Entity assessment (e.g. signal/feature/object).
- Tracking and object detection/recognition/identification
- Level 2 – Situation assessment
- Level 3 – Impact assessment
- Level 4 – Process refinement (i.e. sensor management)
- Level 5 – User refinement
Applications
One application of sensor fusion is GPS/INS, where Global Positioning System and Inertial Navigation System data is fused together using various different methods, e.g. the Extended Kalman Filter. This is useful, for example, in determining the altitude of an aircraft using low-cost sensors.[6]
See also
- Information integration
- Data mining
- Data fusion
- Image fusion
- Information: Information is not data
- Data (computing)
- multimodal integration
- Fisher's method for combining independent tests of significance
- Transducer Markup Language (TML) is an XML based markup language which enables sensor fusion.
- Brooks – Iyengar algorithm
- Inertial navigation system
- Sensor Grid
- Semantic Perception
References
- ↑ Elmenreich, W. (2002). Sensor Fusion in Time-Triggered Systems, PhD Thesis. Vienna, Austria: Vienna University of Technology. p. 173.
- ↑ Haghighat, M. B. A., Aghagolzadeh, A., & Seyedarabi, H. (2011). Multi-focus image fusion for visual sensor networks in DCT domain. Computers & Electrical Engineering, 37(5), 789-797.
- ↑ 3.0 3.1 Einicke, G.A. (2012). Smoothing, Filtering and Prediction: Estimating the Past, Present and Future. Rijeka, Croatia: Intech. ISBN 978-953-307-752-9.
- ↑ N. Xiong; P. Svensson (2002). "Multi-sensor management for information fusion: issues and approaches". Information Fusion. p. 3(2):163–186.
- ↑ http://defensesystems.com/articles/2009/09/02/c4isr1-sensor-fusion.aspx
- ↑ Gross, Jason; Yu Gu, Matthew Rhudy, Srikanth Gururajan, and Marcello Napolitano (July 2012). "Flight Test Evaluation of Sensor Fusion Algorithms for Altitude Estimation". IEEE Transactions on Aerospace and Electronic Systems 48 (3): 2128–2139. doi:10.1109/TAES.2012.6237583.
- 'stuff/Rethinking%20JDL%20Data%20Fusion%20Levels_BowmanSteinberg.pdf Rethinking JDL Data Fusion Levels
- E. P. Blasch and S. Plano, “Level 5: User Refinement to aid the Fusion Process”, Proceedings of the SPIE, Vol. 5099, 2003.
- J. Llinas; C. Bowman; G. Rogova; A. Steinberg; E. Waltz; F. White (2004). "Revisiting the JDL data fusion model II". International Conference on Information Fusion. CiteSeerX: 10.1.1.58.2996.
- E. Blasch, "Sensor, user, mission (SUM) resource management and their interaction with level 2/3 fusion" International Conference on Information Fusion, 2006.
- J. L. Crowley and Y. DemazeauPrinciples and Techniques for Sensor Data Fusion Signal Processing, Volume 32, Issues 1–2, May 1993, Pages 5–27