Traffic sign recognition

Traffic sign (speed limit) recognition

Traffic sign recognition is a technology by which a vehicle is able to recognise the traffic signs put on the road e.g. "speed limit" or "children" or "turn ahead". This is part of the features collectively called ADAS. The technology is being developed by many automotive suppliers, including Continental and Delphi. It uses Image processing techniques to detect the traffic signs. The detection methods can be generally divided into color based, shape based and learning based methods.

History

Vienna Convention on Road Signs and Signals is a treaty signed in 1968 which has been able to standardize traffic signs across different countries. About 52 countries have signed this treaty which includes 31 countries from Europe. The convention has broadly classified the road signs into seven categories designated with letters A–H. This standardasiation has been the main drive for helping the OEMs develop a traffic sign recognition system, which could be used globally.

A Speed Limit Sign in the US

These first TSR systems which recognize speed limits were developed in cooperation by Mobileye and Continental AG. They first appeared in late 2008 on the redesigned BMW 7-Series, and the following year on the Mercedes-Benz S-Class. Currently these systems only detect the round speed limit signs found all across Europe (e.g.[1]).

Second generation systems can also detect overtaking restrictions. It was introduced in 2008 in the Opel Insignia,[2] later followed by the Opel Astra and the Saab 9-5. This technology is also available on the 2011 Volkswagen Phaeton[3] and since 2012 in Volvo S80, V70, XC70, XC60, S60, V60 and V40 (model year 2013-), as a technology called Road Sign Information.[4] They are not able to recognise city limit signs, which in most European countries have meaning for speed limits, as they are too equal to direction signs.

Working

How does a Traffic sign recognition system work? Traffic signs can be analyzed using forward facing cameras in many of the modern cars, vehicles and trucks. One of the basic use case of a traffic sign recognition system in the speed limit. Most of the GPS data would procure speed information, but additional speed limit traffic signs can also be used to extract information and display it in the dashboard of the car to alert the driver about the road sign. This is an advanced driver assistance feature available in most of the high end cars, mainly in European oem vehicles.

An example algorithm for Traffic Sign detection

Modern traffic sign recognition systems are being developed using convolutional neural networks, mainly driven by the requirements of autonomous vehicles and self driving cars. In these scenarios, the detection system need to identify a variety of traffic signs and not just speed limits. This is where the Vienna Convention on Road Signs and Signals comes to help. A convolutional neural network can be trained to take in these predefined traffic signs and 'learn' using Deep Learning techniques. The neural net in turn uses Image Processing and Computer Vision to train the network with its potential outcomes. The trained neural net can then be used in real time to detect new traffic signs in real time. Self driving car companies like Waymo and Uber are generating and outsourcing traffic sign data sets along with Map and Navigation companies like Tom Tom.[5] Advanced computer vision and neural network techniques make this goal highly efficient and achievable in real time.

An example implementation of the image preprocessing steps in Traffic Sign detection algorithm

There are diverse algorithms for traffic sign recognition. Common ones are the ones based on the shape of the sign board. Typical sign board shapes like hexagon, circle, rectangle defines different types of signs, which can be used for classification. Other major algorithms for character recognition includes Haar-like features, Freeman Chain code, AdaBoost detection and deep learning neural networks methods. Haar-like features can be used to create cascaded classifiers which then can help detect the sign board characters. Deep learning can be incorporated for traffic sign detection. Polygonal approximation of digital curves using Ramer–Douglas–Peucker algorithm can be used to detect the shape of the sign boards and methods like Support Vector Machines and Byte-MCT with an AdaBoost classifier has been used in one of the methods to detect traffic signs.[6]

Vehicles using traffic sign recognition

References

  1. ↑ Eichner, M.; Breckon, T. (2008). "Integrated speed limit detection and recognition from real-time video" (PDF). IEEE International Intelligent Vehicles Symposium: 626–631. doi:10.1109/IVS.2008.4621285.
  2. ↑ "Assistenzsystem von Opel - Das magische Auge". Retrieved 17 December 2010.
  3. ↑ "Phaeton debuts with new design and new technologies". Retrieved 22 April 2010.
  4. ↑ "Road Sign Information". Retrieved 19 February 2013.
  5. ↑ "Whoever Owns the Maps Owns the Future of Self-Driving Cars".
  6. ↑ "Lim K, Hong Y, Choi Y, Byun H (2017) Real-time traffic sign recognition based on a general purpose GPU and deep-learning. PLoS ONE 12(3): e0173317".
  7. ↑ "BMW 1 Series 3-door : Traffic Sign Recognition:". Retrieved 4 October 2012.
  8. ↑ "Honda Launch 2014 - Mobileye". Retrieved 18 December 2015.

See also

This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.