Head-up display

This article is about the military and vehicle technology. For its use in gaming, see HUD (video gaming).
HUD of an aircraft

A head-up display or heads-up display[1]—also known as a HUD—is any transparent display that presents data without requiring users to look away from their usual viewpoints. The origin of the name stems from a pilot being able to view information with the head positioned "up" and looking forward, instead of angled down looking at lower instruments.

Although they were initially developed for military aviation, HUDs are now used in commercial aircraft, automobiles and other, mostly professional applications.

Overview

HUD mounted in a PZL TS-11 Iskra jet trainer aircraft with a glass plate combiner and a convex collimating lens just below it

A typical HUD contains three primary components: a projector unit, a combiner, and a video generation computer.[2]

The projection unit in a typical HUD is an optical collimator setup: a convex lens or concave mirror with a Cathode Ray Tube, light emitting diode, or liquid crystal display at its focus. This setup (a design that has been around since the invention of the reflector sight in 1900) produces an image where the light is parallel i.e. perceived to be at infinity.

The combiner is typically an angled flat piece of glass (a beam splitter) located directly in front of the viewer, that redirects the projected image from projector in such a way as to see the field of view and the projected infinity image at the same time. Combiners may have special coatings that reflect the monochromatic light projected onto it from the projector unit while allowing all other wavelengths of light to pass through. In some optical layouts combiners may also have a curved surface to refocus the image from the projector.

The computer provides the interface between the HUD (i.e. the projection unit) and the systems/data to be displayed and generates the imagery and symbology to be displayed by the projection unit .

Types

Other than fixed mounted HUDs, there are also head-mounted displays (HMDs). Including helmet mounted displays (both abbreviated HMD), forms of HUD that features a display element that moves with the orientation of the user's head.

Many modern fighters (such as the F/A-18, F-16 and Eurofighter) use both a HUD and HMD concurrently. The F-35 Lightning II was designed without a HUD, relying solely on the HMD, making it the first modern military fighter not to have a fixed HUD.

Generations

HUDs are split into four generations reflecting the technology used to generate the images.

Newer micro-display imaging technologies are being introduced, including liquid crystal display (LCD), liquid crystal on silicon (LCoS), digital micro-mirrors (DMD), and organic light-emitting diode (OLED).

History

Longitudinal cross-section of a basic reflector sight (1937 German Revi C12/A).
Copilot's HUD of a C-130J

HUDs evolved from the reflector sight, a pre-World War II parallax-free optical sight technology for military fighter aircraft.[3] The gyro gunsight added a reticle that moved based on the speed and turn rate to solve the amount of lead needed to hit a target while maneuvering.

During the early 1940s, the Telecommunications Research Establishment (TRE), in charge of UK radar development, found that Royal Air Force (RAF) night fighter pilots were having a hard time reacting to the verbal instruction of the radar operator as they approached their targets. They experimented with the addition of a second radar display for the pilot, but found they had trouble looking up from the lit screen into the dark sky in order to find the target. In October 1942 they had successfully combined the image from the radar tube with a projection from their standard GGS Mk. II gyro gunsight on a flat area of the windscreen.[4] A key upgrade was the move from the original AI Mk. IV radar to the microwave-frequency AI Mk. VII radar found on the de Havilland Mosquito night fighter. This set produced an artificial horizon that further eased head-up flying.[5]

In 1955 the US Navy's Office of Naval Research and Development did some research with a mockup HUD concept unit along with a sidestick controller in an attempt to ease the pilot's burden flying modern jet aircraft and make the instrumentation less complicated during flight. While their research was never incorporated in any aircraft of that time, the crude HUD mockup they built had all the features of today's modern HUD units.[6]

HUD technology was next advanced by the Royal Navy in the Buccaneer, the prototype of which first flew on 30 April 1958. The aircraft's design called for an attack sight that would provide navigation and weapon release information for the low level attack mode. There was fierce competition between supporters of the new HUD design and supporters of the old electro-mechanical gunsight, with the HUD being described as a radical, even foolhardy option. The Air Arm branch of the Ministry of Defence sponsored the development of a Strike Sight. The Royal Aircraft Establishment (RAE) designed the equipment, it was built by Cintel, and the system was first integrated in 1958. The Cintel HUD business was taken over by Elliott Flight Automation and the Buccaneer HUD was manufactured and further developed, continuing up to a Mark III version with a total of 375 systems made; it was given a 'fit and forget' title by the Royal Navy and it was still in service nearly 25 years later. BAE Systems thus has a claim to the world's first Head Up Display in operational service.[7]

In the United Kingdom, it was soon noted that pilots flying with the new gun-sights were becoming better at piloting their aircraft. At this point, the HUD expanded its purpose beyond weapon aiming to general piloting. In the 1960s, French test-pilot Gilbert Klopfstein created the first modern HUD and a standardized system of HUD symbols so that pilots would only have to learn one system and could more easily transition between aircraft. The modern HUD used in instrument flight rules approaches to landing was developed in 1975.[8] Klopfstein pioneered HUD technology in military fighter jets and helicopters, aiming to centralize critical flight data within the pilot's field of vision. This approach sought to increase the pilot's scan efficiency and reduce "task saturation" and information overload.

Use of HUDs then expanded beyond military aircraft. In the 1970s, the HUD was introduced to commercial aviation, and in 1988, the Oldsmobile Cutlass Supreme became the first production car with a head-up display.

Until a few years ago, the Embraer 190, Saab 2000, Boeing 727, Boeing 737-300, 400, 500 and Boeing 737 New Generation Aircraft (737-600,700,800, and 900 series) were the only commercial passenger aircraft available with HUDs. However, the technology is becoming more common with aircraft such as the Canadair RJ, Airbus A318 and several business jets featuring the displays. HUDs have become standard equipment on the Boeing 787.[9] Furthermore, the Airbus A320, A330, A340 and A380 families are currently undergoing the certification process for a HUD.[10] HUDs are also added to the Space Shuttle orbiter.

Design factors

There are several factors that interplay in the design of a HUD:

Aircraft

On aircraft avionics systems, HUDs typically operate from dual independent redundant computer systems. They receive input directly from the sensors (pitot-static, gyroscopic, navigation, etc.) aboard the aircraft and perform their own computations rather than receiving previously computed data from the flight computers. On other aircraft (the Boeing 787, for example) the HUD guidance computation for Low Visibility Take-off (LVTO) and low visibility approach comes from the same flight guidance computer that drives the autopilot. Computers are integrated with the aircraft's systems and allow connectivity onto several different data buses such as the ARINC 429, ARINC 629, and MIL-STD-1553.[8]

Displayed data

Typical aircraft HUDs display airspeed, altitude, a horizon line, heading, turn/bank and slip/skid indicators. These instruments are the minimum required by 14 CFR Part 91.[12]

Other symbols and data are also available in some HUDs:

Since being introduced on HUDs, both the FPV and acceleration symbols are becoming standard on head-down displays (HDD). The actual form of the FPV symbol on an HDD is not standardized but is usually a simple aircraft drawing, such as a circle with two short angled lines, (180 ± 30 degrees) and "wings" on the ends of the descending line. Keeping the FPV on the horizon allows the pilot to fly level turns in various angles of bank.

Military aircraft specific applications

FA-18 HUD while engaged in a mock dogfight

In addition to the generic information described above, military applications include weapons system and sensor data such as:

VTOL/STOL approaches and landings

During the 1980s, the military tested the use of HUDs in vertical take off and landings (VTOL) and short take off and landing (STOL) aircraft. A HUD format was developed at NASA Ames Research Center to provide pilots of V/STOL aircraft with complete flight guidance and control information for Category III C terminal-area flight operations. This includes a large variety of flight operations, from STOL flights on land-based runways to VTOL operations on aircraft carriers. The principal features of this display format are the integration of the flightpath and pursuit guidance information into a narrow field of view, easily assimilated by the pilot with a single glance, and the superposition of vertical and horizontal situation information. The display is a derivative of a successful design developed for conventional transport aircraft.[14]

Civil aircraft specific applications

The cockpit of NASA's Gulfstream GV with a synthetic vision system display. The HUD combiner is in front of the pilot (with a projector mounted above it). This combiner uses a curved surface to focus the image.

The use of head-up displays allows commercial aircraft substantial flexibility in their operations. Systems have been approved which allow reduced-visibility takeoffs, and landings, as well as full Category III A landings and roll-outs.[15][16][17] Studies have shown that the use of a HUD during landings decreases the lateral deviation from centerline in all landing conditions, although the touchdown point along the centerline is not changed.[18]

Enhanced flight vision systems

In more advanced systems, such as the FAA-labeled Enhanced Flight Vision System,[19] a real-world visual image can be overlaid onto the combiner. Typically an infrared camera (either single or multi-band) is installed in the nose of the aircraft to display a conformed image to the pilot. EVS Enhanced Vision System is an industry accepted term which the FAA decided not to use because "the FAA believes [it] could be confused with the system definition and operational concept found in 91.175(l) and (m)"[19] In one EVS installation, the camera is actually installed at the top of the vertical stabilizer rather than "as close as practical to the pilots eye position". When used with a HUD however, the camera must be mounted as close as possible to the pilots eye point as the image is expected to "overlay" the real world as the pilot looks through the combiner.

"Registration," or the accurate overlay of the EVS image with the real world image, is one feature closely examined by authorities prior to approval of a HUD based EVS. This is because of the importance of the HUD matching the real world.

While the EVS display can greatly help, the FAA has only relaxed operating regulations[20] so an aircraft with EVS can perform a CATEGORY I approach to CATEGORY II minimums. In all other cases the flight crew must comply with all "unaided" visual restrictions. (For example if the runway visibility is restricted because of fog, even though EVS may provide a clear visual image it is not appropriate (or actually legal) to maneuver the aircraft using only the EVS below 100' agl.)

Synthetic vision systems

A synthetic vision system display

HUD systems are also being designed to display a synthetic vision system (SVS) graphic image, which uses high precision navigation, attitude, altitude and terrain databases to create realistic and intuitive views of the outside world.[21][22][23]

In the SVS head down image shown on the right, immediately visible indicators include the airspeed tape on the left, altitude tape on the right, and turn/bank/slip/skid displays at the top center. The boresight symbol (-v-) is in the center and directly below that is the flight path vector symbol (the circle with short wings and a vertical stabilizer). The horizon line is visible running across the display with a break at the center, and directly to the left are numbers at ±10 degrees with a short line at ±5 degrees (the +5 degree line is easier to see) which, along with the horizon line, show the pitch of the aircraft. Unlike this color depiction of SVS on a head down primary flight display, the SVS displayed on a HUD is monochrome – that is, typically, in shades of green.

The image indicates a wings level aircraft (i.e. the flight path vector symbol is flat relative to the horizon line and there is zero roll on the turn/bank indicator). Airspeed is 140 knots, altitude is 9450 feet, heading is 343 degrees (the number below the turn/bank indicator). Close inspection of the image shows a small purple circle which is displaced from the Flight Path Vector slightly to the lower right. This is the guidance cue coming from the Flight Guidance System. When stabilized on the approach, this purple symbol should be centered within the FPV.

The terrain is entirely computer generated from a high resolution terrain database.

In some systems, the SVS will calculate the aircraft's current flight path, or possible flight path (based on an aircraft performance model, the aircraft's current energy, and surrounding terrain) and then turn any obstructions red to alert the flight crew. Such a system might have helped the pilots of American Airlines Flight 965 prevent the fatal accident in 1995.

On the left side of the display is an SVS-unique symbol, with the appearance of a purple, dimishing sideways ladder, and which continues on the right of the display. The two lines define a "tunnel in the sky". This symbol defines the desired trajectory of the aircraft in three dimensions. For example, if the pilot had selected an airport to the left, then this symbol would curve off to the left and down. If the pilot keeps the flight path vector alongside the trajectory symbol, the craft will fly the optimum path. This path would be based on information stored in the Flight Management System's data base and would show the FAA-approved approach for that airport.

The tunnel in the sky can also greatly assist the pilot when more precise four-dimensional flying is required, such as the decreased vertical or horizontal clearance requirements of RNP. Under such conditions the pilot is given a graphical depiction of where the aircraft should be and where it should be going rather than the pilot having to mentally integrate altitude, airspeed, heading, energy and longitude and latitude to correctly fly the aircraft.[24]

Automobiles

HUD in a BMW E60
The green arrow on the windshield near the top of this picture is a Head Up Display on a 2013 Toyota Prius. It toggles between the GPS navigation instruction arrow and the speedometer. The arrow is animated to appear scrolling forward as the car approaches the turn.

These displays are becoming increasingly available in production cars, and usually offer speedometer, tachometer, and navigation system displays. Night vision information is also displayed via HUD on certain automobiles

In 2012 Pioneer Corporation introduced a navigation system that projects a HUD in place of the driver's visor that presents animations of conditions ahead, a form of augmented reality (AR).[25][26] Add-on HUD systems also exist, projecting the display onto a glass combiner mounted on the windshield.

Motorcycle helmet HUDs are also commercially available.[27]

Developmental / experimental uses

HUDs have been proposed or are being experimentally developed for a number of other applications. In the military, a HUD can be used to overlay tactical information such as the output of a laser rangefinder or squadmate locations to infantrymen. A prototype HUD has also been developed that displays information on the inside of a swimmer's goggles or of a scuba diver's mask.[28] A group of Electrical Engineering students from the University of Massachusetts Amherst are integrating technologies in order to develop an affordable Personal Head-Up Display.[29] One such design is a HUD in skiing goggles. HUD systems that project information directly onto the wearer's retina with a low-powered laser (virtual retinal display) are also in experimentation.[30][31]

See also

References

  1. Oxford Dictionary of English, Angus Stevenson, Oxford University Press - 2010, page 809 (head-up display (N.Amer. also heads-up display))
  2. Fred H. Previc; William R. Ercoline. Spatial disorientation in aviation. Books.google.com. p. 452. Retrieved 2012-07-14.
  3. D. N. Jarrett. Cockpit engineering. Books.google.com. p. 189. Retrieved 2012-07-14.
  4. Ian White, "The History of Air Intercept Radar & the British Nightfigher", Pen & Sword, 2007, p. 207
  5. "Axis History Forum • View topic – RAF Fixed and Free-mounted Reflector Gunsights". Forum.axishistory.com. Retrieved 2009-12-08.
  6. "Windshield TV Screen To Aid Blind Flying." Popular Mechanics, March 1955, p. 101.
  7. Rochester Avionics Archives
  8. 8.0 8.1 8.2 Spitzer, Cary R., ed. "Digital Avionics Handbook". Head-Up Displays. Boca Raton, FL: CRC Press, 2001
  9. Norris, G.; Thomas, G.; Wagner, M. & Forbes Smith, C. (2005). Boeing 787 Dreamliner—Flying Redefined. Aerospace Technical Publications International. ISBN 0-9752341-2-9.
  10. "Airbus A318 approved for Head Up Display". Airbus.com. 2007-12-03. Archived from the original on December 7, 2007. Retrieved 2009-10-02.
  11. The avionics handbook By Cary R. Spitzer, section 4-7. Books.google.com. Retrieved 2012-07-14.
  12. "14 CFR Part 91". Airweb.faa.gov. Retrieved 2009-10-02.
  13. ""Forces in a Climb" NASA Glenn Research Center". Grc.nasa.gov. 2008-07-11. Retrieved 2009-10-02.
  14. Merrick, Vernon K., Glenn G. Farris, and Andrejs A. Vanags. "A Head Up Display for Applicatoin to V/STOL Aircraft Approach and Landing". NASA Ames Research Center 1990.
  15. Order: 8700.1 Appendix: 3 Bulletin Type: Flight Standards Handbook Bulletin for General Aviation (HBGA) Bulletin Number: HBGA 99-16 Bulletin Title: Category III Authorization for Parts 91 and 125 Operators with Head-Up Guidance Systems (HGS); LOA and Operations Effective Date: 8-31-99
  16. Falcon 2000 Becomes First Business Jet Certified Category III A by JAA and FAA; Aviation Weeks Show News Online September 7, 1998
  17. "Design Guidance for a HUD System is contained in Draft Advisory Circular AC 25.1329-1X, "Approval of Flight Guidance Systems" dated 10/12/2004". Airweb.faa.gov. Retrieved 2009-10-02.
  18. Goteman, Ö.; Smith, K.; Dekker, S. (2007). "HUD With a Velocity (Flight Path) Vector Reduces Lateral Error During Landing in Restricted Visibility". International Journal of Aviation Psychology 17 (1): 91–108. doi:10.1080/10508410709336939.
  19. 19.0 19.1 U.S. DOT/FAA – Final Rule: Enhanced Flight Vision Systems
  20. 14 CFR Part 91.175 change 281 "Takeoff and Landing under IFR"
  21. "Slide 1" (PDF). Archived from the original (PDF) on March 9, 2008. Retrieved 2009-10-02.
  22. For additional information see Evaluation of Alternate Concepts for Synthetic Vision Flight Displays with Weather-Penetrating Sensor Image Inserts During Simulated Landing Approaches, NASA/TP-2003-212643
  23. "No More Flying Blind, NASA". Nasa.gov. 2007-11-30. Retrieved 2009-10-02.
  24. "PowerPoint Presentation" (PDF). Archived from the original (PDF) on March 9, 2008. Retrieved 2009-10-02.
  25. Pioneer launches car navigation with augmented reality, heads-up displays System also uses dash cams to share images of street conditions across Japan. Alabaster, Jay | Computerworld | Pioneer launches car navigation with augmented reality, heads-up displays June 28, 2013
  26. Ulanoff, Lance | Mashable | Pioneer AR Heads Up Display Augments Your Driving Reality January 11, 2012
  27. "Mike, Werner. "Test Driving the SportVue Motorcycle HUD". Motorcycles in the Fast Lane. 8 November 2005. Accessed 14 February 2007". News.motorbiker.org. Retrieved 2009-10-02.
  28. Julie Clothier for CNN. "Clothier, Julie. "Smart Goggles Easy on the Eyes". CNN.Com. 27 June 2005. CNN. Accessed 22 February 2007". Edition.cnn.com. Retrieved 2009-10-02.
  29. "Ivan A. Bercovich, Radu-A Ivan, Jeffrey Little, Felipe Vilas-Boas. "Personal Head-Up Display" University of Massachusetts Amherst. 11 December 2008". Ecs.umass.edu. Retrieved 2009-10-02.
  30. Panagiotis Fiambolis. ""Virtual Retinal Display (VRD) Technology". Virtual Retinal Display Technology. Naval Postgraduate School. 13 February 2007". Cs.nps.navy.mil. Archived from the original on April 13, 2008. Retrieved 2009-10-02.
  31. Lake, Matt (2001-04-26). "Lake, Matt. "How It Works: Retinal Displays Add a Second Data Layer". New York Times 26 April 2001. accessed 13 February 2006". Nytimes.com. Retrieved 2009-10-02.

External links

Wikimedia Commons has media related to Head-up displays.