Head-up display

HUD of an aircraft

A head-up display or heads-up display,^[1] also known as a HUD, is any transparent display that presents data without requiring users to look away from their usual viewpoints. The origin of the name stems from a pilot being able to view information with the head positioned "up" and looking forward, instead of angled down looking at lower instruments. A HUD also has the advantage that the pilot's eyes do not need to refocus to view the outside after looking at the optically nearer instruments.

Although they were initially developed for military aviation, HUDs are now used in commercial aircraft, automobiles and other, mostly professional applications.

Overview

HUD mounted in a PZL TS-11 Iskra jet trainer aircraft with a glass plate combiner and a convex collimating lens just below it

A typical HUD contains three primary components: a projector unit, a combiner, and a video generation computer.^[2]

The projection unit in a typical HUD is an optical collimator setup: a convex lens or concave mirror with a Cathode Ray Tube, light emitting diode, or liquid crystal display at its focus. This setup (a design that has been around since the invention of the reflector sight in 1900) produces an image where the light is collimated, i.e. the focal point is perceived to be at infinity.

The combiner is typically an angled flat piece of glass (a beam splitter) located directly in front of the viewer, that redirects the projected image from projector in such a way as to see the field of view and the projected infinity image at the same time. Combiners may have special coatings that reflect the monochromatic light projected onto it from the projector unit while allowing all other wavelengths of light to pass through. In some optical layouts combiners may also have a curved surface to refocus the image from the projector.

The computer provides the interface between the HUD (i.e. the projection unit) and the systems/data to be displayed and generates the imagery and symbology to be displayed by the projection unit .

Types

Other than fixed mounted HUD, there are also head-mounted displays (HMDs). Including helmet mounted displays (both abbreviated HMD), forms of HUD that features a display element that moves with the orientation of the user's head.

Many modern fighters (such as the F/A-18, F-16 and Eurofighter) use both a HUD and HMD concurrently. The F-35 Lightning II was designed without a HUD, relying solely on the HMD, making it the first modern military fighter not to have a fixed HUD.

Generations

HUDs are split into four generations reflecting the technology used to generate the images.

• First Generation—Use a CRT to generate an image on a phosphor screen, having the disadvantage of the phosphor screen coating degrading over time. The majority of HUDs in operation today are of this type.
• Second Generation—Use a solid state light source, for example LED, which is modulated by an LCD screen to display an image. These systems do not fade or require the high voltages of first generation systems. These systems are on commercial aircraft.
• Third Generation—Use optical waveguides to produce images directly in the combiner rather than use a projection system.
• Fourth Generation—Use a scanning laser to display images and even video imagery on a clear transparent medium.

Newer micro-display imaging technologies are being introduced, including liquid crystal display (LCD), liquid crystal on silicon (LCoS), digital micro-mirrors (DMD), and organic light-emitting diode (OLED).

History

Longitudinal cross-section of a basic reflector sight (1937 German Revi C12/A).

Copilot's HUD of a C-130J

HUDs evolved from the reflector sight, a pre-World War II parallax-free optical sight technology for military fighter aircraft.^[3] The gyro gunsight added a reticle that moved based on the speed and turn rate to solve the amount of lead needed to hit a target while maneuvering.

During the early 1940s, the Telecommunications Research Establishment (TRE), in charge of UK radar development, found that Royal Air Force (RAF) night fighter pilots were having a hard time reacting to the verbal instruction of the radar operator as they approached their targets. They experimented with the addition of a second radar display for the pilot, but found they had trouble looking up from the lit screen into the dark sky in order to find the target. In October 1942 they had successfully combined the image from the radar tube with a projection from their standard GGS Mk. II gyro gunsight on a flat area of the windscreen.^[4] A key upgrade was the move from the original AI Mk. IV radar to the microwave-frequency AI Mk. VII radar found on the de Havilland Mosquito night fighter. This set produced an artificial horizon that further eased head-up flying.^[5]

In 1955 the US Navy's Office of Naval Research and Development did some research with a mockup HUD concept unit along with a sidestick controller in an attempt to ease the pilot's burden flying modern jet aircraft and make the instrumentation less complicated during flight. While their research was never incorporated in any aircraft of that time, the crude HUD mockup they built had all the features of today's modern HUD units.^[6]

HUD technology was next advanced by the Royal Navy in the Buccaneer, the prototype of which first flew on 30 April 1958. The aircraft's design called for an attack sight that would provide navigation and weapon release information for the low level attack mode. There was fierce competition between supporters of the new HUD design and supporters of the old electro-mechanical gunsight, with the HUD being described as a radical, even foolhardy option. The Air Arm branch of the Ministry of Defence sponsored the development of a Strike Sight. The Royal Aircraft Establishment (RAE) designed the equipment, it was built by Cintel, and the system was first integrated in 1958. The Cintel HUD business was taken over by Elliott Flight Automation and the Buccaneer HUD was manufactured and further developed, continuing up to a Mark III version with a total of 375 systems made; it was given a 'fit and forget' title by the Royal Navy and it was still in service nearly 25 years later. BAE Systems, as successor to Elliotts via GEC-Marconi Avionics, thus has a claim to the world's first Head Up Display in operational service.^[7] The earliest usage of the term "head-up-display" can be traced to the Royal Aircraft Establishment's work during this time.^[8]

In the United Kingdom, it was soon noted that pilots flying with the new gun-sights were becoming better at piloting their aircraft. At this point, the HUD expanded its purpose beyond weapon aiming to general piloting. In the 1960s, French test-pilot Gilbert Klopfstein created the first modern HUD and a standardized system of HUD symbols so that pilots would only have to learn one system and could more easily transition between aircraft. The modern HUD used in instrument flight rules approaches to landing was developed in 1975.^[9] Klopfstein pioneered HUD technology in military fighter jets and helicopters, aiming to centralize critical flight data within the pilot's field of vision. This approach sought to increase the pilot's scan efficiency and reduce "task saturation" and information overload.

Use of HUDs then expanded beyond military aircraft. In the 1970s, the HUD was introduced to commercial aviation, and in 1988, the Oldsmobile Cutlass Supreme became the first production car with a head-up display.

Until a few years ago, the Embraer 190, Saab 2000, Boeing 727, Boeing 737-300, 400, 500 and Boeing 737 New Generation Aircraft (737-600,700,800, and 900 series) were the only commercial passenger aircraft available with HUDs. However, the technology is becoming more common with aircraft such as the Canadair RJ, Airbus A318 and several business jets featuring the displays. HUDs have become standard equipment on the Boeing 787.^[10] Furthermore, the Airbus A320, A330, A340 and A380 families are currently undergoing the certification process for a HUD.^[11] HUDs were also added to the Space Shuttle orbiter.

Design factors

There are several factors that interplay in the design of a HUD:

• Field of View – also "FOV", indicates the angle(s), vertically as well as horizontally, subtended at the pilot's eye, that the combiner displays symbology in relation to the outside view. A narrow FOV means that the view (of a runway, for example) through the combiner might include little additional information beyond the perimeters of the runway environment; whereas a wide FOV would allow a 'broader' view. For aviation applications, the major benefit of a wide FOV is that an aircraft approaching the runway in a crosswind might still have the runway in view through the combiner, even though the aircraft is pointed well away from the runway threshold; where a narrow FOV the runway would be 'off the edge' of the combiner, out of the HUD's view. Because the human eyes are separated, each eye receives a different image. The HUD image is viewable by one or both eyes, depending on technical and budget limitations in the design process. Modern expectations are that both eyes view the same image, in other words a "binocular Field of View (FOV)".
• Collimation – The projected image is collimated which makes the light rays parallel. Because the light rays are parallel the lens of the human eye focuses on infinity to get a clear image. Collimated images on the HUD combiner are perceived as existing at or near optical infinity. This means that the pilot's eyes do not need to refocus to view the outside world and the HUD display...the image appears to be "out there", overlaying the outside world. This feature is critical for effective HUDs: not having to refocus between HUD-displayed symbolic information and the outside world onto which that information is overlaid is one of the main advantages of collimated HUDs. It gives HUDs special consideration in safety-critical and time-critical manoeuvers, when the few seconds a pilot needs in order to re-focus inside the cockpit, and then back outside, are very critical: for example, in the final stages of landing. Collimation is therefore a primary distinguishing feature of high-performance HUDs and differentiates them from consumer-quality systems that, for example, simply reflect uncollimated information off a car's windshield (causing drivers to refocus and shift attention from the road ahead).
• Eyebox – The optical collimator produces a cylinder of parallel light so the display can only be viewed while the viewer's eyes are somewhere within that cylinder, a three-dimensional area called the head motion box or eyebox. Modern HUD eyeboxes are usually about 5 lateral by 3 vertical by 6 longitudinal inches. This allows the viewer some freedom of head movement but movement too far up/down left/right will cause the display to vanish off the edge of the collimator and movement too far back will cause it to crop off around the edge (vignette). The pilot is able to view the entire display as long as one of the eyes is inside the eyebox.^[12]
• Luminance/contrast – Displays have adjustments in luminance and contrast to account for ambient lighting, which can vary widely (e.g., from the glare of bright clouds to moonless night approaches to minimally lit fields).
• Boresight – Aircraft HUD components are very accurately aligned with the aircraft's three axes – a process called boresighting – so that displayed data conforms to reality typically with an accuracy of ±7.0 milliradians (±24 MOA), and may vary across the HUD's FOV. In this case the word "conform" means, "when an object is projected on the combiner and the actual object is visible, they will be aligned". This allows the display to show the pilot exactly where the artificial horizon is, as well as the aircraft's projected path with great accuracy. When Enhanced Vision is used, for example, the display of runway lights are aligned with the actual runway lights when the real lights become visible. Boresighting is done during the aircraft's building process and can also be performed in the field on many aircraft.^[9]
• Scaling – The displayed image (flight path, pitch and yaw scaling, etc.), are scaled to present to the pilot a picture that overlays the outside world in an exact 1:1 relationship. For example, objects (such as a runway threshold) that are 3 degrees below the horizon as viewed from the cockpit must appear at the −3 degree index on the HUD display.
• Compatibility – HUD components are designed to be compatible with other avionics, displays, etc.

Aircraft

On aircraft avionics systems, HUDs typically operate from dual independent redundant computer systems. They receive input directly from the sensors (pitot-static, gyroscopic, navigation, etc.) aboard the aircraft and perform their own computations rather than receiving previously computed data from the flight computers. On other aircraft (the Boeing 787, for example) the HUD guidance computation for Low Visibility Take-off (LVTO) and low visibility approach comes from the same flight guidance computer that drives the autopilot. Computers are integrated with the aircraft's systems and allow connectivity onto several different data buses such as the ARINC 429, ARINC 629, and MIL-STD-1553.^[9]

Displayed data

Typical aircraft HUDs display airspeed, altitude, a horizon line, heading, turn/bank and slip/skid indicators. These instruments are the minimum required by 14 CFR Part 91.^[13]

Other symbols and data are also available in some HUDs:

• boresight or waterline symbol—is fixed on the display and shows where the nose of the aircraft is actually pointing.
• flight path vector (FPV) or velocity vector symbol—shows where the aircraft is actually going, the sum of all forces acting on the aircraft.^[14] For example, if the aircraft is pitched up but is losing energy, then the FPV symbol will be below the horizon even though the boresight symbol is above the horizon. During approach and landing, a pilot can fly the approach by keeping the FPV symbol at the desired descent angle and touchdown point on the runway.
• acceleration indicator or energy cue—typically to the left of the FPV symbol, it is above it if the aircraft is accelerating, and below the FPV symbol if decelerating.
• angle of attack indicator—shows the wing's angle relative to the airflow, often displayed as "α".
• navigation data and symbols—for approaches and landings, the flight guidance systems can provide visual cues based on navigation aids such as an Instrument Landing System or augmented Global Positioning System such as the Wide Area Augmentation System. Typically this is a circle which fits inside the flight path vector symbol. Pilots can fly along the correct flight path by "flying to" the guidance cue.

Since being introduced on HUDs, both the FPV and acceleration symbols are becoming standard on head-down displays (HDD). The actual form of the FPV symbol on an HDD is not standardized but is usually a simple aircraft drawing, such as a circle with two short angled lines, (180 ± 30 degrees) and "wings" on the ends of the descending line. Keeping the FPV on the horizon allows the pilot to fly level turns in various angles of bank.

Military aircraft specific applications

FA-18 HUD while engaged in a mock dogfight

In addition to the generic information described above, military applications include weapons system and sensor data such as:

• target designation (TD) indicator—places a cue over an air or ground target (which is typically derived from radar or inertial navigation system data).
• V_c—closing velocity with target.
• Range—to target, waypoint, etc.
• weapon seeker or sensor line of sight—shows where a seeker or sensor is pointing.
• weapon status—includes type and number of weapons selected, available, arming, etc.

VTOL/STOL approaches and landings

During the 1980s, the military tested the use of HUDs in vertical take off and landings (VTOL) and short take off and landing (STOL) aircraft. A HUD format was developed at NASA Ames Research Center to provide pilots of V/STOL aircraft with complete flight guidance and control information for Category III C terminal-area flight operations. This includes a large variety of flight operations, from STOL flights on land-based runways to VTOL operations on aircraft carriers. The principal features of this display format are the integration of the flightpath and pursuit guidance information into a narrow field of view, easily assimilated by the pilot with a single glance, and the superposition of vertical and horizontal situation information. The display is a derivative of a successful design developed for conventional transport aircraft.^[15]

Civil aircraft specific applications

The cockpit of NASA's Gulfstream GV with a synthetic vision system display. The HUD combiner is in front of the pilot (with a projector mounted above it). This combiner uses a curved surface to focus the image.

The use of head-up displays allows commercial aircraft substantial flexibility in their operations. Systems have been approved which allow reduced-visibility takeoffs, and landings, as well as full Category III A landings and roll-outs.^[16][17][18] Studies have shown that the use of a HUD during landings decreases the lateral deviation from centerline in all landing conditions, although the touchdown point along the centerline is not changed.^[19]

Enhanced flight vision systems

In more advanced systems, such as the US Federal Aviation Administration (FAA)-labeled 'Enhanced Flight Vision System',^[20] a real-world visual image can be overlaid onto the combiner. Typically an infrared camera (either single or multi-band) is installed in the nose of the aircraft to display a conformed image to the pilot. 'EVS Enhanced Vision System' is an industry accepted term which the FAA decided not to use because "the FAA believes [it] could be confused with the system definition and operational concept found in 91.175(l) and (m)"^[20] In one EVS installation, the camera is actually installed at the top of the vertical stabilizer rather than "as close as practical to the pilots eye position". When used with a HUD however, the camera must be mounted as close as possible to the pilots eye point as the image is expected to "overlay" the real world as the pilot looks through the combiner.

"Registration," or the accurate overlay of the EVS image with the real world image, is one feature closely examined by authorities prior to approval of a HUD based EVS. This is because of the importance of the HUD matching the real world.

While the EVS display can greatly help, the FAA has only relaxed operating regulations^[21] so an aircraft with EVS can perform a CATEGORY I approach to CATEGORY II minimums. In all other cases the flight crew must comply with all "unaided" visual restrictions. (For example, if the runway visibility is restricted because of fog, even though EVS may provide a clear visual image it is not appropriate (or legal) to maneuver the aircraft using only the EVS below 100 feet above ground level.)

A Synthetic Vision System Display

Synthetic vision systems

A synthetic vision system display

HUD systems are also being designed to display a synthetic vision system (SVS) graphic image, which uses high precision navigation, attitude, altitude and terrain databases to create realistic and intuitive views of the outside world.^[22][23][24]

In the 1st SVS head down image shown on the right, immediately visible indicators include the airspeed tape on the left, altitude tape on the right, and turn/bank/slip/skid displays at the top center. The boresight symbol (-v-) is in the center and directly below that is the flight path vector (FPV) symbol (the circle with short wings and a vertical stabilizer). The horizon line is visible running across the display with a break at the center, and directly to the left are numbers at ±10 degrees with a short line at ±5 degrees (the +5 degree line is easier to see) which, along with the horizon line, show the pitch of the aircraft. Unlike this color depiction of SVS on a head down primary flight display, the SVS displayed on a HUD is monochrome – that is, typically, in shades of green.

The image indicates a wings level aircraft (i.e. the flight path vector symbol is flat relative to the horizon line and there is zero roll on the turn/bank indicator). Airspeed is 140 knots, altitude is 9,450 feet, heading is 343 degrees (the number below the turn/bank indicator). Close inspection of the image shows a small purple circle which is displaced from the flight path vector slightly to the lower right. This is the guidance cue coming from the Flight Guidance System. When stabilized on the approach, this purple symbol should be centered within the FPV.

The terrain is entirely computer generated from a high resolution terrain database.

In some systems, the SVS will calculate the aircraft's current flight path, or possible flight path (based on an aircraft performance model, the aircraft's current energy, and surrounding terrain) and then turn any obstructions red to alert the flight crew. Such a system might have helped prevent the crash of American Airlines Flight 965 into a mountain in December 1995.

On the left side of the display is an SVS-unique symbol, with the appearance of a purple, diminishing sideways ladder, and which continues on the right of the display. The two lines define a "tunnel in the sky". This symbol defines the desired trajectory of the aircraft in three dimensions. For example, if the pilot had selected an airport to the left, then this symbol would curve off to the left and down. If the pilot keeps the flight path vector alongside the trajectory symbol, the craft will fly the optimum path. This path would be based on information stored in the Flight Management System's database and would show the FAA-approved approach for that airport.

The tunnel in the sky can also greatly assist the pilot when more precise four-dimensional flying is required, such as the decreased vertical or horizontal clearance requirements of Required Navigation Performance (RNP). Under such conditions the pilot is given a graphical depiction of where the aircraft should be and where it should be going rather than the pilot having to mentally integrate altitude, airspeed, heading, energy and longitude and latitude to correctly fly the aircraft.^[25]

Tanks

In mid-2017, the Israel Defense Forces will begin trials of Elbit's Iron Vision, the world's first helmet-mounted head-up display for tanks. Israel's Elbit, which developed the helmet-mounted display system for the F-35, plans Iron Vision to use a number of externally mounted cameras to project the 360° view of a tank's surroundings onto the helmet-mounted visors of its crew members. This allows the crew members to stay inside the tank, without having to open the hatches to see outside.^[26][26]

Automobiles

HUD in a BMW E60

The green arrow on the windshield near the top of this picture is a Head-Up Display on a 2013 Toyota Prius. It toggles between the GPS navigation instruction arrow and the speedometer. The arrow is animated to appear scrolling forward as the car approaches the turn. The image is projected without any kind of glass combiner.

These displays are becoming increasingly available in production cars, and usually offer speedometer, tachometer, and navigation system displays. Night vision information is also displayed via HUD on certain automobiles.

Add-on HUD systems also exist, projecting the display onto a glass combiner mounted above or below the windshield.

In 2012 Pioneer Corporation introduced a HUD navigation system that replaces the driver side sun visor and visually overlays animations of conditions ahead; a form of augmented reality (AR).^[27][28] Developed by Pioneer Corporation, AR-HUD became the first aftermarket automotive Head-Up Display to use a direct-to-eye laser beam scanning method, also known as virtual retinal display (VRD). AR-HUD's core technology involves a miniature laser beam scanning display developed by MicroVision, Inc.^[29].

Motorcycle helmet HUDs are also commercially available.^[30]

Uniti electric city car will replace the dashboard and replace it with a large HUD directly to display information directly on the windscreen.^[31] The purpose is to increase safety as the driver will not have to move his eyes out from the road to look at the speed or the GPS screen.^[32]

Developmental / experimental uses

HUDs have been proposed or are being experimentally developed for a number of other applications. In the military, a HUD can be used to overlay tactical information such as the output of a laser rangefinder or squadmate locations to infantrymen. A prototype HUD has also been developed that displays information on the inside of a swimmer's goggles or of a scuba diver's mask.^[33] HUD systems that project information directly onto the wearer's retina with a low-powered laser (virtual retinal display) are also in experimentation.^[34][35]

See also

• Acronyms and abbreviations in avionics
• Augmented reality
• EyeTap
• HUD (video gaming)
• Optical head-mounted display
• Smartglasses
• The Eyes-on-the-Road-Benefit
• Virtual retinal display
• Wearable computer

References

External links

Wikimedia Commons has media related to Head-up displays.

• Rochester Archives Article—'Buccaneer HUD PDU'
• BBC Article—'Pacman comes to life virtually'
• 'Clinical evaluation of the 'head-up' display of anesthesia data'
• 'When will the Head-up go Civil' – Flight 1968 archive
• 'Elliott Brothers to BAE SYSTEMS' – a short history of Elliott Brothers
• Head-up Over the Hills – a 1964 Flight International article on flying using an early Specto head-up display
• Jaguar Unveils 'Virtual Widescreen' Technology to Assist Drivers - Latin Post