High-dynamic-range video

High-dynamic-range video (HDR video) describes high dynamic range (HDR) video that is greater than standard dynamic range (SDR) video which uses a conventional gamma curve.[1] SDR video, when using a conventional gamma curve and a bit depth of 8-bits per sample, has a dynamic range of about 6 stops (64:1).[1] When HDR content is displayed on a 2,000 cd/m2 display with a bit depth of 10-bits per sample it has a dynamic range of 200,000:1 or 17.6 stops.[1]

Technology

Capture

In February and April 1990, Georges Cornuéjols introduced the first real-time HDR camera combining two successively[2] or simultaneously[3]-captured images.

In 1991 the first commercial video camera using consumer-grade sensors and cameras was introduced that performed real-time capturing of multiple images with different exposures, and producing an HDR video image, by Hymatom, licensee of Cornuéjols.

Also in 1991, Cornuéjols introduced the principle of non linear image accumulation HDR+ to increase the camera sensitivity:[4] in low-light environments, several successive images are accumulated, increasing the signal-to-noise ratio.

Later, in the early 2000s, several scholarly research efforts used consumer-grade sensors and cameras.[5] A few companies such as RED and Arri have been developing digital sensors capable of a higher dynamic range.[6][7] RED EPIC-X can capture time-sequential HDRx[8] images with a user-selectable 1–3 stops of additional highlight latitude in the "x" channel. The "x" channel can be merged with the normal channel in post production software. The Arri Alexa camera uses a dual gain architecture to generate an HDR image from two exposures captured at the same time.[9]

With the advent of low-cost consumer digital cameras, many amateurs began posting tone mapped HDR time-lapse videos on the Internet, essentially a sequence of still photographs in quick succession. In 2010 the independent studio Soviet Montage produced an example of HDR video from disparately exposed video streams using a beam splitter and consumer grade HD video cameras.[10] Similar methods have been described in the academic literature in 2001 and 2007.[11][12]

Modern movies have often been filmed with cameras featuring a higher dynamic range, and legacy movies can be upgraded even if manual intervention would be needed for some frames (as when old black-and-white films are upgraded to color). Also, special effects, especially those in which real and synthetic footage are seamlessly mixed, require both HDR shooting and rendering. HDR video is also needed in applications that demand high accuracy for capturing temporal aspects of changes in the scene. This is important in monitoring of some industrial processes such as welding, in predictive driver assistance systems in automotive industry, in surveillance video systems, and other applications. HDR video can be also considered to speed image acquisition in applications that need a large number of static HDR images are, for example in image-based methods in computer graphics.

OpenEXR was created in 1999 by Industrial Light and Magic (ILM) and released in 2003 as an open source software library.[13][14] OpenEXR is used for film and television production.[14]

Display

Display devices capable of greater dynamic range have been researched for decades, primarily with flat panel technologies like plasma, SED/FED and OLED.

TV sets with enhanced dynamic range and upscaling of existing SDR/LDR video/broadcast content with reverse tone mapping have been anticipated since early 2000s[15][16]. In 2016, HDR conversion of SDR video was released to market as Samsung's HDR+ (in LCD TV sets)[17] and Technicolor SA's HDR Intelligent Tone Management.[18]

Production

Academy Color Encoding System (ACES) was created by the Academy of Motion Picture Arts and Sciences and released in December 2014.[19] ACES is a complete workflow system that supports both HDR and wide color gamut (WCG).[19]

Video interfaces that support at least one HDR Format include HDMI 2.0a which was released on April 8, 2015 and DisplayPort 1.4 which was released on March 1, 2016.[20][21] On December 12, 2016, HDMI announced that Hybrid Log-Gamma (HLG) support had been added to the HDMI 2.0b standard.[22][23][24] HDMI 2.1 was officially announced on January 4, 2017, and added support for Dynamic HDR which is dynamic metadata that allows for changes on a scene-by-scene or frame-by-frame basis.[25][26] Society of Motion Picture and Television Engineers (SMPTE) has created a standard for dynamic metadata which is SMPTE ST 2094 or Dynamic Metadata for Color Volume Transform (DMCVT).[27] SMPTE ST 2094 was published in 2016 as six parts and includes four applications from Dolby, Philips, Samsung, and Technicolor.[27]

Standards

Perceptual Quantizer

Perceptual Quantizer (PQ), published by SMPTE as SMPTE ST 2084, is a transfer function that allows for the display of high dynamic range (HDR) video with a luminance level of up to 10,000 cd/m2 and can be used with the Rec. 2020 color space.[28][29][30][31] PQ is a non-linear electro-optical transfer function (EOTF). On April 18, 2016, the Ultra HD Forum announced industry guidelines for UHD Phase A which uses Hybrid Log-Gamma (HLG) and PQ transfer functions with a bit depth of 10-bits and the Rec. 2020 color space.[32] On July 6, 2016, the ITU announced Rec. 2100 which uses HLG or PQ as transfer functions with a Rec. 2020 color space.[33][34]

HDR10

HDR10 Media Profile, more commonly known as HDR10, was announced on August 27, 2015, by the Consumer Technology Association and which uses the wide-gamut Rec. 2020 color space, a bit depth of 10-bits, and the SMPTE ST 2084 (PQ) transfer function – a combination later also standardized in ITU-R BT.2100.[35] It also uses SMPTE ST 2086 "Mastering Display Color Volume" static metadata to send color calibration data of the mastering display, as well as MaxFALL (Maximum Frame Average Light Level) and MaxCLL (Maximum Content Light Level) static values, encoded as SEI messages within the video stream. HDR10 is an open standard supported by a wide variety of companies, which includes monitor and TV manufacturers such as Dell, LG, Samsung, Sharp, Sony, and Vizio,[36][37] as well as Microsoft and Sony Interactive Entertainment, which support HDR10 on their PlayStation 4 and Xbox One S video game console platforms.[38][39]

HDR10+

HDR10+, also known as HDR10 Plus, was announced on April 20, 2017, by Samsung and Amazon Video. HDR10+ updates HDR10 by adding dynamic metadata [40][41][42] which is based on Samsung application SMPTE ST 2094-40.[27][43] The dynamic metadata is additional data that can be used to more accurately adjust brightness levels on a scene-by-scene or frame-by-frame basis. HDR10+ is an open standard and is royalty-free; it is supported by Colorfront’s Transkoder and MulticoreWare's x265. HDR10+ video will be offered by Amazon Video later in 2017.

Dolby Vision

Dolby Vision is an HDR format from Dolby Laboratories that can be optionally supported by Ultra HD Blu-ray discs and streaming video services.[44][45] Dolby Vision is a proprietary format and Dolby SVP of Business Giles Baker has stated that the royalty cost for Dolby Vision is less than $3 per TV.[46][47][48] Dolby Vision includes the Perceptual Quantizer (SMPTE ST 2084) electro-optical transfer function, up to 4K resolution, and a wide-gamut color space (ITU-R Rec. 2020). The main two differences from HDR10 is that Dolby Vision has a 12-bit color depth and dynamic metadata. The colour depth allows up to 10,000-nit maximum brightness (mastered to 4,000-nit in practice).[49] It can encode mastering display colorimetry information using static metadata (SMPTE ST 2086) but also provide dynamic metadata (SMPTE ST 2094-10, Dolby format) for each scene.[27] Examples of Ultra HD (UHD) TVs that support Dolby Vision include LG, TCL, and Vizio,[50] although their displays are only capable of 10-bit color and 800 to 1000 nits luminance.[51][52][53]

Hybrid Log-Gamma

Hybrid Log-Gamma (HLG) is a HDR standard that was jointly developed by the BBC and NHK.[54] HLG defines a non-linear electro-optical transfer function (EOTF) in which the lower half of the signal values use a gamma curve and the upper half of the signal values use a logarithmic curve.[1][55] The HLG standard is royalty-free and is compatible with SDR displays.[54][56] HLG is supported by ATSC 3.0, Digital Video Broadcasting (DVB) UHD-1 Phase 2, HDMI 2.0b, HEVC, and VP9.[22][57][58][59][60] HLG is supported by video services such as Freeview Play and YouTube.[61][62]

SL-HDR1

SL-HDR1 is a HDR standard that was jointly developed by STMicroelectronics, Philips International B.V., CableLabs, and Technicolor R&D France.[63] It was standardised as ETSI TS 103 433 in August 2016. [64] SL-HDR1 provides direct backwards compatibility by using static and dynamic metadata (using SMPTE ST 2094-20 Philips and 2094-30 Technicolor formats) to reconstruct a HDR signal from a SDR video stream which can be delivered using SDR distribution networks and services already in place. SL-HDR1 allows for HDR rendering on HDR devices and SDR rendering on SDR devices using a single layer video stream.[64] The HDR reconstruction metadata can be added either to HEVC or AVC using a supplemental enhancement information (SEI) message.[64]

Guidelines and recommendations

ITU-R Rec. 2100

Rec. 2100 is a technical recommendation by ITU-R for production and distribution of HDR content using 1080p or UHD resolution, 10-bit or 12-bit color, HLG or PQ transfer functions, and wide color gamut using the Rec. 2020 color space.[33][34]

UHD Phase A

UHD Phase A are guidelines from the Ultra HD Forum for distribution of SDR and HDR content using Full HD 1080p and 4K UHD resolutions. It requires color depth of 10-bits per sample, a color gamut of Rec. 709 or Rec. 2020, a frame rate of up to 60 fps, a display resolution of 1080p or 2160p, and either standard dynamic range (SDR) or high dynamic range that uses Hybrid Log-Gamma (HLG) or Perceptual Quantizer (PQ) transfer functions.[65] UHD Phase A defines HDR as having a dynamic range of at least 13 stops (213=8192:1) and WCG as a color gamut that is wider than Rec. 709.[65] UHD Phase A consumer devices are compatible with HDR10 requirements and will be able to process Rec. 2020 color space and HLG or PQ at 10 bits.

History

The HEVC specification incorporates the Main 10 profile on their first version that supports 10 bits per sample.

On April 8, 2015, The HDMI Forum released version 2.0a of the HDMI Specification to enable transmission of HDR. The Specification references CEA-861.3, which in turn references the Perceptual Quantizer (PQ) which was standardized as SMPTE ST 2084.[20] The previous HDMI 2.0 version already supported the Rec. 2020 color space.

On June 24, 2015, Amazon Video was the first streaming service to offer HDR video using HDR10 Media Profile video.[66][67]

On November 17, 2015, Vudu announced that they had started offering titles in Dolby Vision.[68]

On March 1, 2016, the Blu-ray Disc Association released Ultra HD Blu-ray with mandatory support for HDR10 Media Profile video and optional support for Dolby Vision.[44][45]

On April 9, 2016, Netflix started offering both HDR10 Media Profile video and Dolby Vision.[69]

On July 6, 2016, the International Telecommunication Union (ITU) announced Rec. 2100 that defines two HDR transfer functions which are HLG and PQ.[33][34]

On July 29, 2016, SKY Perfect JSAT Group announced that on October 4 they will start the world's first 4K HDR broadcasts using HLG.[70]

On September 9, 2016, Google announced Android TV 7.0 which supports Dolby Vision, HDR10, and HLG.[58][71]

On September 26, 2016, Roku announced that the Roku Premiere+ and Roku Ultra will support HDR using HDR10.[72]

On November 7, 2016, Google announced that YouTube will start streaming HDR videos which can be encoded with HLG or PQ.[73][61]

On November 17, 2016, the Digital Video Broadcasting (DVB) Steering Board approved UHD-1 Phase 2 with a HDR solution which supports Hybrid Log-Gamma (HLG) and Perceptual Quantizer (PQ).[59][74] The specification has been published as DVB Bluebook A157 and will be published by the ETSI as TS 101 154 v2.3.1.[59][74]

On January 2, 2017, LG Electronics USA announced that all of LG’s SUPER UHD TV models now support a variety of HDR technologies, including Dolby Vision, HDR10, and HLG (Hybrid Log Gamma), and are ready to support Advanced HDR by Technicolor.

See also

References

  1. 1 2 3 4 T. Borer; A. Cotton. "A "Display Independent" High Dynamic Range Television System" (PDF). BBC. Retrieved 2015-11-01.
  2. ↑ "Device for increasing the dynamic range of a camera". espacenet.com.
  3. ↑ "Camera with very wide dynamic range".
  4. ↑ "Device for increasing the dynamic range of a camera". espacenet.com.
  5. ↑ Kang, Sing Bing; Uyttendaele, Matthew; Winder, Simon; Szeliski, Richard (2003). "ACM SIGGRAPH 2003 Papers – on SIGGRAPH '03". ch. High dynamic range video (pages 319–325). ISBN 1-58113-709-5. doi:10.1145/1201775.882270.
  6. ↑ https://www.red.com/
  7. ↑ http://www.arridigital.com
  8. ↑ Zimmerman, Steven (12 October 2016). "Sony IMX378: Comprehensive Breakdown of the Google Pixel’s Sensor and its Features". XDA Developers. Retrieved 17 October 2016.
  9. ↑ "ARRI Group: ALEXA´s Sensor". www.arri.com. Retrieved 2016-07-02.
  10. ↑ "HDR video accomplished using dual 5D Mark IIs, is exactly what it sounds like". Engadget.
  11. ↑ "A Real Time High Dynamic Range Light Probe".
  12. ↑ McGuire, Morgan; Matusik, Wojciech; Pfister, Hanspeter; Chen, Billy; Hughes, John; Nayar, Shree (2007). "Optical Splitting Trees for High-Precision Monocular Imaging". IEEE Computer Graphics and Applications. 27 (2): 32–42. PMID 17388201. doi:10.1109/MCG.2007.45.
  13. ↑ "Industrial Light & Magic Releases Proprietary Extended Dynamic Range Image File Format OpenEXR to Open Source Community" (PDF) (Press release). 2003-01-22.
  14. 1 2 "Main OpenEXR web site".
  15. ↑ Karol Myszkowski; Rafal Mantiuk; Grzegorz Krawczyk (2008). High Dynamic Range Video (First ed.). Morgan & Claypool. p. 8. ISBN 9781598292145.
  16. ↑ Ldr2Hdr: on-the-fly reverse tone mapping of legacy video and photographs. SIGGRAPH 2007 paper
  17. ↑ Steven Cohen (2016-07-27). "Samsung Releases HDR+ Firmware Update for 2016 SUHD TV Lineup". High-Def Digest. Retrieved 2016-08-07.
  18. ↑ Carolyn Giardina (2016-04-11). "NAB: Technicolor, Vubiquity to Unwrap HDR Up-Conversion and TV Distribution Service". The Hollywood Reporter. Retrieved 2016-08-10.
  19. 1 2 "ACES". Academy of Motion Picture Arts and Sciences. Retrieved 2016-07-29.
  20. 1 2 "HDMI 2.0a Spec Released, HDR Capability Added". Twice. April 8, 2015. Retrieved April 8, 2015.
  21. ↑ "VESA Updates Display Stream Compression Standard to Support New Applications and Richer Display Content". PRNewswire. 27 January 2016. Retrieved 29 January 2016.
  22. 1 2 "Introducing HDMI 2.0b". HDMI.org. Retrieved 2017-01-07.
  23. ↑ Ramus Larsen (2016-12-12). "HDMI 2.0b standard gets support for HLG HDR". flatpanelshd. Retrieved 2017-01-25.
  24. ↑ Andrew Cotton (2016-12-31). "2016 in Review - High Dynamic Range". BBC. Retrieved 2017-01-25.
  25. ↑ "HDMI Forum announces version 2.1 of the HDMI specification". HDMI.org. 2017-01-04. Retrieved 2017-01-10.
  26. ↑ "Philips HDR technology" (PDF). Philips. Retrieved 2017-01-10.
  27. 1 2 3 4 "SMPTE ST 2094 and Dynamic Metadata" (PDF). Society of Motion Picture and Television Engineers. Retrieved 2017-01-25.
  28. ↑ Adam Wilt (2014-02-20). "HPA Tech Retreat 2014 – Day 4". DV Info Net. Retrieved 2014-11-05.
  29. ↑ "ST 2084:2014". Society of Motion Picture and Television Engineers. Retrieved 2015-09-21.
  30. ↑ Chris Tribbey (2015-07-10). "HDR Special Report: SMPTE Standards Director: No HDR Format War, Yet". MESA. Retrieved 2015-09-21.
  31. ↑ Bryant Frazer (2015-06-09). "Colorist Stephen Nakamura on Grading Tomorrowland in HDR". studiodaily. Retrieved 2015-09-21.
  32. ↑ "End-to-end guidelines for phase A implementation". Ultra HD Forum. 2016-04-18. Retrieved 2016-04-18.
  33. 1 2 3 "BT.2100 : Image parameter values for high dynamic range television for use in production and international programme exchange". International Telecommunication Union. 2016-07-04. Retrieved 2016-07-04.
  34. 1 2 3 "ITU announces BT.2100 HDR TV standard". Rasmus Larsen. 2016-07-05. Retrieved 2016-07-26.
  35. ↑ Rachel Cericola (2015-08-27). "What Makes a TV HDR-Compatible? The CEA Sets Guidelines". Big Picture Big Sound. Retrieved 2015-09-21.
  36. ↑ Adrienne Maxwell (2016-05-02). "Dolby Vision vs. HDR10: What You Need to Know". hometheaterreview.com. Retrieved 2016-07-29.
  37. ↑ David Katzmaier (2016-08-10). "Vizio upgrades TVs to work with both HDR formats (hands-on)". CNET. Retrieved 2016-08-10.
  38. ↑ "Sony will wake a sleeping HDR beast via firmware. What else hides in PS4?". Ars Technica. Retrieved 8 September 2016.
  39. ↑ "Forza Horizon 3 uses the Xbox One S high dynamic range tech". Eurogamer. Retrieved June 15, 2016.
  40. ↑ "Samsung and Amazon Video Deliver Next Generation HDR Video Experience with Updated Open Standard HDR10+". Samsung. 2017-04-20. Retrieved 2017-04-20.
  41. ↑ Cho Mu-Hyun (2017-04-20). "Samsung, Amazon partner for HDR10 Plus". ZDNet. Retrieved 2017-04-20.
  42. ↑ John Archer (2017-04-20). "Samsung And Amazon Just Made The TV World Even More Confusing". Forbes. Retrieved 2017-04-20.
  43. ↑ John Laposky (2017-04-20). "Samsung, Amazon Video Team To Deliver Updated Open Standard HDR10+". Twice. Retrieved 2017-04-29.
  44. 1 2 Caleb Denison (2016-01-28). "Ultra HD Blu-ray arrives March 2016; here’s everything we know". Digital Trends. Retrieved 2016-07-27.
  45. 1 2 Michael S. Palmer (2016-02-10). "Hands On First Look: Samsung UBD-K8500 Ultra HD Blu-ray Player". High-Def Digest. Retrieved 2016-07-27.
  46. ↑ Tim Moynihan (2016-01-20). "What you need to know before buying an HDR TV". Wired (magazine). Retrieved 2017-01-26.
  47. ↑ Giles Baker (2016-09-20). "Dolby Vision and HDR10: What Format War?". LinkedIn. Retrieved 2017-01-26.
  48. ↑ Lee Neikirk (2016-09-09). "Dolby Says The "HDR Format War" Doesn't Exist". Reviewed.com. Retrieved 2017-01-26.
  49. ↑ Dolby Laboratories. "Dolby Vision" (PDF). Retrieved 2016-08-24.
  50. ↑ HD Report (2016-04-19). "How To Stream 4k Ultra HD with High Dynamic Range (HDR)". hd-report.com. Retrieved 2016-08-23.
  51. ↑ "LG SUPER UHD 4K TV - 200Hz HDR with Dolby Vision in 55 inch and 65 inch sizes. UH950T Series.". www.lg.com. Retrieved 2016-10-30.
  52. ↑ "Bargain brand TCL launches high-end TV with Dolby Vision HDR". CNET. Retrieved 2016-10-30.
  53. ↑ "Check out this VIZIO Reference Series 65" Class Ultra HD Full‑Array LED Smart TV". VIZIO. Retrieved 2016-10-30.
  54. 1 2 "High Dynamic Range" (PDF). European Broadcasting Union. Retrieved 2015-11-01.
  55. ↑ ARIB, Association of Radio Industries and Businesses (2015-07-03). "ARIB STD-B67" (PDF).
  56. ↑ "High Dynamic Range with Hybrid Log-Gamma" (PDF). BBC. Retrieved 2015-11-08.
  57. ↑ Rajan Joshi; Shan Liu; Gary Sullivan; Gerhard Tech; Jizheng Xu; Yan Ye (2015-09-05). "HEVC Screen Content Coding Draft Text 4". JCT-VC. Retrieved 2015-11-01.
  58. 1 2 "HDR Video Playback". Android. Retrieved 2016-09-23.
  59. 1 2 3 "DVB SB Approves UHD HDR Specification". Digital Video Broadcasting. 2016-11-17. Retrieved 2017-01-07.
  60. ↑ "ATSC Standard: Video" (PDF). Advanced Television Systems Committee. 2017-05-19. Retrieved 2017-05-19.
  61. 1 2 "Upload High Dynamic Range (HDR) videos". Google. Retrieved 2017-01-11.
  62. ↑ Julian Clover (2016-09-23). "Freeview updates for HEVC and Ultra HD". Broadband TV News. Retrieved 2016-09-23.
  63. ↑ "High-Performance Single Layer Directly Standard Dynamic Range (SDR) Compatible High Dynamic Range (HDR) System for use in Consumer Electronics devices (SL-HDR1)". ETSI. Retrieved 2016-11-02.
  64. 1 2 3 "ETSI Technical Specification TS 103 433 V1.1.1" (PDF). ETSI. 2016-08-03. Retrieved 2016-11-02.
  65. 1 2 "Ultra HD Forum: Phase A Guidelines" (PDF). Ultra HD Forum. 2016-07-15. Retrieved 2016-07-29.
  66. ↑ John Archer (2015-06-24). "Amazon Grabs Key Tech Advantage Over Netflix With World's First HDR Streaming Service". Forbes. Retrieved 2016-07-29.
  67. ↑ Kris Wouk (2015-06-24). "Amazon brings Dolby Vision TVs into the HDR fold with short list of titles". Digital Trends. Retrieved 2016-07-29.
  68. ↑ "Dolby and VUDU launch the future home theater experience with immersive sound and advanced imaging". Business Wire. 2015-11-17. Retrieved 2016-07-29.
  69. ↑ Rasmus Larsen (2016-04-09). "Netflix is now streaming in HDR / Dolby Vision". Digital Trends. Retrieved 2016-07-26.
  70. ↑ Colin Mann (2016-07-29). "4K HDR from SKY Perfect JSAT". Advanced Television. Retrieved 2016-07-30.
  71. ↑ Ramus Larsen (2016-09-07). "Android TV 7.0 supports Dolby Vision, HDR10 and HLG". flatpanelshd. Retrieved 2016-09-23.
  72. ↑ David Katzmaier (2016-09-26). "Roku unveils five new streaming boxes with prices as low as $30". CNET. Retrieved 2016-09-26.
  73. ↑ Steven Robertson (2016-11-07). "True colors: adding support for HDR videos on YouTube". Google. Retrieved 2017-01-11.
  74. 1 2 James Grover (2016-11-17). "UHD-1 Phase 2 approved". TVBEurope. Retrieved 2017-01-07.
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.