Skip to main content Accessibility help
×
Home

The technology behind the exceptional visual experience via high dynamic range

  • Neeraj J. Gadgil (a1), Qing Song (a1), Guan-Ming Su (a1) and Samir N. Hulyalkar (a1)

Abstract

High dynamic range (HDR) technology is rapidly changing today's video landscape by offering spectacular visual experiences. The development in display technology to support higher luminance levels for commercial and consumer electronic devices such as TVs, smartphones, projectors etc., has created an exponential demand for delivering HDR content to viewers. The essential component of the HDR technology is “expanded contrast,” which allows richer black levels and enhanced brightness, providing dramatic contrast that reveals finer details. The use of “wide color gamut” allows wider color spectrum and richer colors providing aesthetically pleasing true-to-life feel. Such visual enhancements clearly establish HDR as one of the most significant upcoming video technologies.

In this paper, we review major technical advances in this exciting field of study. Quantization of HDR signals is reviewed in the context of transfer functions that convert optical signals to electrical signals and vice versa. They mainly consist of Perceptual Quantization and Hybrid-Log-Gamma approaches. Compression of HDR content is another broad area of study involving several coding approaches, often categorized in terms of backward-compatibility and single/dual layer methods. Some key industry applications of HDR processing systems are also discussed, followed by some future directions of HDR technology.

  • View HTML
    • Send article to Kindle

      To send this article to your Kindle, first ensure no-reply@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle. Find out more about sending to your Kindle.

      Note you can select to send to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

      Find out more about the Kindle Personal Document Service.

      The technology behind the exceptional visual experience via high dynamic range
      Available formats
      ×

      Send article to Dropbox

      To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Dropbox.

      The technology behind the exceptional visual experience via high dynamic range
      Available formats
      ×

      Send article to Google Drive

      To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Google Drive.

      The technology behind the exceptional visual experience via high dynamic range
      Available formats
      ×

Copyright

This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.

Corresponding author

Corresponding author: Neeraj J. Gadgil Email: Neeraj.Gadgil@dolby.com

References

Hide All
1Poynton, C.: Digital Video and HDTV: Algorithms and Interfaces. Elsevier, Waltham, MA, 2012.
2Dolby Vision white paper. Dolby Laboratories Inc., URL: https://www.dolby.com/us/en/technologies/dolby-vision/dolby-vision-whitepaper.pdf.
3Borer, T.; Cotton, A.: A “Display Independent” high dynamic range television system. Research & Development White Paper-WHP 309, British Broadcasting Corporation, September 2015.
4HDR demystified: Emerging UHDTV systems, Technical Paper, SpectraCal Inc., vol. 1, March 2016.
5Barten, P.G.J.: Contrast sensitivity of the human eye and its effects on image quality. SPIE Optical Engineering Press, Bellingham, WA, 1999.
6Konstantinides, K.; Su, G.M.; Gadgil, N.: High dynamic range video coding, in Bhattacharyya, S., Deprettere, E., Leupers, R., Takala, J.: Eds, Handbook of Signal Processing Systems, Springer, Cham, 2019.
7Wiegand, T.; Sullivan, G.J.; Bjontegaard, G.; Luthra, A.: Overview of the H.264/AVC video coding standard. IEEE Trans. Circuits Syst. Video Technol., 13 (7) (2003), 560576.
8Sullivan, G.J.; Ohm, J.R.; Han, W.J.; Wiegand, T.: Overview of the high efficiency video coding (HEVC) standard. IEEE Trans. Circuits Syst. Video Technol., 22 (12) (2012), 16491668.
9Gish, W.; Miller, S.: Unambiguous video pipeline description motivated by HDR, in 2016 IEEE Int. Conf. on Image Processing (ICIP), Phoenix, AZ, September 2016, 909–912.
10ITU-R BT.1886, Reference electro-optical transfer function for flat panel displays used in HDTV studio production, Int. Telecommunication Union, Radiocommunication Sector, 2011.
11ITU-R BT.709, Parameter values for the HDTV standards for production and international program exchange, Int. Telecommunication Union, Radiocommunication Sector, 2002.
12Miller, S.; Nezamabadi, M.; Daly, S.: Perceptual signal coding for more efficient usage of bit codes. SMPTE Mot. Imag. J., 122 (4) (2013), 5259.
13SMPTE ST-2084, High dynamic range electro-optical transfer function of mastering reference display. The Society of motion picture and television engineers, 2014.
14ARIB STD-B67, Essential parameter values for the extended imaged image dynamic range television (EIDRTV) system for programme production. Association of Radio Industries and Businesses (ARIB), 2015.
15ITU-R BT.2100-2, Image parameter values for high dynamic range television for use in production and international programme exchage. Int. Telecommunication Union, 2018.
16ITU-R BT.601, Studio encoding parameters of digital television for standard 4: 3 and wide-screen 16: 9 aspect ratios. Int. Telecommunication Union, Radiocommunication Sector, 1990.
17SMPTE-EG-0432-1:2010, Digital source processing - color processing for D-Cinema. The Society of motion picture and television engineers.
18ITU-R BT.2020, Parameter values for ultra-high definition television systems for production and international programme exchange. Int. Telecommunication Union (ITU), 2015.
19Berns, R.S. et al. : Billmeyer and Saltzman's Principles of Color Technology. Wiley, New York, 2000.
20Perrin, A.; Rerabek, M.; Husak, W.; Ebrahimi, T.: ICtCp versus Y'CbCr: Evaluation of ICtCp color space and an adaptive reshaper for HDR and WCG. IEEE Consum. Electron Mag., 7 (3) (2018), 3847.
21Ebner, F.; Fairchild, M.D.: Development and testing of a color space (IPT) with improved hue uniformity, in Color and Imaging Conference, vol. 1998 (1). Society for Imaging Science and Technology, 1998, 8–13.
22Mantiuk, R.; Efremov, A.; Myszkowski, K.; Seidel, H.-P.: Backward compatible high dynamic range MPEG video compression. ACM Trans. Graph., 25 (2006), 713723.
23Mai, Z.; Mansour, H.; Mantiuk, R.; Nasiopoulos, P.; Ward, R.; Heidrich, W.: Optimizing a tone curve for backward-compatible high dynamic range image and video compression. IEEE Trans. Image Process., 20 (6) (2011), 15581571.
24Su, G.-M.; Atkins, R.; Chen, Q.: Backward-compatible coding for ultra high definition video signals with enhanced dynamic range. US Patent 9,549,207, January 2017.
25Chen, Q.; Su, G.-M.; Yin, P.: Near constant-time optimal piecewise LDR to HDR inverse tone mapping. Proc. SPIE, 9404 (2015), 9404.1–11.
26Su, G.-M.; Qu, S.; Hulyalkar, S.N.; Chen, T.; Gish, W.C.; Koepfer, H.: Layer decomposition in hierarchical VDR coding. US Patent 9,497,456 B2, November 2012.
27François, E.; Taquet, J.: AHG18: On 16-bits support for range extensions, in JCTVC-N0142, 14th JCT-VC Meeting, Vienna, Austria, July–August 2013.
28Kim, W.-S.; Pu, W.; Chen, J.; Wang, Y.-K.; Sole, J.; Karczewicz, M.: AhG 5 and 18: High bit-depth coding using auxiliary picture, in JCTVC-O0090, 15th JCT-VC Meeting, October–November 2013.
29Aminlou, A.; Ugur, K.: On 16-bit coding, in JCTVC-P0162, 16th JCT-VC Meeting, January 2014.
30Auyeung, C.; Xu, J.: AhG 5 and 18: Coding of high bit-depth source with lower bit-depth encoders and a continuity mapping, in JCTVC-P0173, 16th JCT-VC Meeting, January 2014.
31ITU Rec. H.265, High efficiency video coding. Series H: Audiovisual and multimedia systems, infrastructure of audiovisual services - coding of moving video, December 2016.
32Ström, J., et al. : High quality HDR video compression using HEVC main 10 profile, in 2016 Picture Coding Symp., December 2016, 1–5.
33Lu, T.; Yin, P.; Chen, T.; Su, G.-M.: Rate control adaptation for high dynamic range images. U.S. Patent Application Publication US 2016/0134870, 2016.
34Lu, T., et al. : Compression efficiency improvement over HEVC main 10 profile for HDR and WCG content, in 2016 Data Compression Conf., March 2016, 279–288.
35Wong, C.-W.; Su, G.-M.; Wu, M.: Joint baseband signal quantization and transform coding for high dynamic range video. IEEE Signal Processing Letters, vol. abs/1603.02980, 2016.
36Ström, J.; Samuelsson, J.; Dovstam, K.: Luma adjustment for high dynamic range video, in 2016 Data Compression Conf., March 2016, 319–328.
37Lu, T., et al. : ITP colour space and its compression performance for high dynamic range and wide colour gamut video distribution. ZTE Communications, special issue on Recent Progresses on Multimedia Coding, Analysis and Transmission, no. 1, 2016.
38Kadu, H.; Song, Q.; Su, G.: Single layer progressive coding for high dynamic range videos, in 2018 Picture Coding Symp. (PCS), June 2018, 86–90.
39François, E.; van de Kerkhof, L.: A single-layer HDR video coding framework with SDR compatibility. SMPTE Mot. Imag. J., 126 (3) (2017), 1622.
40Luthra, A.; François, E.; van de Kerkhof, L.: Report of HDR core experiment 7 on investigating the visual quality of HLG generated HDR and SDR video, in JCTVC-W0027, 23rd JCT-VC Meeting, February 2016.
41Pindoria, M.; Naccari, M.; Borer, T.; Cotton, A.: Some considerations on Hue shifts observed in HLG backward compatible video, in JCTVC-W0119, 23rd JCT-VC Meeting, February 2016.
42Holm, J.: HLG issues, in JCTVC-W0132, 23rd JCT-VC Meeting, February 2016.
43Blu-Ray Disc Read-Only format, Audio Visual Application Format Specifications for BD-874 ROM Version 3.1. White Paper, Blu-Ray Disc Association, August 2016.
44Working with wide color gamut and high dynamic range in Final Cut Pro X: New workflows for editing. White Paper, Apple Inc., December 2017.
45High dynamic range (HDR) on Intel Graphics. Revision 1.0, Technical White Paper, Intel Inc., November 2017.
46Chen, Q.; Su, G.-m.; Peng, Y.: Spatial adaptive upsampling filter for HDR image based on multiple luminance range, in Digital Photography X, vol. 9023. International Society for Optics and Photonics, 2014, p. 902311.
47Talebi, H.; Su, G.-M.; Yin, P.: Fast HDR image upscaling using locally adapted linear filters, in Digital Photography XI, vol. 9404. Int. Society for Optics and Photonics, 2015, p. 94040H.
48Wen, B.; Su, G.-M.: TransIm: Transfer image local statistics across EOTFs for HDR image applications, in To appear, IEEE Int. Conf. on Multimedia & Expo, July 2018.
49Song, Q.; Su, G.-M.; Cosman, P.C.: Hardware-efficient debanding and visual enhancement filter for inverse tone mapped high dynamic range images and videos, in Image Processing (ICIP), 2016 IEEE Int. Conf. on IEEE, 2016, 3299–3303.
50Su, G.-M.; Chen, Q.; Lee, B.; Daly, S.: Pre-dithering in high dynamic range video coding. US Patent 15/035,551, October 2016.
51Mukherjee, S.; Su, G.-M.; Cheng, I.: Adaptive dithering using Curved Markov-Gaussian noise in the quantized domain for mapping SDR to HDR image, in To appear, Int. Conf. on Smart Multimedia, August 2018.
52SMPTE ST 2094-1:2016, Dynamic metadata for color volume transform - core components. May 2016.
53SMPTE ST 2094-10:2016, Dynamic metadata for color volume transform - application #1. May 2016.
54Su, Y.; Chung, C.Y.; Wu, H.-J.; Zhai, J.; Zhang, K.; Xiaosong, Z.: Techniques in backwards compatible multi-layer compression of hdr video. US Patent 10/021,411, July 2018.
55Gupta, M.; Mitsunaga, T.; Iso, D.; Nayar, S.K.: Methods, systems, and media for high dynamic range imaging. US Patent 9,648,248, May 2017.
56Ciurea, F.; Venkataraman, K.: Systems and methods for high dynamic range imaging using array cameras. US Patent 9,774,789, September 2017.
57Kalantari, N.K.; Ramamoorthi, R.: Deep high dynamic range imaging of dynamic scenes. ACM Trans. Graph, 36 (4) (2017), 144.
58Eilertsen, G.; Kronander, J.; Denes, G.; Mantiuk, R.K.; Unger, J.: HDR image reconstruction from a single exposure using deep CNNs. ACM Trans. Graph. (TOG), 36 (6) (2017), 178.

Keywords

Metrics

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed