Hostname: page-component-848d4c4894-4rdrl Total loading time: 0 Render date: 2024-07-04T13:02:31.307Z Has data issue: false hasContentIssue false
  • English
  • Français

A Nonlocal Total Variation Model for Image Decomposition: Illumination and Reflectance

Published online by Cambridge University Press:  28 May 2015

Wei Wang  and
Michael K. Ng
Wei Wang*
Affiliation:
Department of Mathematics, Tongji University, Shanghai, China
Michael K. Ng*
Affiliation:
Department of Mathematics, Hong Kong Baptist University, Kowloon Tong, Hong Kong
*
Corresponding author.Email address:wangw@tongji.edu.cn
Corresponding author.Email address:mng@math.hkbu.edu.hk
Get access

Abstract

In this paper, we study to use nonlocal bounded variation (NLBV) techniques to decompose an image intensity into the illumination and reflectance components. By considering spatial smoothness of the illumination component and nonlocal total variation (NLTV) of the reflectance component in the decomposition framework, an energy functional is constructed. We establish the theoretical results of the space of NLBV functions such as lower semicontinuity, approximation and compactness. These essential properties of NLBV functions are important tools to show the existence of solution of the proposed energy functional. Experimental results on both grey-level and color images are shown to illustrate the usefulness of the nonlocal total variation image decomposition model, and demonstrate the performance of the proposed method is better than the other testing methods.

Keywords

68U1065K0565N21Image decompositionilluminationreflectancenonlocal total variationiterative method
Type
Research Article
Information
Numerical Mathematics: Theory, Methods and Applications , Volume 7 , Issue 3 , August 2014 , pp. 334 - 355
Copyright
Copyright © Global Science Press Limited 2014

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

[1]Bertalmío, M., Caselles, V., and Provenzi, E., “Issues about Retinex Theory and Contrast Enhancement,” Int. J. Comput. Vis., vol. 83, no. 1, pp. 101–119, 2009.CrossRefGoogle Scholar
[2]Palma-Amestoy, R.Provenzi, E., Bertalmío, M., and Caselles, V., “A Perceptually Inspired Variational Framework for Color Enhancement,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 3, pp. 458–474, 2009.CrossRefGoogle Scholar
[3]Funt, B., Drew, M., and Brockington, M., “Recovering shading from color images,” in Lecture Notes in Computer Science: Computer Vision, ECCV92, vol. 588 Sandini, G., Ed. Berlin, Germany: Springer-Verlag, 1992, pp. 124132.Google Scholar
[4]Limare, N., Morel, J. M., Petro, A. and Sbert, C., “Retinex Poisson Equation: a Model for Color Perception,” Image Processing On Line, 2011. http://dx.doi.org/10.5201/ipol.2011.lmps_rpe.CrossRefGoogle Scholar
[5]Kimmel, R., Shaked, D., Elad, M., Keshet, R., and Sobel, I., “A Variational Framework for Retinex,” International Journal of Computer Vision, vol. 52, pp. 7–23, 2004.CrossRefGoogle Scholar
[6]Land, E. H., and McCann, J. J., “Lightness and Retinex Theory,” J.Opt. Soc. Am., vol. 61, pp. 1–11, 1971.CrossRefGoogle ScholarPubMed
[7]McCann, J. J., Parraman, C and Rizzi, A., “Pixel and Spatial Mechanisms of Color Constancy,” IS&T/SPIE Electronic Imaging 2010, San Jose (California, USA), 17–21, January 2010.Google Scholar
[8]Land, E. H., “The Retinex Theory of Color Vision,” Sci. Amer., vol. 237, pp. 108–128, 1977.CrossRefGoogle ScholarPubMed
[9]Land, E. H., “Recent Advances in the Retinex Theory and Some Implications for Cortical Computations: Color Vision and Natural Image,” proc. Nat. Acad. Sci. USA, vol. 80, pp. 5163–5169, 1983.CrossRefGoogle ScholarPubMed
[10]Frankle, J. and McCann, J., “Method and Apparatus for Lightness Imaging,” U.S. Patent 4384336, May 17, 1983.Google Scholar
[11]McCann, J., “Lesson Learned from Mondrians Applied to Real Images and Color Gamuts,” in Proc. IST/SID 7th Color Imag. Conf., pp. 1–8, 1999.Google Scholar
[12]Funt, B., Ciurea, F., and McCann, J., “Retinex in Matlab,” J.Electron. Imag., vol. 13, no. 1, pp. 48–57, 2004.CrossRefGoogle Scholar
[13]McCann, J. J., and Sobel, I., “Experiments with Retinex,” HPL Color Summit, 1998.Google Scholar
[14]Bertalmío, M. and Cowan, J., “Implementing the Retinex Algorithm with Wilson-Cowan Equations,” J. Physiol., vol. 103, pp. 69–72, 2009.Google ScholarPubMed
[15]Horn, B. K. P., “Determining Lightness from an Image,” Computer Graphics and Image Processing, vol. 3, pp. 277–299, 1974.CrossRefGoogle Scholar
[16]Blake, A., “Boundary Conditions of Lightness Computation in Mondrain World,” Computer Vision Graphics and Image Processing, vol. 32, pp. 314–327, 1985.CrossRefGoogle Scholar
[17]Terzopoulos, D., “Image Analysis Using Multigrid Relaxation method,” IEEE Trans. on PAMI, vol. 8, pp. 129–139, 1986.CrossRefGoogle Scholar
[18]Morel, J. M., Petro, A. B., and Sbert, C., “Fast Implementation of Color Constancy Algorithms,” Proc. SPIE, vol. 7241|724106, 2009. DOI:10.1117/12.805474.CrossRefGoogle Scholar
[19]Morel, J. M., Petro, A. B., and Sbert, C., “A PDE Formalization of Retinex Theory,” IEEE Transactions on Image Processing, vol. 19, no. 11, pp. 2825–2837, 2010.CrossRefGoogle ScholarPubMed
[20] Elad, Michael, “Retinex by Two Bilateral Filters,” Scale Space and PDE Methods in Computer Vision, vol. 3459, pp. 217–229, 2005.CrossRefGoogle Scholar
[21]Ma, W., and Osher, S., “A TV Bregman Iterative Model of Retinex Theory,” Inverse Problems and Imaging, vol. 6, No. 4, pp. 697–708, 2012.CrossRefGoogle Scholar
[22]Ma, W., Morel, J. M., Osher, S. and Chien, A., “An L1-based Variational Model for Retinex Theory and Its Applications to Medical Images,” Computer Vision and Pattern Recognition (CVPR), IEEE Conference on., pp. 153–160, 2011.Google Scholar
[23]Zosso, D., Tran, G., and Osher, S., “A unifying Retinex model based on non-local differential operators,” Proc. SPIE 8657, Computational Imaging XI, 865702, 2013.Google Scholar
[24]Ng, M. and Wang, W., “A total variation model for Retinex,” SIAM Journal on Imaging Sciences, vol. 4, no. 1, pp. 345–365, 2011.CrossRefGoogle Scholar
[25]Ambrosio, L., Fusco, N., and Pallara, D., “Functions of Bounded Variation and Free Discontinuity Problems,” Oxford Mathematical Monographs. Oxford University Press, March 2000.Google Scholar
[26]Rudin, L., Osher, S., and Fatemi, E., “Nonlinear total variation based noise removal algorithms,” Physica D, vol. 60, pp. 259–268, 1992.CrossRefGoogle Scholar
[27]Yaroslavsky, L. P., “Digital picture processing,” An introduction., Springer Verlag, 1985.CrossRefGoogle Scholar
[28]Smith, S. M. and Brady, J. M., “SUSAN-a new approach to low level image processing,” Int. Journal of Computer Vision, vol. 23, pp. 45–78, 1997.CrossRefGoogle Scholar
[29]Tomasi, C. and Manduchi, R., “Bilateral filtering for gray and color images,” in ICCV, Bombay, pp.839–846, 1998.Google Scholar
[30]Buades, A., Coll, B., Morel, J. M., and Sbert, C., “Non local demosaicing,” In: Proceedings of the 2008 International Workshop on Local and Non-Local Approximation in Image Processing (LNLA08). Lausanne, Suisse.Google Scholar
[31]Protter, M., Elad, M., Takeda, H., Milanfar, P., “Generalizing the Non-Local-Means to superresolution reconstruction,” IEEE TIP, vol. 18, no. 1, pp. 36–51, 2009.Google Scholar
[32]Kindermann, S., Osher, S., and Jones, P. W., “Deblurring and denoising of images by nonlocal functionals,” SIAM MMS, vol. 4, no. 4, pp.1091–1115, 2005.CrossRefGoogle Scholar
[33]Gilboa, G., and Osher, S., “Nonlocal linear image regularization and supervised segmentation,” SIAM MMS, vol. 6, no. 2, pp.595–630, 2007.CrossRefGoogle Scholar
[34]Gilboa, G., and Osher, S., “Nonlocal operators with applications to image processing,” SIAM MMS, vol.7, no. 3, pp.1005–1028, 2008.CrossRefGoogle Scholar
[35]Lou, Y., Zhang, X., Osher, S., and Bertozzi, A., “Image recovery via nonlocal operators,” Journal of Scientific Computing, vol. 42, pp.185–197, 2010.CrossRefGoogle Scholar
[36]Peyré, G., Bougleux, S., and Cohen, L., “Non-local regularization of inverse problems,” ECCV, Part III, LNCS 5304: 57–68, 2008.Google Scholar
[37]Zhang, X., Burger, M., Bresson, X., and Osher, S., “Bregmanized Nonlocal Regularization for Deconvolution and Sparse Reconstruction,” SIAM J.Imaging Sci., vol. 3, no. 3, pp.253–276, 2010.CrossRefGoogle Scholar
[38]Kindermann, S., Osher, S. and Jones, P., “Deblurring and denoising of images by nonlocal functionals,” SIAM Mutiscale Modeling and Simulation, vol.4, no. 4, pp.1091–1115, 2005.CrossRefGoogle Scholar
[39]Goldstein, T. and Osher, S., “The Split Bregman Method for L1-Regularized Problems,” SIAM Journal on Imaging Sciences, vol. 2, No. 2, PP.323–343, 2009.CrossRefGoogle Scholar
[40]Sled, J. G., Zijdenbos, A. P., and Evans, A. C., “A nonparametric method for automatic correction of intensity nonuniformity in MRI data,” IEEE Transactions on Medical Imaging, vol. 17, no. 1, pp.87–97, 1998.CrossRefGoogle ScholarPubMed
[41]Zhang, X. and Wandell, B. A., “A Spatial Extension of CIELAB for Digital Color Image Reproduction,” SID Digest, pp.731–734, 1996.Google Scholar