Skip to main content Accessibility help

We use cookies to distinguish you from other users and to provide you with a better experience on our websites. Close this message to accept cookies or find out how to manage your cookie settings.

Close cookie message
×
Hostname: page-component-76fb5796d-5g6vh Total loading time: 0 Render date: 2024-04-26T12:00:13.411Z Has data issue: false hasContentIssue false

6 - Image registration using mutual information

from PART II - Similarity Metrics for Image Registration

Published online by Cambridge University Press:  03 May 2011

By
Arlene A. Cole-Rhodes  and
Pramod K. Varshney
Edited by
Jacqueline Le Moigne ,
Nathan S. Netanyahu  and
Roger D. Eastman
Arlene A. Cole-Rhodes
Affiliation:
Morgan State University, Maryland
Pramod K. Varshney
Affiliation:
Syracuse University, New York
Jacqueline Le Moigne
Affiliation:
NASA-Goddard Space Flight Center
Nathan S. Netanyahu
Affiliation:
Bar-Ilan University, Israel and University of Maryland, College Park
Roger D. Eastman
Affiliation:
Loyola University Maryland
Get access

Summary

Abstract

This chapter provides an overview of the use of mutual information (MI) as a similarity measure for the registration of multisensor remote sensing images. MI has been known for some time to be effective for the registration of monomodal, as well as multimodal images in medical applications. However, its use in remote sensing applications has only been explored more recently. Like correlation, MI-based registration is an area-based method. It does not require any preprocessing, which allows the registration to be fully automated. The MI approach is based on principles of information theory. Specifically, it provides a measure of the amount of information that one variable contains about the other. In registration, we are concerned with maximizing the dependency of a pair of images. In this context, we discuss the computation of mutual information and various key issues concerning its evaluation and implementation. These issues include the estimation of the probability density function and computation of the joint histogram, normalization of MI, and use of different types of interpolation, search and optimization techniques for finding the parameters of the registration transformation (including multiresolution approaches).

Introduction

In this chapter, we discuss the application of mutual information (MI) as a similarity metric for cross-registering images produced by different imaging sensors. These images may be from different sources taken at different times and may be produced at different spectral frequencies and/or at different spatial resolutions.

Type
Chapter
Information
Image Registration for Remote Sensing , pp. 131 - 150
Publisher: Cambridge University Press
Print publication year: 2011

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Astola, J. and Virtanen, I. (1982). Entropy correlation coefficient, a measure of statistical dependence for categorized data. In Proceedings of the University of Vaasa, Discussion Papers, Finland, No. 44.Google Scholar
Brown, L. (1992), A survey of image registration techniques, ACM Computing Surveys, 24(4), 325–376.CrossRefGoogle Scholar
Camp, J. and Robb, R. (1999). A novel binning method for improved accuracy and speed of volume image coregistration using normalized mutual information. In Proceedings of the SPIE Conference on Medical Imaging: Image Processing, San Diego, CA, Vol. 3661, pp. 24–31.Google Scholar
Chen, H. M. and Varshney, P. K. (2000). A pyramid approach for multimodality image registration based on mutual information. In Proceedings of the Third International Conference on Information Fusion, Paris, France, Vol. 1, pp. MOD3/9–MOD315.Google Scholar
Chen, H. M. and Varshney, P. K. (2003). Mutual information based CT-MR brain image registration using generalized partial volume joint histogram estimation. IEEE Transactions on Medical Imaging, 22(9), 1111–1119.CrossRefGoogle ScholarPubMed
Chen, H. M. and Varshney, P. K. (2004). MI based registration of multi-sensor and multi-temporal images. In Varshney, P. K. and Arora, M. K., eds., Advanced Image Processing Techniques for Remotely Sensed Hyperspectral Data. New York: Springer-Verlag, pp. 181–198.CrossRefGoogle Scholar
Chen, H. M., Varshney, P. K., and Arora, M. K. (2003a). Performance of mutual information similarity registration of multitemporal remote sensing images. IEEE Transactions on Geoscience and Remote Sensing, 41(11), 2445–2454.CrossRefGoogle Scholar
Chen, H., Varshney, P. K., and Arora, M. K. (2003b). Mutual information based image registration for remote sensing data. International Journal of Remote Sensing, 24(18), 3701–3706.CrossRefGoogle Scholar
Chen, H. M., Varshney, P. K., and Arora, M. K. (2003c). A study of joint histogram estimation methods to register multi-sensor remote sensing images using mutual information. In Proceedings of the IEEE International Geoscience and Remote Sensing Symposium, Toulouse, France, Vol. 6, pp. 4035–4037.Google Scholar
Cole-Rhodes, A., Johnson, K., and Moigne, J. (2002). Multiresolution registration of remote sensing images using stochastic gradient. In Proceedings of the SPIE Conference on Wavelet and Independent Component Analysis Applications IX, Orlando, FL, Vol. 4738, pp. 44–55.CrossRefGoogle Scholar
Cole-Rhodes, A., Johnson, K., Moigne, J., and Zavorin, I. (2003). Multiresolution registration of remote sensing imagery by optimization of mutual information using a stochastic gradient. IEEE Transactions on Image Processing, 12(12), 1495–1511.CrossRefGoogle ScholarPubMed
Collignon, A., Maes, F., Delaere, D., Vandermeulen, D., Suetens, P., and Marchal, G. (1995a). Automated multimodality image registration based on information theory. In Proceedings of the 14th International Conference on Information Processing in Medical Imaging, Ile de Berder, France; Y. Bizais, C. Barillot, and R. Di Paula, eds. Dordrecht, The Netherlands: Kluwer Academic, pp. 263–274.Google Scholar
Collignon, A., Vandermeulen, D., Suetens P., and Marchal, G. (1995b). 3D multimodality medical image registration using feature space clustering. In Proceedings of the First International Conference on Computer Vision, Virtual Reality, and Robotics in Medicine, Nice, France; Lecture Notes in Computer Science, N. Ayache, ed. Berlin: Springer, Vol. 905, pp. 195–204.CrossRefGoogle Scholar
Cover, T. M. and Thomas, J. A. (1991). Elements of Information Theory. New York: Wiley.CrossRefGoogle Scholar
Hamza, A. B., He, Y., and Krim, H. (2001). An information divergence measure for ISAR image registration. In Proceedings of the IEEE Workshop on Statistical Signal Processing, Singapore, pp. 130–133.Google Scholar
He, Y., Hamza, A. B., and Krim, H. (2003). A generalized divergence measure for robust image registration. IEEE Transactions on Signal Processing, 51, 1211–1220.Google Scholar
Johnson, K., Cole-Rhodes, A., Zavorin, I., and Moigne, J. (2001). Mutual information as a similarity measure for remote sensing image registration. In Proceedings of the SPIE Conference on Geo-Spatial Image and Data Exploitation II, Orlando, FL, Vol. 4383, pp. 51–61.CrossRefGoogle Scholar
Knops, Z. F., Maintz, J. B. A., Viergever, M. A., and Pluim, J. P. W. (2003). Normalized mutual information based registration using K-means clustering based histogram binning. In Proceedings of the SPIE Conference on Medical Imaging, San Diego, CA, Vol. 5032, pp. 1072–1080.Google Scholar
Moigne, J. and Zavorin, I. (2000). Use of wavelets for image registration. In Proceedings of the SPIE Conference on Wavelet Applications VII, Orlando, FL, Vol. 4056, pp. 99–108.CrossRefGoogle Scholar
Moigne, J., Campbell, W. J., and Cromp, R. F. (2002). An automated parallel image registration technique of multiple source remote sensing data. IEEE Transactions on Geoscience and Remote Sensing, 40(8), 1849–1864.CrossRefGoogle Scholar
Moigne, J., Cole-Rhodes, A., Eastman, R., Johnson, K., Morisette, J., Netanyahu, N. S., Stone, H., and Zavorin, I. (2001). Multi-sensor registration of remotely sensed imagery. In Proceedings of the Eighth International Symposium on Remote Sensing, Vol. 4541, Toulouse, France.Google Scholar
Levenberg, K. (1944). A method for the solution of certain non-linear problems in least squares. The Journal of Applied Mathematics, 2, 164–168.Google Scholar
Maes, F., Collignon, A., Vandermeulen, D., Marchal, G., and Suetens, P. (1997). Multimodality image registration by maximization of mutual information. IEEE Transactions on Medical Imaging, 16(2), 187–198.CrossRefGoogle ScholarPubMed
Maes, F., Vandermeulen, D., and Suetens, P. (2003). Medical image registration using mutual information. Proceedings of the IEEE, 91(10), 1699–1722.CrossRefGoogle Scholar
Marquardt, D. (1963). An algorithm for least-squares estimation of nonlinear parameters. SIAM Journal on Applied Mathematics, 11, 431–441.CrossRefGoogle Scholar
Nelder, J. A. and Mead, R. (1965). A simplex method for function minimization. The Computer Journal, 7(4), 308–313.CrossRefGoogle Scholar
Pluim, J. P., Maintz, J. B., and Viergever, M. A. (2000). Interpolation artefacts in mutual information-based registration. Computer Vision and Image Understanding, 77(11), 211–232.CrossRefGoogle Scholar
Pluim, J. P., Maintz, J. B., and Viergever, M. A. (2003). Mutual information-based registration of medical images: A survey. IEEE Transactions on Medical Imaging, 22(8), 986–1004.CrossRefGoogle ScholarPubMed
Powell, M. J. D. (1964). An efficient method for finding the minimum of a function of several variables without calculating derivatives. The Computer Journal, 7(2), 155–162.CrossRefGoogle Scholar
Rodriguez-Carranza, C. E. and Loew, M. H. (1998). A weighted and deterministic entropy measure for image registration using mutual information. In Proceedings of the SPIE Conference on Image Processing, San Diego, CA, Vol. 3338, pp. 155–166.Google Scholar
Simoncelli, E., Freeman, W., Adelson, E., and Heeger, D. (1992). Shiftable multiscale transforms. IEEE Transactions on Information Theory, 38(2), 587–607.CrossRefGoogle Scholar
Spall, J. C. (1992). Multivariate stochastic approximation using a simultaneous perturbation gradient approximation. IEEE Transactions on Automatic Control, 37(3), 332–341.CrossRefGoogle Scholar
Studholme, C., Hill, D. L., and Hawkes, D. J. (1995). Automated 3D registration of truncated MR and CT images of the head. In Proceedings of the Sixth British Machine Vision Conference, Birmingham, UK, pp. 27–36.Google Scholar
Studholme, C., Hill, D., and Hawkes, D. (1999). An overlap invariant entropy measure of 3D medical image alignment. Pattern Recognition, 32(1), 71–86.CrossRefGoogle Scholar
Thévenaz, P., and Unser, M. (2000). Optimization of mutual information for multiresolution image registration. IEEE Transactions on Image Processing, 9(12), 2083–2099.Google ScholarPubMed
Thévenaz, P., Ruttimann, U. E., and Unser, M. (1998). A pyramid approach to subpixel registration based on intensity. IEEE Transactions on Image Processing, 7(1), 27–41.CrossRefGoogle ScholarPubMed
Tsao, J. (2003). Interpolation artifacts in multimodality image registration based on maximization of mutual information. IEEE Transactions on Medical Imaging, 22(7), 845–846.Google ScholarPubMed
Unser, M., Aldroubi, A., and Eden, M. (1993). B-spline signal processing: Part 1. Theory. IEEE Transactions on Signal Processing, 41(2), 821–833.CrossRefGoogle Scholar
Viola, P. and Wells, W. M., III (1995). Alignment by maximization of mutual information. In Proceedings of the Fifth IEEE International Conference on ComputerVision, Cambridge, MA, pp. 16–23.CrossRefGoogle Scholar
Zavorin, I., Stone, H., and Moigne, J. (2002). Iterative pyramid-based approach to subpixel registration of multisensor satellite imagery. In Proceedings of the SPIE Conference on Earth Observing Systems VII, Seattle, WA, Vol. 4814, pp. 435–446.CrossRefGoogle Scholar
Zhu, Y. and Cochoff, S. (2002). Influence of implementation parameters on registration of MR and SPECT brain images by maximization of mutual information. Journal of Nuclear Medicine, 43(2), 160–166.Google ScholarPubMed
Zitová, B., and Flusser, J. (2003). Image registration methods: A survey. Image and Vision Computing, 21, 977–1000.CrossRefGoogle Scholar

Save book to Kindle

To save this book to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×