Skip to main content Accessibility help
×
Home
  • Print publication year: 2014
  • Online publication date: June 2014

3 - Hybrid-imaging for motion deblurring

Summary

Introduction

This chapter introduces a hybrid-imaging system for motion deblurring, which is an imaging system that couples two or more cameras that function differently to perform a unified task. The cameras are usually selected to have different specialized functions. For example, a hybrid stereo camera presented by Sawhney et al. (Sawhney, Guo, Hanna, Kumar, Adkins & Zhou 2001) utilizes two cameras with different spatial resolutions to obtain high resolution stereo output.

In the context of this chapter, a hybrid-imaging system refers to a standard high resolution camera, which we call the primary detector with an auxiliary low resolution camera called the secondary detector. The secondary detector shares a common optical path with the primary detector, but operates at a significantly higher frame rate.

The primary detector produces a high resolution, high quality colour image but is susceptible to motion blur, whereas the secondary detector output is a sequence of low resolution, often monochromatic and noisy images of the same scene taken during the exposure time of the primary detector. An example of the primary and secondary detectors' output is shown in Figure 3.1.

The image sequence produced by the secondary detector is of little visual use. However, it contains information about the motion of the camera during the exposure, or more precisely, the motion flow field of the image during integration time. While the camera motion and the observed flow field are not identical (e.g. the observed flow field includes information about moving objects in the scene as well as their depth), the idea of hybrid-imaging motion deblurring is that given the image sequence from the secondary detector, it would be possible to compute the blur function (or the PSF) at every point of the high resolution image taken by the primary detector.

Ben-Ezra, M. & Nayar, S. (2004). Motion-based Motion Deblurring. IEEE Transactions on Pattern Analysis and Machine Intelligence, 26(6), 689–98.
Bioucas-Dias, J., Figueiredo, M. & Oliveira, J. (2006 a). Adaptive total-variation image deconvolution: A majorization-minimization approach. In Proceedings of the European Signal Processing Conference, pp. 1-4.
Bioucas-Dias, J., Figueiredo, M. & Oliveira, J. (2006 b). Total variation-based image deconvolution: a majorization-minimization approach. In IEEE International Conference on Acoustics, Speech and Signal Processing, Vol. 2, p. 11.
Chuang, Y., Curless, B., Salesin, D. H. & Szeliski, R. (2001). A Bayesian approach to digital matting. In IEEE Conference on Computer Vision and Pattern Recognition, pp. 264–71.
Dey, N., Blanc-Feraud, L., Zimmer, C., Roux, P., Kam, Z., Olivo-Marin, J. & Zerubia, J. (2006). Richardson-Lucy algorithm with total variation regularization for 3D confocal microscope deconvolution, Microscopy Research and Technique, 69(4), 260–6.
Fergus, R., Singh, B., Hertzmann, A., Roweis, S. T. & Freeman, W. T. (2006). Removing camera shake from a single photograph. ACM Transactions on Graphics, 25(3), pp. 787–94.
Jansson, P. A. (1997). Deconvolution of Image and Spectra, 2nd edn. Academic Press.
Joshi, N., Szeliski, R. & Kriegman, D. (2008). PSF estimation using sharp edge prediction. In IEEE Conference on Computer Vision and Pattern Recognition, pp. 1-8.
Krishnan, D. & Fergus, R. (2009). Fast image deconvolution using hyper-Laplacian priors. Advances in Neural Information Processing Systems, 22, 1-9.
Lauer, T. (2002). Deconvolution with a spatially-variant PSF. In SPIE Proceedings, Astronomical Data Analysis II, Vol. 4847, pp. 167–73.
Levin, A., Fergus, R., Durand, F. & Freeman, W. (2007). Deconvolution using natural image priors. Massachusetts Institute of Techmology, Computer Science and Artificial Intelligence Laboratory.
Lin, H., Tai, Y.-W. & Brown, M. S. (2011). Motion regularization for matting motion blurred objects. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33(11), 2329–36.
Lucas, B. & Kanade, T. (1981). An iterative image registration technique with an application to stereo vision. In Proceedings of the Defense Advanced Research Projects Agemy, pp. 121–30.
Sawhney, H., Guo, Y., Hanna, K., Kumar, R., Adkins, S. & Zhou, S. (2001). Hybrid stereo camera: an IBR approach for synthesis of very high resolution stereoscopic image sequences. In ACM Proceedings of the 28 th Annual Conference on Computer Graphics and Interactive Techniques, pp. 451–60.
Shan, Q., Xiong, W. & Jia, J. (2007). Rotational motion deblurring of a rigid object from a single image. In IEEE International Conference on Computer Vision, pp. 1-8.
Tai, Y., Du, H., Brown, M. & Lin, S. (2010). Correction of spatially varying image and video blur using a hybrid camera. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(6), 1012–28.
Wiener, N. (1964). Extrapolation, Interpolation, and Smoothing of Stationary Time Series. MIT Press.
Yuan, L., Sun, J., Quan, L. & Shum, H. (2007). Image deblurring with blurred/noisy image pairs. ACM Transactions on Graphics, 26(3), 1:1–10.