Hostname: page-component-cd9895bd7-q99xh Total loading time: 0 Render date: 2024-12-14T18:32:35.110Z Has data issue: false hasContentIssue false

Comparing shape descriptor methods for different color space and lighting conditions

Published online by Cambridge University Press:  04 December 2019

Abhishek Mukhopadhyay*
Affiliation:
Indian Institute of Science, Centre for Product Design and Manufacturing, Bengaluru, India
Imon Mukherjee
Affiliation:
Indian Institute of Information Technology, Kalyani, Computer Science and Engineering, Nadia, West Bengal, India
Pradipta Biswas
Affiliation:
Indian Institute of Science, Centre for Product Design and Manufacturing, Bengaluru, India
*
Author for correspondence: Abhishek Mukhopadhyay, E-mail: abhishek.gmit@gmail.com

Abstract

Detecting and recognizing objects is one of the most important uses of vision systems in nature and is consequently highly evolved. This paper aims to accurately detect an object using its shape and color information from a complex background. In particular, we evaluated our algorithm to detect 19 different integrated circuits (IC) from 10 different printed circuit boards (PCB) of different colors. We have compared three different shape descriptors for four different color space models. We have evaluated shape detection algorithms in different lighting conditions (indoor, outdoor, and controlled light source) to find suitable illumination for image acquisition. We undertook statistical hypothesis testing to find the effect of color space models and shape descriptors on the accuracy, false positive and false negative rates. While measuring accuracy, we have noted that L*a*b* color space is significantly worse, and the best result is obtained in YCbCr color space using bounding box shape descriptors for 2500 Lux using LED.

Type
Research Article
Copyright
Copyright © Cambridge University Press 2019

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Barrow, HG, Tenenbaum, JM, Bolles, RC and Wolf, HC (1977) Parametric Correspondence and Chamfer Matching: Two New Techniques for Image Matching. Menlo Park, CA, USA: Sri International's Artificial Intelligence Center.Google Scholar
Ben-Musa, AS, Singh, SK and Agrawal, P (2014) Object detection and recognition in cluttered scene using Harris Corner Detection. 2014 International Conference on Control, Instrumentation, Communication and Computational Technologies (ICCICCT). Kanyakumari, India: IEEE, pp. 181–184.CrossRefGoogle Scholar
Borgefors, G (1988) Hierarchical chamfer matching: a parametric edge matching algorithm. IEEE Transactions on Pattern Analysis and Machine Intelligence 10, 849865.CrossRefGoogle Scholar
Caleiro, PM, Neves, AJ and Pinho, AJ (2007) Color-spaces and color segmentation for real-time object recognition in robotic applications. Electrónica e Telecomunicaçoes 4, 940945.Google Scholar
Chikando, A and Kinser, J (2005) Optimizing image segmentation using color model mixtures. Proceedings of 34th Applied Imagery and Pattern Recognition Workshop, 2005. Washington, DC, USA: IEEE, p. 6.Google Scholar
Cyganek, B (2013) Object Detection and Recognition in Digital Images: Theory and Practice. Wiley, New York.CrossRefGoogle Scholar
Dalal, N and Triggs, B (2005) Histograms of oriented gradients for human detection. IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), 2005, Vol. 1. San Diego, CA, USA: IEEE, pp. 886–893.CrossRefGoogle Scholar
Duan, G, Duan, F, Xu, Y, Gong, H and Qu, X (2015) Investigation of optimal segmentation color space of Bayer true color images with multi-objective optimization methods. Journal of the Indian Society of Remote Sensing 43, 487499.CrossRefGoogle Scholar
Felzenszwalb, PF, Girshick, RB, McAllester, D and Ramanan, D (2010) Object detection with discriminatively trained part-based models. IEEE Transactions on Pattern Analysis and Machine Intelligence 32, 16271645.CrossRefGoogle ScholarPubMed
Franco, A, Maltoni, D and Papi, S (2017) Grocery product detection and recognition. Expert Systems with Applications 81, 163176.CrossRefGoogle Scholar
Gavrila, DM and Philomin, V (1999) Real-time object detection for “smart” vehicles. Proceedings of the Seventh IEEE International Conference on Computer Vision, Fort Collins, Colorado, USA, Vol. 1. IEEE, pp. 87–93.CrossRefGoogle Scholar
Gevers, T and Smeulders, AW (1999) Color-based object recognition. Pattern Recognition 32, 453464.CrossRefGoogle Scholar
Gode, CS and Khobragade, AS (2016) Object detection using color clue and shape feature. International Conference on Wireless Communications, Signal Processing and Networking (WiSPNET). Chennai, India. IEEE, pp. 464–468.CrossRefGoogle Scholar
Heitz, G, Elidan, G, Packer, B and Koller, D (2009) Shape-based object localization for descriptive classification. International Journal of Computer Vision 84, 4062.CrossRefGoogle Scholar
Hernandez-Lopez, JJ, Quintanilla-Olvera, AL, López-Ramírez, JL, Rangel-Butanda, FJ, Ibarra-Manzano, MA and Almanza-Ojeda, DL (2012) Detecting objects using color and depth segmentation with Kinect sensor. Procedia Technology 3, 196204.CrossRefGoogle Scholar
Hirano, Y, Garcia, C, Sukthankar, R and Hoogs, A (2006) Industry and object recognition: Applications, applied research and challenges. J. Ponce et al. (Eds.). Toward Category-Level Object Recognition. Berlin, Heidelberg: Springer, pp. 4964.Google Scholar
Ibraheem, NA, Hasan, MM, Khan, RZ and Mishra, PK (2012) Understanding color models: a review. ARPN Journal of Science and Technology 2, 265275.Google Scholar
Jain, AK and Vailaya, A (1996) Image retrieval using color and shape. Pattern Recognition 29, 12331244.CrossRefGoogle Scholar
Khan, FS, Anwer, RM, Van de Weijer, J, Bagdanov, AD, Vanrell, M and Lopez, AM (2012) Color attributes for object detection. 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Providence, RI, USA: IEEE, pp. 3306–3313.CrossRefGoogle Scholar
Khattab, D, Ebied, HM, Hussein, AS and Tolba, MF (2014) Color image segmentation based on different color space models using automatic GrabCut. The Scientific World Journal 2014, 110.CrossRefGoogle ScholarPubMed
Khurana, P, Sharma, A, Singh, SN and Singh, PK (2016) A survey on object recognition and segmentation techniques. 2016 3rd International Conference on Computing for Sustainable Global Development (INDIACom). New Delhi, India: IEEE, pp. 3822–3826.Google Scholar
Kim, TH, Cho, TH, Moon, YS and Park, SH (1999) Visual inspection system for the classification of solder joints. Pattern Recognition 32, 565575.CrossRefGoogle Scholar
Kyo, S, Koga, T, Okazaki, S, Uchida, R, Yoshimoto, S and Kuroda, I (2003) A 51.2 GOPS scalable video recognition processor for intelligent cruise control based on a linear array of 128 4-way VLIW processing elements. 2003 IEEE International Solid-State Circuits Conference, 2003. Digest of Technical Papers. ISSCC. San Francisco, CA, USA: IEEE, pp. 48–477.Google Scholar
Liu, JQ, Kuang, H and Ding, SH (2007) Research on machine vision system for inspection of SMT chip pins. China Mechanical Engineering 18, 19081912.Google Scholar
Moganti, M, Ercal, F, Dagli, CH and Tsunekawa, S (1996) Automatic PCB inspection algorithms: a survey. Computer Vision and Image Understanding 63, 287313.CrossRefGoogle Scholar
Mohan, A, Papageorgiou, C and Poggio, T (2001) Example-based object detection in images by components. IEEE Transactions on Pattern Analysis and Machine Intelligence 23, 349–361.CrossRefGoogle Scholar
Mori, G, Belongie, S and Malik, J (2005) Efficient shape matching using shape contexts. IEEE Transactions on Pattern Analysis and Machine Intelligence 27, 18321837.CrossRefGoogle ScholarPubMed
Ohta, YI, Kanade, T and Sakai, T (1980) Color information for region segmentation. Computer Graphics and Image Processing 13, 222241.CrossRefGoogle Scholar
Olson, CF and Huttenlocher, DP (1997) Automatic target recognition by matching oriented edge pixels. IEEE Transactions on Image Processing 6, 103113.CrossRefGoogle ScholarPubMed
Papageorgiou, CP, Oren, M and Poggio, T (1998) A general framework for object detection. Sixth International Conference on Computer Vision. Bombay, India: IEEE, pp. 555–562.Google Scholar
Rasouli, A and Tsotsos, JK (2017) The effect of color space selection on detectability and discriminability of colored objects. arXiv preprint arXiv:1702.05421.Google Scholar
Scandaliaris, J, Villamizar, M, Andrade-Cetto, J and Sanfeliu, A (2007) Robust color contour object detection invariant to shadows. Iberoamerican Congress on Pattern Recognition. Berlin, Heidelberg: Springer, pp. 301310.Google Scholar
Shasani, SS, Meher, RR and Patra, MK (2015) Color and Shape Recognition, Bachelor of Technology Thesis, Department of Computer Science and Engineering, National Institute of Technology, Rourkela, Odisha, India.Google Scholar
Song, DL, Ge, LH, Qi, WW and Chen, M (2010) Illumination invariant color model selection based on genetic algorithm in robot soccer. 2010 2nd International Conference on Information Science and Engineering (ICISE). Hangzhou, China: IEEE, pp. 1245–1248.CrossRefGoogle Scholar
Stella, XY, Gross, R and Shi, J (2002) Concurrent object recognition and segmentation by graph partitioning. Advances in Neural Information Processing Systems 1, 14071414.Google Scholar
Toshev, A, Taskar, B and Daniilidis, K (2012) Shape-based object detection via boundary structure segmentation. International Journal of Computer Vision 99, 123146.CrossRefGoogle Scholar
Zarit, BD, Super, BJ and Quek, FK (1999) Comparison of five color models in skin pixel classification. Proceedings International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems. In Conjunction with ICCV'99 (Cat. No. PR00378). Corfu, Greece: IEEE, pp. 58–63.Google Scholar
Zhang, D and Lu, G (2004) Review of shape representation and description techniques. Pattern Recognition 37, 119.CrossRefGoogle Scholar
Zhang, J, Huang, K, Yu, Y and Tan, T (2011) Boosted local structured HOG-LBP for object localization. 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, pp. 1393–1400.CrossRefGoogle Scholar