Hostname: page-component-77c89778f8-vsgnj Total loading time: 0 Render date: 2024-07-19T17:08:39.423Z Has data issue: false hasContentIssue false
  • English
  • Français

On the use of agent technology in intelligent, multisensory and distributed surveillance

Published online by Cambridge University Press:  12 May 2011

José M. Gascueña  and
Antonio Fernández-Caballero
José M. Gascueña
Affiliation:
Departamento de Sistemas Informáticos, Instituto de Investigación en Informática de Albacete, Universidad de Castilla-La Mancha, 02071-Albacete, Spain; e-mail: Antonio.Fdez@uclm.es
Antonio Fernández-Caballero*
Affiliation:
Departamento de Sistemas Informáticos, Instituto de Investigación en Informática de Albacete, Universidad de Castilla-La Mancha, 02071-Albacete, Spain; e-mail: Antonio.Fdez@uclm.es
Get access Rights & Permissions [Opens in a new window]

Abstract

This article revises the state of the art of the application of agent technology within the scope of surveillance systems. Thus, the potential of the practical use of the concepts and technologies of the agent paradigm can be identified and evaluated in this domain. Current surveillance systems are noted for using several devices, heterogeneous in many instances, distributed along the observed scenario, while incorporating a certain degree of intelligence to alert the operator proactively to what is going on in the observed scenario and prevent the operator from having to observe the monitors continuously. The basic characteristics of the agents (autonomy, reactivity, proactiveness and social ability), along with multiagent systems’ characteristics (distributed data management, low coupling, robustness, communication and coordination between autonomous entities), suggest that the agency is a good choice for solving problems which appear and are dealt with in surveillance systems.

Type
Articles
Information
The Knowledge Engineering Review , Volume 26 , Issue 2 , 12 May 2011 , pp. 191 - 208
Copyright
Copyright © Cambridge University Press 2011

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Abreu, B., Botelho, L., Cavallaro, A., Douxchamps, D., Ebrahimi, T., Figueiredo, P., Macq, B., Mory, B., Nunes, L., Orri, J., Trigueiros, M. J., Violante, A. 2000. A video-based multiagent traffic surveillance system. In The IEEE Intelligent Vehicles Symposium, Dearborn, MI, USA, 457–462.Google Scholar
Aguilar-Ponce, R., Kumar, A., Tecpanecatl-Xihuitl, J. L., Bayoumi, M. 2007. A network of sensor-based framework for automated visual surveillance. Journal of Network and Computer Applications 30, 1244–1271.CrossRefGoogle Scholar
Ao Ieong, T. W. H., Lee, R. S. T. 2004. iJADE Face Recognizer—A multiagent based pose and scale invariant human face recognition system. In Knowledge-Based Intelligent Information and Engineering Systems, Lecture Notes in Artificial Intelligence 3214, 494–601. Springer.CrossRefGoogle Scholar
Attwood, C. I., Watson, D. A. 2004. Advisor—socket and see: lessons learnt in building a real-time distributed surveillance system. In Intelligent Distributed Surveillance Systems, London, UK, 6–11.Google Scholar
Beer, M., d'Inverno, M., Luck, M., Jennings, N., Preist, C., Schroeder, M. 1999. Negotiation in multi-agent systems. The Knowledge Engineering Review 14, 285–289.CrossRefGoogle Scholar
Bigus, J. P. 2000. The agent building and learning environment. In The Fourth International Conference on Autonomous Agents, Barcelona, Spain, 108–109.Google Scholar
Biswas, P. K., Qi, H., Xu, Y. 2008. Mobile-agent-based collaborative sensor fusion. Information Fusion 9, 399–411.CrossRefGoogle Scholar
Bovenkamp, E. G. P., Dijkstra, J., Bosch, J. G., Reiber, J. H. C. 2004. Multiagent segmentation of IVUS images. Pattern Recognition 37(4), 647–663.CrossRefGoogle Scholar
Bramberger, M., Quaritsch, M., Winkler, T., Rinner, B., Schwabach, H. 2005. Integrating multicamera tracking into a dynamic task allocation system for smart cameras. In Advanced Video and Signal Based Surveillance, Como, Italy, 474–479.Google Scholar
Castanedo, F., Patricio, M. A., García, J., Molina, J. M. 2006. Extending surveillance systems capabilities using BDI cooperative sensor agents. In 4th ACM International Workshop on Video Surveillance and Sensor Networks, Santa Barbara, CA, USA, 131–138.Google Scholar
Castanedo, F., García, J., Patricio, M. A., Molina, J. M. 2008. A multiagent architecture to support active fusion in a visual sensor network. In 2nd ACM/IEE International Conference on Distributed Smart Cameras, Stanford, CA, USA, 1–8.Google Scholar
Chetty, G., Sharma, D. 2006. Distributed face recognition: A multiagent approach. In Knowledge-Based Intelligent Information and Engineering Systems, Lecture Notes in Artificial Intelligence 4253, 1168–1175. Springer.CrossRefGoogle Scholar
Collinot, A., Drogoul, A., Benhamou, P. 1996. Agent oriented design of a soccer robot team. In 2nd International Conference on Multiagent Systems, Kyoto, Japan, 41–47.Google Scholar
Cossentino, M., Sabatucci, L., Chella, A. 2003. A possible approach to the development of robotic multiagent systems. In IEEE/WIC Conference on Intelligent Agent Technology, Halifax, Canada, 539–544.Google Scholar
Costello, C., Diehl, C., Banerjee, A., Fisher, H. 2004. Scheduling an active camera to observe people. In ACM 2nd International Workshop on Visual Surveillance and Sensor Networks, New York, NY, USA, 39–45.Google Scholar
Cucchiara, R. 2005. Multimedia surveillance systems. In The third ACM International Workshop on Video Surveillance and Sensor Networks, Singapore, 3–10.Google Scholar
De Gregorio, M. 2007. A hybrid intelligent system for active video surveillance. In The Seventh International Conference on Intelligent Systems Design and Applications, 21–26.Google Scholar
DeLoach, S., Matson, E., Li, Y. 2002. Applying agent oriented software engineering to cooperative robotics. In The Fifteenth International Florida Artificial Intelligence Research Society Conference, 391–396.Google Scholar
Detmold, H., Dick, A., Falkner, K., Munro, D. S., Hengel, A., Morrison, R. 2006a. Scalable surveillance software architecture. In IEEE International Conference on Video and Signal Based Surveillance, Sydney, Australia, 103–108.Google Scholar
Detmold, H., Dick, A., Falkner, K., Munro, D. S., Hengel, A., Morrison, R. 2006b. Middleware for video surveillance networks. In International Workshop on Middleware for Sensor Networks, Melbourne, Australia, 31–36.Google Scholar
Durfee, E. H., Lesser, V. R., Corkill, D. D. 1989. Trends in cooperative distributed problem solving. IEEE Transactions on Knowledge and Data Engineering 1(1), 63–83.CrossRefGoogle Scholar
d'Inverno, M., Fisher, M., Lomuscio, A., Luck, M., de Rijke, M., Ryan, M., Wooldridge, M. 1997. Formalisms for multi-agent systems. The Knowledge Engineering Review 12, 315–321.CrossRefGoogle Scholar
Fernández-Caballero, A., Gómez, F., López-López, J. 2008. Road-traffic monitoring by knowledge-driven static and dynamic image analysis. Expert Systems with Applications 353, 701–719.CrossRefGoogle Scholar
Finin, T., McKay, D., Fritzon, R. 1992. An Overview on KQML: A Knowledge Query and Manipulation Language. Technical Report no. CS-94-12, University of Maryland Computer Science Department.Google Scholar
Franklin, S., Graesser, A. 1996. Is it an agent, or just a program?: a taxonomy for autonomous agents. In Intelligent Agents III, Agent Theories, Architectures and Languages, Lecture Notes in Computer Science 1193, 21–35. Springer.CrossRefGoogle Scholar
García, J., Carbo, J., Molina, J. M. 2005. Agent-based coordination of cameras. International Journal of Computer Science and Applications 2(1), 33–37.Google Scholar
Gascueña, J. M., Fernández-Caballero, A. 2007. The INGENIAS methodology for advanced surveillance systems modelling. In 2nd International Work-Conference on the Interplay between Natural and Artificial Computation, Lecture Notes in Computer Science 4528, 541–550.Google Scholar
Gascueña, J. M., Fernández-Caballero, A. 2009a. Agent-based modeling of a mobile robot to detect and follow humans. In 3rd International KES Symposium on Agents and Multiagent Systems—Technologies and Applications, Lecture Notes in Computer Science 5559, 80–89.Google Scholar
Gascueña, J. M., Fernández-Caballero, A. 2009b. Prometheus and INGENIAS agent methodologies: a complementary approach. In Agent-Oriented Software Engineering IX, Lecture Notes in Computer Science 5386, 131–144.Google Scholar
Gascueña, J. M., Fernández-Caballero, A. 2009c. Towards an integrative methodology to develop multiagent systems. In International Conference on Agents and Artificial Intelligence, Porto, Portugal, 392–399.Google Scholar
Haering, N., Venetianer, P. L., Lipton, A. 2008. The evolution of video surveillance: an overview. Machine Vision and Applications 19(5–6), 279–290.CrossRefGoogle Scholar
Haesevoets, R., Van Eylen, B., Weyns, D., Helleboogh, A., Holvoet, T. 2007. Context-driven dynamic organizations applied to coordinated monitoring of traffic jams. In Engineering Environment-Mediated Multiagent Systems, Dresden, Germany, 126–143.Google Scholar
Horaud, R. P., Knossow, D., Michaelis, M. 2006. Camera cooperation for achieving visual attention. Machine Vision and Applications 16(6), 331–342.CrossRefGoogle Scholar
Horling, B., Lesser, V. 2004. A survey of multi-agent organizational paradigms. The Knowledge Engineering Review 19, 281–316.CrossRefGoogle Scholar
Hu, W., Tan, T., Wang, L., Maybank, S. 2004. A survey on visual surveillance of object motion and behaviors. IEEE Transactions on Systems, Man and Cybernetics 34(3), 334–350.CrossRefGoogle Scholar
Huhns, M. N., Stephens, L. M. 1999. Multiagent systems and societies of agents. In Multiagent Systems, Weiss, G. (ed.). The MIT Press.Google Scholar
Jiménez, J. A., Vallejo, M., Ochoa, J. F. 2007. Methodology for the analysis and design of multiagent robotic systems: MAD-Smart. Avances en Sistemas e Informática 4(2), 61–70.Google Scholar
Jovanovic, M., Rinner, B. 2007. Middleware for dynamic reconfiguration in distributed camera systems. In 5th IEEE International Workshop on Intelligent Solutions in Embedded Systems, Madrid, Spain, 139–150.Google Scholar
Kang, W., Deng, F. 2007. Research on intelligent visual surveillance for public security. In 6th IEEE/ACIS International Conference on Computer and Information Science, Melbourne, Australia, 824–829.Google Scholar
Karlsson, B., Bäckström, O., Kulesza, W., Axelsson, L. 2005. Intelligent sensor networks—an agent-oriented approach. In Workshop on Real-World Wireless Sensor Networks, Stockholm, Sweden.Google Scholar
Kim, N., Kim, I., Kim, H. 2006. Video surveillance using dynamic configuration of multiple active cameras. In International Conference on Image Processing, Atlanta, GA, USA, 1761–1764.Google Scholar
Kipsic, D., Ribaric, S. 2005. A multiagent-based approach to face detection and localization. In 27th International Conference on Information Technology Interfaces, Cavtat, Croatia, 377–382.Google Scholar
Kulkarni, P., Ganesan, D., Shenoy, P., Lu, Q. 2005. SensEye: a multitier camera sensor network. In 13th ACM International Conference on Multimedia, Singapore, 229–238.Google Scholar
Kumar, P., Mittal, A., Kumar, P. 2008. Study of robust and intelligent surveillance in visible and multimodal framework. Informatica 32(1), 63–77.Google Scholar
Lange, D. B., Oshima, M. 1999. Seven good reasons for mobile agents. Communications of the ACM 42(3), 88–89.CrossRefGoogle Scholar
Liu, J., Tang, Y. Y. 1999. Adaptive image segmentation with distributed behaviour based agents. IEEE Transactions on Pattern Analysis and Machine Intelligence 21(6), 544–551.Google Scholar
López, M. T., Fernández-Caballero, A., Fernández, M. A., Mira, J., Delgado, A. E. 2006a. Visual surveillance by dynamic visual attention method. Pattern Recognition 39(11), 2194–2211.CrossRefGoogle Scholar
López, M. T., Fernández-Caballero, A., Fernández, M. A., Mira, J., Delgado, A. E. 2006b. Motion features to enhance scene segmentation in active visual attention. Pattern Recognition Letters 275, 469–478.CrossRefGoogle Scholar
López, M. T., Fernández-Caballero, A., Fernández, M. A., Mira, J., Delgado, A. E. 2007. Dynamic visual attention model in image sequences. Image and Vision Computing 25(5), 597–613.CrossRefGoogle Scholar
Mazouzi, S., Guessoum, Z., Michel, F., Batouche, M. 2007. A multiagent approach for range image segmentation. In 5th International Central and Eastern European Conference on MultiAgent Systems, Leipzig, Germany, 1–10.Google Scholar
Menegatti, E., Cavasin, M., Mumolo, E., Nolich, M., Pagello, E. 2007. Combining audio and video surveillance with a mobile robot. International Journal on Artificial Intelligence Tools 16(2), 377–398.CrossRefGoogle Scholar
Mitchell, H. B. 2007. MultiSensor Data Fusion: An Introduction. Springer-Verlag.Google Scholar
Molina, J. M., Garcia, J., Jiménez, F. J., Casar, J. R. 2003. Cooperative management in a net of intelligent surveillance agent-sensors. International Journal of Intelligent Sytems 18(3), 279–307.Google Scholar
Nguyen, N., Bui, H., Venkatesh, S., West, G. 2003. Multiple camera coordination in a surveillance system. ACTA Automatica Sinica 29(3), 408–422.Google Scholar
Patricio, M. A., Castanedo, F., Berlanga, A., Pérez, O., García, J., Molina, J. M. 2008. Computational intelligence in visual sensor networks: improving video processing systems. Studies in Computational Intelligence 96, 351–377.Google Scholar
Pavón, J., Gómez-Sanz, J., Fernández-Caballero, A., Valencia, J. J. 2007. Development of intelligent multisensor surveillance systems with agents. Robotics and Autonomous Systems 55(12), 892–903.CrossRefGoogle Scholar
Pechoucek, M., Thompson, S. G., Voos, H. (eds). 2008. Defense industry applications of autonomous agents and multiagent systems. In Whitestein Series in Software Agent Technologies and Autonomic Computing, Whitestone Technologies.Google Scholar
Perugini, D., Lambert, D., Sterling, L., Pearce, A. 2003. Distributed information fusion agents. In Sixth International Conference of Information Fusion, Cairns, Australia, 1, 86–93.Google Scholar
Petrushin, V. A., Wei, G., Shakil, O., Roqueiro, D., Gershman, A. V. 2006. Multiple-sensor indoor surveillance system. In The 3rd Canadian Conference on Computer and Robot Vision, Quebec City, Canada, 40.Google Scholar
Quaritsch, M., Kreuzthaler, M., Rinner, B., Bischof, H., Strobl, B. 2007. Autonomous multicamera tracking on embedded smart cameras. EURASIP Journal on Embedded Systems, 2007(1), 10.Google Scholar
Qureshi, F., Terzopoulos, D. 2006. Surveillance camera scheduling: a virtual vision approach. ACM Multimedia Systems Journal 12(3), 269–283.CrossRefGoogle Scholar
Räty, T., Lindholm, M., Nieminen, M., Oikarinen, J. 2008. Distributing essential logical deductions to surveillance personnel and a video recorder. In Second International Conference on Mobile Ubiquitous Computing, Systems, Services and Technologies, Valencia, Spain, 295–304.Google Scholar
Remagnino, P., Tan, T., Baker, K. 1998. Agent orientated annotation in model based visual surveillance. In Sixth International Conference on Computer Vision, Bombay, India, 857–862.Google Scholar
Remagnino, P., Shihab, A. I., Jones, G. A. 2004. Distributed intelligence for multicamera visual surveillance. Pattern Recognition 37(4), 675–689.CrossRefGoogle Scholar
Richard, N., Dojat, M., Garbay, C. 2004. Automated segmentation of human brain MR images using a multiagent approach. Artificial Intelligence in Medicine 30(2), 153–176.CrossRefGoogle Scholar
Rodin, V., Benzinou, A., Guillaud, A., Ballet, P., Harrouet, F., Tisseau, J., Le Bihan, J. 2004. An immune oriented multiagent system for biological image processing. Pattern Recognition 37(4), 631–645.CrossRefGoogle Scholar
Schmidt, D. C. 2006. Guest editor's introduction: model-driven engineering. Computer 39(2), 25–31.CrossRefGoogle Scholar
Shunmuganathan, K. L., Vasudevan, V. 2006. Multiagent based facial recognition system using RETSINA. Asian Journal of Information Technology 5(11), 1177–1179.Google Scholar
Singh, M. P., Huhns, M. N. 2005. Service-oriented Computing: Semantics, Processes, Agents. John Wiley & Sons, Ltd.Google Scholar
Tran, Q. N. 2006. MOBMAS—A Methodology for Ontology-based Multi-agent Systems Development. PhD dissertation, School of Information Systems, Technology and Management, University of New South Wales.Google Scholar
Trivedi, M., Mikic, I., Kogut, G. 2000. Distributed video networks for incident detection and management. In Proceedings of IEEE Conference on Intelligent Transportation Systems, Dearborn, MI, USA, 155–160.Google Scholar
Trivedi, M., Prati, A., Kogut, G. 2002. Distributed interactive video arrays for event based analysis of incidents. In The 5th IEEE Conference on Intelligent Transportation Systems, Dearborn, MI, USA, 950–956.Google Scholar
Ukita, N., Matsuyama, T. 2005. Real-time cooperative multitarget tracking by communicating active vision agents. Computer Vision and Image Understanding 97(2), 137–179.CrossRefGoogle Scholar
Valera, M., Velastin, S. A. 2006. A review of the state-of-the-art in distributed surveillance systems. In Intelligent Distributed Video Surveillance Systems, The Institution of Engineering and Technology, 1–30.Google Scholar
Vallejo, D., Albusac, J., Gonzalez-Morcillo, C., Jiménez, L. 2008. A service-oriented multiagent architecture for cognitive surveillance. In Cooperative Information Agents XII, Lecture Notes in Computer Science 5180, 101–115. Springer.CrossRefGoogle Scholar
Velastin, S. A., Khoudour, L., Lo, B. P. L., Sun, J., Vicencio-Silva, M. 2004. PRISMATICA: a multisensor surveillance system for public transport networks. In The Twelfth International Conference Road Transport Information and Control, London, UK, 19–25.Google Scholar
Vigna, G. 2004. Mobile agents: ten reasons for failure. In IEEE International Conference on Mobile Data Management, Berkeley, CA, USA, 298–299.Google Scholar
Weiss, G. 2001. Agent orientation in software engineering. The Knowledge Engineering Review 16(4), 349–373.CrossRefGoogle Scholar
Wooldridge, M., Jennings, J. A. 1995. Intelligent agents: theory and practice. The Knowledge Engineering Review 10(2), 115–152.CrossRefGoogle Scholar