Hostname: page-component-8448b6f56d-sxzjt Total loading time: 0 Render date: 2024-04-24T01:48:17.863Z Has data issue: false hasContentIssue false
  • English
  • Français

Computer-assisted visual perception in teleoperated robotics

Published online by Cambridge University Press:  09 March 2009

M. Mallem ,
F. Chavand  and
E. Colle
M. Mallem
Affiliation:
Laboratoire de Robotique d'Evry (LRE), 22, allée Jean Rostand, 91000 Evry (France)
F. Chavand
Affiliation:
Laboratoire de Robotique d'Evry (LRE), 22, allée Jean Rostand, 91000 Evry (France)
E. Colle
Affiliation:
Laboratoire de Robotique d'Evry (LRE), 22, allée Jean Rostand, 91000 Evry (France)
Get access Rights & Permissions [Opens in a new window]

Summary

Due to the complexity of teleoperation tasks, human operators figure in the teleoperator perception-decision-control loop. The operator needs an interactive system to handle the huge flow of data between himself and the teleoperator.

The scene represented by the robot and its environment is viewed by one or more cameras. However, the video image may be degraded in extreme environments (underwater, space, etc.) or simply inadequate (2-D image).

In this paper we describe the visual perception aids based of the scene, and more specifically how these are generated by the method we put forward. The system developed at the LRE superimposes a 3-D synthetic image onto the video picture, and animates the scene in real-time on the basis of sensor information feedback. The graphic image can be generated from models, if the objects are known, otherwise interactively, with the cooperation of the operator if the objects are completely unknown. Experiments show that these graphic aids improve the operator's performance in task execution.

Keywords

TeleoperationPerception aids3-D synthetic imageImage mixing
Type
Article
Information
Robotica , Volume 10 , Issue 2 , March 1992 , pp. 93 - 103
Copyright
Copyright © Cambridge University Press 1992

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

1.Hightower, J.D., Spain, E.M. and Bowles, R.N., Telepresence: a hybrid approach to high performance robots ICAR'87, Versailles France 563–573 (10, 1987).Google Scholar
2.Terre, C., “Conduite à distance d'un robot mobile pour la sécurité civile. Approche ergonomique” Thèse de doctorat de I'université Paris V (11 1990).Google Scholar
3.Hill, J., “Comparison of seven performance measures in a time delayed manipulation task” IEEE Trans, on Systems Man and Cybernetics SMC6, No. 4 (1976).Google Scholar
4.Sheridan, T.B., “Supervisory control of remote manipulators, vehicles and dynamic processes: Experiment in command and display aiding” Advances in Man Machine Systems Research 1, 49–137 (1984).Google Scholar
5.Andre, G. and Fournier, A., “The generalized information feedback concept in computer aided teleoperation” RO-MAN-SY 86, Cracow (09, 1986) pp. 22–32.Google Scholar
6.Foley, J.D., “Interface for advanced computing” Scientific American 83–90 (10, 1987).Google Scholar
7.Quetin, N. and Gaillard, J. P., “Evaluation de retour sensoriel d'information” Journées annuelle du programme ARA Poitiers, France, 81–91 (09, 1982).Google Scholar
8.Vertut, J., and Coiffet, P., Les Robots, Téléopération, Evolution des Technologies Tome 3A (Hermès Publishing, Paris, 1984).Google Scholar
9.Vigne, C., “Télétransmissions sous marine par fibre optique” Remote Control in Hostile Environment: Cross-technological Experiences ORIA'89, Marseille 167–183 (12, 1989).Google Scholar
10.Borot, P. and Brisset, L., “ELIT: un robot sous-marin d'observation autonome” Proceedings of a colloquium on “Space and Sea”, Marseille, France, 24–27 (11 24–27, 1987).Google Scholar
11.Hancock, P.A. and Chignell, M.H., “Adaptative control in human-machine systems” in: Human factors Psychology No. 47 (Hancock, Peter A. ed.) (Eisevier Science Publishers, North-Holland, Amsterdam 1987).Google Scholar
12.Tsukiyama, T., “The present status of R&D in the Japonese Advanced Robot Technology national project” Proceedings of the 3rd Int. Conf, on Advanced Robotics, ICAR'87,Versailles—France, 15–23 (10., 1987).Google Scholar
13.Gaillard, J.P., Galerne, S. and Colle, E., “La visualisation des efforts” Journées ARA—Pole TAO, Besançon G1–G11 (11, 1983).Google Scholar
14.Corker, K., Bejczy, A.K. and Bappaport, B., “Force/Torque display for space teleoperation control experiments and evaluation” NASA AMES RESEARCH Center, 21st Annual Conf. Manual Control (1986) pp. 26–1.Google Scholar
15.Tachi, S. and Arai, H., “Study on tele-Existence (II): Three dimensional color display with sensation of presence” Proceedings of '85 Int. Conf. on Advanced Robotics345–352 (09 1985).Google Scholar
16.Pepper, R.L., Cole, R.E., Spain, E.H., and Sigurdson, J.E., “Research issues involved in applying stereoscopic television to remotely operated vehicles” Proc. SPIE, 402 Three-dimensional Imaging, 170–175 (1983).CrossRefGoogle Scholar
17.Fornoff, H. and Thornton, W.G., “Experimental evaluation of remote manipulation system” In: Remotely Manned Systems (Heer, E., Ed.) (Bell Aerospace Co., Buffalo, USA. 1973).Google Scholar
18.Paine, G., “Microprocessors for real time displays and control of space teleoperators” Proceedings of the 1st International Symposium on mini and micro-computers in control, San Diego, California, (1979) pp. 18–25.Google Scholar
19.Bejczy, A.K., “Robots as man-extension systems in space” IFAC 9th Triennial World Congress – Budapest, Hungary (1984) pp. 2411–2416.Google Scholar
20.Kim, W.S. and Stark, L., “Cooperative control of visual displays for telemanipulation” IEEE Proc. Robotics & Automation Conference (1989) pp. 1327–1332.Google Scholar
21.Bos, J.F.T., “Visual enhancements for graphical displays in the control of space manipulators” 8th European Annual Conference on Human Decision Making and Manual Control,T.U. of Denmark, Lyngby, 119–132 (June 12–14, 1989).Google Scholar
22.Coiffet, P., “La Robotique, Principes et Applications” Hermès Publishing, Paris, 1986).Google Scholar
23.Laugier, C., “Les apports successifs des langages symboliques et de la CAO en programmation des robots” ROBOTICA 6, part 4 243–253 (1988).CrossRefGoogle Scholar
24.Quaro, C., “Etude et réalisation d'un système graphique interactif pour la robotique” Thèse de Docteur Ingénieur, Montpellier (1985).Google Scholar
25.Chavand, F., Colle, E., Gaillard, J.P., Mallem, A. and Stromboni, J.P., “Visual assistance to the operator in teleoperation supervision situation”, Proc. Int. Symposium on Teleoperation and Control 237–248Bristol (07, 1988).Google Scholar
26.Mallem, M., Chavand, F. and Gaillard, J.P., “Visual enhancements in teleoperation”. EAM 90. Ispra, Italy, 1–10 (09 1990).Google Scholar
27.Hung, Y., Yeh, Pen-Shu and Harwood, D., “Passive ranging to known planar point sets” IEEE Int. Conf. on Robotics and Automation St Louis, (March 25–28, 1985) pp. 80–85.Google Scholar
28.Mallem, M., “Aide à la perception en téléopération: superposition à une image caméra d'une image synthétique 3D animée en temps réel à partir des informations capteurs” Thèse de doctorat de l'université Paris XII, (04, 1990).Google Scholar
29.Ganapathy, S., “Decomposition of the transformation matrices for robot vision” Proceedings Int. Conf. on Robotics and Automation130–139 (1984).Google Scholar