Skip to main content Accessibility help

Computer-assisted visual perception in teleoperated robotics

  • M. Mallem (a1), F. Chavand (a1) and E. Colle (a1)


Due to the complexity of teleoperation tasks, human operators figure in the teleoperator perception-decision-control loop. The operator needs an interactive system to handle the huge flow of data between himself and the teleoperator.

The scene represented by the robot and its environment is viewed by one or more cameras. However, the video image may be degraded in extreme environments (underwater, space, etc.) or simply inadequate (2-D image).

In this paper we describe the visual perception aids based of the scene, and more specifically how these are generated by the method we put forward. The system developed at the LRE superimposes a 3-D synthetic image onto the video picture, and animates the scene in real-time on the basis of sensor information feedback. The graphic image can be generated from models, if the objects are known, otherwise interactively, with the cooperation of the operator if the objects are completely unknown. Experiments show that these graphic aids improve the operator's performance in task execution.



Hide All
1.Hightower, J.D., Spain, E.M. and Bowles, R.N., Telepresence: a hybrid approach to high performance robots ICAR'87, Versailles France 563573 (10, 1987).
2.Terre, C., “Conduite à distance d'un robot mobile pour la sécurité civile. Approche ergonomique” Thèse de doctorat de I'université Paris V (11 1990).
3.Hill, J., “Comparison of seven performance measures in a time delayed manipulation taskIEEE Trans, on Systems Man and Cybernetics SMC6, No. 4 (1976).
4.Sheridan, T.B., “Supervisory control of remote manipulators, vehicles and dynamic processes: Experiment in command and display aidingAdvances in Man Machine Systems Research 1, 49137 (1984).
5.Andre, G. and Fournier, A., “The generalized information feedback concept in computer aided teleoperation” RO-MAN-SY 86, Cracow (09, 1986) pp. 2232.
6.Foley, J.D., “Interface for advanced computingScientific American 8390 (10, 1987).
7.Quetin, N. and Gaillard, J. P., “Evaluation de retour sensoriel d'informationJournées annuelle du programme ARA Poitiers, France, 8191 (09, 1982).
8.Vertut, J., and Coiffet, P., Les Robots, Téléopération, Evolution des Technologies Tome 3A (Hermès Publishing, Paris, 1984).
9.Vigne, C., “Télétransmissions sous marine par fibre optique” Remote Control in Hostile Environment: Cross-technological Experiences ORIA'89, Marseille 167183 (12, 1989).
10.Borot, P. and Brisset, L., “ELIT: un robot sous-marin d'observation autonomeProceedings of a colloquium on “Space and Sea”, Marseille, France, 2427 (11 24–27, 1987).
11.Hancock, P.A. and Chignell, M.H., “Adaptative control in human-machine systems” in: Human factors Psychology No. 47 (Hancock, Peter A. ed.) (Eisevier Science Publishers, North-Holland, Amsterdam 1987).
12.Tsukiyama, T., “The present status of R&D in the Japonese Advanced Robot Technology national projectProceedings of the 3rd Int. Conf, on Advanced Robotics, ICAR'87,Versailles—France, 1523 (10., 1987).
13.Gaillard, J.P., Galerne, S. and Colle, E., “La visualisation des effortsJournées ARA—Pole TAO, Besançon G1–G11 (11, 1983).
14.Corker, K., Bejczy, A.K. and Bappaport, B., “Force/Torque display for space teleoperation control experiments and evaluationNASA AMES RESEARCH Center, 21st Annual Conf. Manual Control (1986) pp. 26–1.
15.Tachi, S. and Arai, H., “Study on tele-Existence (II): Three dimensional color display with sensation of presenceProceedings of '85 Int. Conf. on Advanced Robotics345352 (09 1985).
16.Pepper, R.L., Cole, R.E., Spain, E.H., and Sigurdson, J.E., “Research issues involved in applying stereoscopic television to remotely operated vehicles” Proc. SPIE, 402 Three-dimensional Imaging, 170175 (1983).
17.Fornoff, H. and Thornton, W.G., “Experimental evaluation of remote manipulation system” In: Remotely Manned Systems (Heer, E., Ed.) (Bell Aerospace Co., Buffalo, USA. 1973).
18.Paine, G., “Microprocessors for real time displays and control of space teleoperators” Proceedings of the 1st International Symposium on mini and micro-computers in control, San Diego, California, (1979) pp. 1825.
19.Bejczy, A.K., “Robots as man-extension systems in spaceIFAC 9th Triennial World Congress – Budapest, Hungary (1984) pp. 24112416.
20.Kim, W.S. and Stark, L., “Cooperative control of visual displays for telemanipulationIEEE Proc. Robotics & Automation Conference (1989) pp. 13271332.
21.Bos, J.F.T., “Visual enhancements for graphical displays in the control of space manipulators8th European Annual Conference on Human Decision Making and Manual Control,T.U. of Denmark, Lyngby, 119132 (June 12–14, 1989).
22.Coiffet, P., “La Robotique, Principes et ApplicationsHermès Publishing, Paris, 1986).
23.Laugier, C., “Les apports successifs des langages symboliques et de la CAO en programmation des robotsROBOTICA 6, part 4 243253 (1988).
24.Quaro, C., “Etude et réalisation d'un système graphique interactif pour la robotique” Thèse de Docteur Ingénieur, Montpellier (1985).
25.Chavand, F., Colle, E., Gaillard, J.P., Mallem, A. and Stromboni, J.P., “Visual assistance to the operator in teleoperation supervision situation”, Proc. Int. Symposium on Teleoperation and Control 237248Bristol (07, 1988).
26.Mallem, M., Chavand, F. and Gaillard, J.P., “Visual enhancements in teleoperation”. EAM 90. Ispra, Italy, 110 (09 1990).
27.Hung, Y., Yeh, Pen-Shu and Harwood, D., “Passive ranging to known planar point setsIEEE Int. Conf. on Robotics and Automation St Louis, (March 25–28, 1985) pp. 8085.
28.Mallem, M., “Aide à la perception en téléopération: superposition à une image caméra d'une image synthétique 3D animée en temps réel à partir des informations capteurs” Thèse de doctorat de l'université Paris XII, (04, 1990).
29.Ganapathy, S., “Decomposition of the transformation matrices for robot visionProceedings Int. Conf. on Robotics and Automation130139 (1984).


Computer-assisted visual perception in teleoperated robotics

  • M. Mallem (a1), F. Chavand (a1) and E. Colle (a1)


Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed