Sensor-guided manipulation in a manufacturing workcell

Bijoy K. Ghosh, Di Xiao, Ning Xi, Tzyh Jong Tarn

Research output: Contribution to conferencePaperpeer-review

1 Scopus citations


The main problem that we address in this paper is how a robot manipulator is able to track and grasp a part placed arbitrarily on a moving disc conveyor aided by a single CCD camera and fusing information from encoders placed on the conveyor and also from encoders on the robot manipulator. The important assumption that distinguishes our work from what has been previously reported in the literature is that the position and orientation of the camera and the base frame of the robot is apriori assumed to be unknown and is `visually calibrated' during the operation of the manipulator. Moreover the part placed on the conveyor is assumed to be non-planar, i.e. the feature points observed on the part is assumed to be located arbitrarily in IR3. The novelties of the proposed approach in this paper includes a (i) multisensor fusion scheme based on complementary data for the purpose of part localization, and (ii) self-calibration between the turntable and the robot manipulator using visual data and feature points on the end-effector. The principle advantages of the proposed scheme are the following. (i) It renders possible to reconfigure a manufacturing workcell without recalibrating the relation between the turntable and the robot. This significantly shortens the setup time of the workcell. (ii) It greatly weakens the requirement on the image processing speed.

Original languageEnglish
Number of pages6
StatePublished - 1997
EventProceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Part 2 (of 3) - Grenoble, Fr
Duration: Sep 7 1998Sep 11 1998


ConferenceProceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Part 2 (of 3)
CityGrenoble, Fr


Dive into the research topics of 'Sensor-guided manipulation in a manufacturing workcell'. Together they form a unique fingerprint.

Cite this