Real-time integration of sensing, planning and control in robotic work-cells

Di Xiao, Mumin Song, Bijoy K. Ghosh, Ning Xi, Tzyh Jong Tarn, Zhenyu Yu

Research output: Contribution to journalArticlepeer-review

22 Scopus citations


This paper addresses real-time planning and control for robot manipulators in a re-configurable work-cell or an unknown workspace. The considered tasks in robotic work-cell are (1) to catch a moving object by using vision-guidance system, and (2) to follow a path on an unknown surface. These two tasks are commonly performed in the applications of material handling and processing. In order to efficiently and successfully accomplish the tasks, novel strategies for integrating real-time planning and control are proposed to improve agility and reconfigurability of robotic systems and to deal with the uncertainties in the environment by means of multi-sensor fusion. In the proposed schemes, a novel calibration-free stereo vision algorithm and a new hybrid position/force control strategy are utilized. In order to achieve intelligent robot manipulation in an unstructured workspace and reconfigurable work-cell, complementary sensory data from different types of sensors, such as force/torque, encoders and visual sensors, are integrated simultaneously during robot constrained motion.

Original languageEnglish
Pages (from-to)653-663
Number of pages11
JournalControl Engineering Practice
Issue number6
StatePublished - Jun 2004


  • Force control
  • Motion planning
  • Robot vision
  • Sensor fusion


Dive into the research topics of 'Real-time integration of sensing, planning and control in robotic work-cells'. Together they form a unique fingerprint.

Cite this