Servoed world models as interfaces between robot control systems and sensory data

Summary

A hierarchical robot sensory system being developed for industrial robotics is described. At each level of the hierarchy, sensory interpretative processes are guided by expectancy-generating modeling processes. The modeling processes are driven by a priori knowledge (object prototypes), by knowledge of the robot's movements (feed-forward from the control system), and by feedback from the interpretative processes (prior state of the sensory world). At the lowest level, the senses (vision, proximity, tactile, force, joint angle, etc.) are handled separately; above this level, they are integrated into a multi-model world model. At successively higher levels, the interpretative and modeling processes describe the world with successively higher order constructs, and over successively longer time periods. Each level of the modeling hierarchy provides output, in parallel, to guide the corresponding levels of a hierarchical robot control system.