In this paper, we present a robot programming system taking into account natural communication and process integrated simulation as well as a unified robot control layer and an interface towards the Digital Factory for program transmission. We choose an integrative approach including markerless gesture recognition and a mobile Augmented Reality simulation on common handheld devices, e.g. smartphones or tablet-PCs. The user is enabled to draw poses and trajectories into the workspace of the robot supported with simultaneous visual feedback in Augmented Reality. In addition the user can adapt the robot program by gestural manipulation of poses and trajectories. Within a task-oriented implementation of the robot program a pick and place task was implemented through the programming by demonstration principle. With the help of a user study we evaluate programming duration, programming errors and subjective assessment compared with Teach-In and Offline Programming. The analysis of the results shows a significant reduction of programming duration as well as a reduction of programming errors compared with Teach-In. Furthermore, most participants favour the spatial programming system.
Multiplexed optical barcoding of cells via photochemical programming of bioorthogonal host–guest recognition
