Visual Robotic Perception System with Incremental Learning for Child–Robot Interaction Scenarios

This paper proposes a novel lightweight visual perception system with Incremental Learning (IL), tailored to child–robot interaction scenarios. Specifically, this encompasses both an action and emotion recognition module, with the former wrapped around an IL system, allowing novel actions to be easily added. This IL system enables the tutor aspiring to use robotic agents in interaction scenarios to further customize the system according to children’s needs. We perform extensive evaluations of the developed modules, achieving state-of-the-art results on both the children’s action BabyRobot dataset and the children’s emotion EmoReact dataset. Finally, we demonstrate the robustness and effectiveness of the IL system for action recognition by conducting a thorough experimental analysis for various conditions and parameters.

A High-Resolution, Ultrabroad-Range and Sensitive Capacitive Tactile Sensor based on CNTs/PDMS Composite for Robotic Hands

Tactile sensors are of great significance for robotic perception improvement to realize stable object manipulation and accurate object identification. To date, it remains a critical challenge to develop a broad-range...

Thermal Infrared Sensing for Near Real-Time Data-Driven Fire Detection and Monitoring Systems

With the increasing interest in leveraging mobile robotics for fire detection and monitoring arises the need to design recognition technology systems for these extreme environments. This work focuses on evaluating the sensing capabilities and image processing pipeline of thermal imaging sensors for fire detection applications, paving the way for the development of autonomous systems for early warning and monitoring of fire events. The contributions of this work are threefold. First, we overview image processing algorithms used in thermal imaging regarding data compression and image enhancement. Second, we present a method for data-driven thermal imaging analysis designed for fire situation awareness in robotic perception. A study is undertaken to test the behavior of the thermal cameras in controlled fire scenarios, followed by an in-depth analysis of the experimental data, which reveals the inner workings of these sensors. Third, we discuss key takeaways for the integration of thermal cameras in robotic perception pipelines for autonomous unmanned aerial vehicle (UAV)-based fire surveillance.

Soft Robotic Finger Embedded with Visual Sensor for Bending Perception

SUMMARY The various vision-based tactile sensors have been developed for robotic perception in recent years. In this paper, the novel soft robotic finger embedded with the visual sensor is proposed for perception. It consists of a colored soft inner chamber, an outer structure, and an endoscope camera. The bending perception algorithm based on image preprocessing and deep learning is proposed. The boundary of color regions and the position of marker dots are extracted from the inner chamber image and label image, respectively. Then the convolutional neural network with multi-task learning is trained to obtain bending states of the finger. Finally, the experiments are implemented to verify the effectiveness of the proposed method.