The Design of Lil’Flo, a Socially Assistive Robot for Upper Extremity Motor Assessment and Rehabilitation in the Community Via Telepresence

AbstractIntroductionWe present Lil’Flo, a socially assistive robotic telerehabilitation system for deployment in the community. As shortages in rehabilitation professionals increase, especially in rural areas, there is a growing need to deliver care in the communities where patients live, work, learn, and play. Traditional telepresence, while useful, fails to deliver the rich interactions and data needed for motor rehabilitation and assessment.MethodsFrom prior work, we have developed design requirements for a socially assistive robot for upper extremity motor assessment and rehabilitation via telepresence. We designed Lil’Flo, targeted towards pediatric patients with cerebral palsy and brachial plexus injuries. The system combines traditional telepresence and computer vision with a humanoid, who can play games with patients and guide them in a present and engaging way under the supervision of a remote clinician.ResultsThe humanoid’s arms have sufficient range of motion, and the face is able to communicate several emotions clearly. The system is portable, extensible, and cheaper than our prior iteration. A simple web interface allows operators to focus on interactions while the computer vision system stores data for analysis.ConclusionsLil’Flo represents a novel approach to delivering rehabilitation care in the community while maintaining the clinician-patient connection.

Download Full-text

The design of Lil’Flo, a socially assistive robot for upper extremity motor assessment and rehabilitation in the community via telepresence

Journal of Rehabilitation and Assistive Technologies Engineering ◽

10.1177/20556683211001805 ◽

2021 ◽

Vol 8 ◽

pp. 205566832110018

Author(s):

Michael J Sobrepera ◽

Vera G Lee ◽

Michelle J Johnson

Keyword(s):

Rural Areas ◽

Motor Rehabilitation ◽

Rehabilitation Care ◽

Rehabilitation Professionals ◽

Novel Approach ◽

Assistive Robot ◽

Care Facilities ◽

The Rich ◽

Socially Assistive Robot ◽

Assistive Robotic

Introduction We present Lil’Flo, a socially assistive robotic telerehabilitation system for deployment in the community. As shortages in rehabilitation professionals increase, especially in rural areas, there is a growing need to deliver care in the communities where patients live, work, learn, and play. Traditional telepresence, while useful, fails to deliver the rich interactions and data needed for motor rehabilitation and assessment. Methods We designed Lil’Flo, targeted towards pediatric patients with cerebral palsy and brachial plexus injuries using results from prior usability studies. The system combines traditional telepresence and computer vision with a humanoid, who can play games with patients and guide them in a present and engaging way under the supervision of a remote clinician. We surveyed 13 rehabilitation clinicians in a virtual usability test to evaluate the system. Results The system is more portable, extensible, and cheaper than our prior iteration, with an expressive humanoid. The virtual usability testing shows that clinicians believe Lil’Flo could be deployed in rural and elder care facilities and is more capable of remote stretching, strength building, and motor assessments than traditional video only telepresence. Conclusions Lil’Flo represents a novel approach to delivering rehabilitation care in the community while maintaining the clinician-patient connection.

Download Full-text

Computer Vision Based Asset Surveillance for Smart Buildings

Journal of Computational and Theoretical Nanoscience ◽

10.1166/jctn.2020.8691 ◽

2020 ◽

Vol 17 (1) ◽

pp. 456-463

Author(s):

K. S. Gautam ◽

Latha Parameswaran ◽

Senthil Kumar Thangavel

Keyword(s):

Computer Vision ◽

Correlation Coefficient ◽

Real World ◽

Vision System ◽

Region Of Interest ◽

Detection And Tracking ◽

Novel Approach ◽

Ip Camera ◽

Pros And Cons ◽

Real World Problems

Unraveling meaningful pattern form the video offers a solution to many real-world problems, especially surveillance and security. Detecting and tracking an object under the area of video surveillance, not only automates the security but also leverages smart nature of the buildings. The objective of the manuscript is to detect and track assets inside the building using vision system. In this manuscript, the strategies involved in asset detection and tracking are discussed with their pros and cons. In addition to it, a novel approach has been proposed that detects and tracks the object of interest across all the frames using correlation coefficient. The proposed approach is said to be significant since the user has an option to select the object of interest from any two frames in the video and correlation coefficient is calculated for the region of interest. Based on the arrived correlation coefficient the object of interest is tracked across the rest of the frames. Experimentation is carried out using the 10 videos acquired from IP camera inside the building.

Download Full-text

Artificial Vision Algorithms for Socially Assistive Robot Applications: A Review of the Literature

Sensors ◽

10.3390/s21175728 ◽

2021 ◽

Vol 21 (17) ◽

pp. 5728

Author(s):

Victor Manuel Montaño-Serrano ◽

Juan Manuel Jacinto-Villegas ◽

Adriana Herlinda Vilchis-González ◽

Otniel Portillo-Rodríguez

Keyword(s):

Computer Vision ◽

Processing Speed ◽

General Information ◽

Artificial Vision ◽

Review Of The Literature ◽

Status Monitoring ◽

Assistive Robot ◽

The One ◽

Socially Assistive Robot ◽

And Robotics

Today, computer vision algorithms are very important for different fields and applications, such as closed-circuit television security, health status monitoring, and recognizing a specific person or object and robotics. Regarding this topic, the present paper deals with a recent review of the literature on computer vision algorithms (recognition and tracking of faces, bodies, and objects) oriented towards socially assistive robot applications. The performance, frames per second (FPS) processing speed, and hardware implemented to run the algorithms are highlighted by comparing the available solutions. Moreover, this paper provides general information for researchers interested in knowing which vision algorithms are available, enabling them to select the one that is most suitable to include in their robotic system applications.

Download Full-text

A novel approach to control the Jointed Arm Robot by tracking the position of the moving object on a conveyor using an Integrated Computer Vision system

Journal of Engineering Research ◽

10.36909/jer.10509 ◽

2021 ◽

Author(s):

Pramod Kumar Thotapalli ◽

◽

CH. R. Vikram Kumar ◽

B.ChandraMohana Reddy ◽

◽

...

Keyword(s):

Computer Vision ◽

Gaussian Mixture Model ◽

Mixture Model ◽

Moving Objects ◽

Vision System ◽

Autonomous Systems ◽

Gaussian Mixture ◽

Vital Role ◽

Work Cell ◽

Novel Approach

Computer vision algorithms play a vital role in developing self-sustained autonomous systems. The objective of the present work is to integrate the robotic system with a moving conveyor using a single camera by adopting a Gaussian Mixture Model (GMM) based background subtraction method. In this work, a simple web camera is placed above the work cell to capture the continuous images of the moving objects on the conveyor along with a jointed arm robot are connected to a microcontroller through the computer. The position of the object with time and its features are extracted from the captured image frames by subtracting its background using the Gaussian Mixture Model (GMM). The output images of GMM are further processed by image processing techniques to extract the features like shape, color, center coordinates. The extracted coordinates of objects of interest are used as input parameters to the controller to activate the base rotation of a joint arm robot to perform different manipulations. The developed algorithm is evaluated on an indigenously fabricated work cell integrated with a computer vision setup.

Download Full-text

The influence of a socially assistive robot on mood, anxiety, and arousal in children.

Professional Psychology Research and Practice ◽

10.1037/pro0000177 ◽

2018 ◽

Vol 49 (1) ◽

pp. 48-56 ◽

Cited By ~ 14

Author(s):

Molly K. Crossman ◽

Alan E. Kazdin ◽

Elizabeth R. Kitt

Keyword(s):

Assistive Robot ◽

Socially Assistive Robot

Download Full-text

Modern Technology for Image processing and Computer vision -A Review

Journal of Advanced Sciences and Engineering Technologies ◽

10.32441/jaset.v1i2.178 ◽

2018 ◽

Vol 1 (2) ◽

pp. 17-23

Author(s):

Takialddin Al Smadi

Keyword(s):

Image Processing ◽

Computer Vision ◽

Augmented Reality ◽

Video Compression ◽

Video Processing ◽

Vision System ◽

Citrus Fruit ◽

Modern Technology ◽

Image And Video Processing ◽

Depth Video

This survey outlines the use of computer vision in Image and video processing in multidisciplinary applications; either in academia or industry, which are active in this field.The scope of this paper covers the theoretical and practical aspects in image and video processing in addition of computer vision, from essential research to evolution of application.In this paper a various subjects of image processing and computer vision will be demonstrated ,these subjects are spanned from the evolution of mobile augmented reality (MAR) applications, to augmented reality under 3D modeling and real time depth imaging, video processing algorithms will be discussed to get higher depth video compression, beside that in the field of mobile platform an automatic computer vision system for citrus fruit has been implemented ,where the Bayesian classification with Boundary Growing to detect the text in the video scene. Also the paper illustrates the usability of the handed interactive method to the portable projector based on augmented reality. © 2018 JASET, International Scholars and Researchers Association

Download Full-text

A Novel Approach to Upper Extremity Amputation to Augment Volitional Control and Restore Proprioception

Case Medical Research ◽

10.31525/ct1-nct03882073 ◽

2019 ◽

Author(s):

Keyword(s):

Upper Extremity ◽

Volitional Control ◽

Novel Approach ◽

Extremity Amputation

Download Full-text

Measurement of Gem Colour Using a Computer Vision System: A Case Study with Jadeite-Jade

Minerals ◽

10.3390/min11080791 ◽

2021 ◽

Vol 11 (8) ◽

pp. 791

Author(s):

Sufei Zhang ◽

Ying Guo

Keyword(s):

Computer Vision ◽

Regression Model ◽

Vision System ◽

Expert Group ◽

Group Test ◽

System A ◽

Real Objects ◽

Practical Tool ◽

Almost All

This paper introduces computer vision systems (CVSs), which provides a new method to measure gem colour, and compares CVS and colourimeter (CM) measurements of jadeite-jade colour in the CIELAB space. The feasibility of using CVS for jadeite-jade colour measurement was verified by an expert group test and a reasonable regression model in an experiment involving 111 samples covering almost all jadeite-jade colours. In the expert group test, more than 93.33% of CVS images are considered to have high similarities with real objects. Comparing L*, a*, b*, C*, h, and ∆E* (greater than 10) from CVS and CM tests indicate that significant visual differences exist between the measured colours. For a*, b*, and h, the R2 of the regression model for CVS and CM was 90.2% or more. CVS readings can be used to predict the colour value measured by CM, which means that CVS technology can become a practical tool to detect the colour of jadeite-jade.

Download Full-text