scholarly journals Leveraging video data from a digital smartphone autism therapy to train an emotion detection classifier

Author(s):  
Cathy Hou ◽  
Haik Kalantarian ◽  
Peter Washington ◽  
Kaiti Dunlap ◽  
Dennis P. Wall

Autism spectrum disorder (ASD) is a neurodevelopmental disorder affecting one in 40 children in the United States and is associated with impaired social interactions, restricted interests, and repetitive behaviors. Previous studies have demonstrated the promise of applying mobile systems with real-time emotion recognition to autism therapy, but existing platforms have shown limited performance on videos of children with ASD. We propose the development of a new emotion classifier designed specifically for pediatric populations, trained with images crowdsourced from an educational mobile charades-style game: Guess What?. We crowdsourced the acquisition of videos of children portraying emotions during remote game sessions of Guess What? that yielded 6,344 frames from fifteen subjects. Two raters manually labeled the frames with four of the Ekman universal emotions (happy, scared, angry, sad), a neutral class, and n/a for frames with an indeterminable label. The data were pre-processed, and a model was trained with a transfer-learning and neural-architecture-search approach using the Google Cloud AutoML Vision API. The resulting classifier was evaluated against existing approaches (Azure Face API from Microsoft and Rekognition from Amazon Web Services) using the standard metrics of F1 score. The resulting classifier demonstrated superior performance across all evaluated emotions, supporting our hypothesis that a model trained with a pediatric dataset would outperform existing emotion-recognition approaches for the population of interest. These results suggest a new strategy to develop precision therapy for autism at home by integrating the model trained with a personalized dataset to the mobile game.

Cells ◽  
2020 ◽  
Vol 9 (11) ◽  
pp. 2500
Author(s):  
Marta Garcia-Forn ◽  
Andrea Boitnott ◽  
Zeynep Akpinar ◽  
Silvia De Rubeis

Autism spectrum disorder (ASD) is a prevalent neurodevelopmental disorder characterized by impairments in social communication and social interaction, and the presence of repetitive behaviors and/or restricted interests. In the past few years, large-scale whole-exome sequencing and genome-wide association studies have made enormous progress in our understanding of the genetic risk architecture of ASD. While showing a complex and heterogeneous landscape, these studies have led to the identification of genetic loci associated with ASD risk. The intersection of genetic and transcriptomic analyses have also begun to shed light on functional convergences between risk genes, with the mid-fetal development of the cerebral cortex emerging as a critical nexus for ASD. In this review, we provide a concise summary of the latest genetic discoveries on ASD. We then discuss the studies in postmortem tissues, stem cell models, and rodent models that implicate recently identified ASD risk genes in cortical development.


2012 ◽  
Vol 14 (3) ◽  
pp. 293-305 ◽  

Autism is a neurodevelopmental disorder whose diagnosis is based on three behavioral criteria: unusual reciprocal social interactions, deficits in communication, and stereotyped repetitive behaviors with restricted interests. A large number of de novo single gene mutations and chromosomal deletions are associated with autism spectrum disorders. Based on the strong genetic evidence, mice with targeted mutations in homologous genes have been generated as translational research tools. Mouse models of autism have revealed behavioral and biological outcomes of mutations in risk genes. The field is now poised to employ the most robust phenotypes in the most replicable mouse models for preclinical screening of novel therapeutics.


2020 ◽  
Author(s):  
Nisim Perets ◽  
Oded Oron ◽  
Shay Herman ◽  
Evan Elliott ◽  
Daniel Offen

Abstract Autism Spectrum Disorder (ASD) is a neurodevelopmental disorder with main core symptoms including deficits in social-communication abilities and repetitive behaviors/restricted interests. ASD affects 1 of 88 children worldwide and currently there is no sufficiently effective treatment that alleviates its core deficits. In our previous studies, we have shown that both MSC and MSC-exo can ameliorate core ASD-like symptoms of the BTBR multifactorial mouse model of autism. Furthermore, we have demonstrated that the MSC-exo migrate to distinct neuropathological areas in several mouse models, including the frontal cortex and cerebellum in BTBR mice. In contrast to BTBR mice, which is a multifactorial model of autism, the Shank3B KO mouse is used to study ASD which develops due to a specific genetic mutation. Here we demonstrate that intranasal treatment with MSC-exo improves the social behavior deficit in multiple paradigms, increases vocalization and reduces repetitive behaviors. We also observed an increase of GABRB1 in the prefrontal cortex. Taken together, our data indicate that intranasal treatment with MSC-exo improves the core ASD-like deficits of in this mouse model autism and therefore has the potential to treat ASD patients carrying the Shank3 mutation.


2019 ◽  
Author(s):  
Naomi V. Ekas ◽  
◽  
Abdallah M. Badahdah ◽  
Azza O. Abdelmoneium

Autism is a lifelong neurodevelopmental disorder that affects approximately 1% of children worldwide. Children with autism have difficulties in social interactions and communication and often engage in repetitive behaviors or have restricted interests (American Psychiatric Association, 2013). As a result of their child’s autism diagnosis, parents of children with autism often experience increased stress and poorer psychological well-being. Moreover, relationships within the family (e.g., marital relationship) may be negatively impacted. Addressing the needs of family members, particularly parents, is critical, as decades of research have shown that parents’ psychological well-being can affect the way that parents interact with their children. These interactional patterns can, in turn, impact children’s development in many of the areas that are affected by autism, including the social and emotional, language, and cognitive domains. The government of Qatar has recently taken steps to address the needs of children with autism and their families. The overarching aim of the Qatar National Autism Plan is to improve the lives of individuals with autism and their families. The six pillars of the National Autism Plan are designed to address the needs of individuals with autism and their families in areas such as raising awareness about autism, receiving early diagnosis, and accessing treatment and education. Once these needs are met, it is likely that the families of children with autism in Qatar can flourish. However, there are likely to be other challenges and unmet needs that the National Autism Plan does not address, and it was with this in mind that this first comprehensive study of families of children with autism in Qatar was undertaken.


2008 ◽  
Vol 14 (6) ◽  
pp. 967-979 ◽  
Author(s):  
TRACEY A. KNAUS ◽  
ANDREW M. SILVER ◽  
KRISTEN A. LINDGREN ◽  
NOUCHINE HADJIKHANI ◽  
HELEN TAGER-FLUSBERG

AbstractAutism spectrum disorder (ASD) is a neurodevelopmental disorder characterized by language and communication impairments, social impairments, and repetitive behaviors or restricted interests. Previous studies of semantic functions have found differences in semantic processing and differences in the activation of the language network in adults with ASD compared to controls. The goal of this study is to examine semantic functions in adolescents with ASD compared to typically developing adolescents. We utilized fMRI with a reading version of a response-naming task to investigate activation in 12 right-handed adolescent boys with ASD and 12 typically developing boys. Both groups performed the task at ceiling levels. Boys with ASD had significantly stronger activation than controls in Broca's area, which was less left lateralized in ASD individuals. Controls had a significant correlation between frontal and temporal language area activation in the left hemisphere, whereas ASD adolescents did not. Direct group comparisons revealed additional regions activated in the ASD group relative to the control group. These results suggest differences in semantic organization, approaches to the semantic task, or efficiency in semantic processing in ASD adolescents relative to typically developing adolescents. (JINS, 2008,14, 967–979.)


2017 ◽  
Author(s):  
Ernest Pedapati ◽  
Jacob Shaffer

Autism spectrum disorder (ASD) is a complex neurodevelopmental disorder marked by impairments in social behavior and difficulties with repetitive and restrictive behaviors. In 2012, the prevalence of ASD in the United States was estimated to be one in 68 among children age 8 years. Although the etiology of ASD is poorly understood, many researchers have identified genetic, epigenetic, and environmental factors likely involved in the disorder. In approximately 10% of cases, a definitive association with a specific genetic defect can be identified. A diagnosis of ASD is best performed through an interdisciplinary assessment and is based on diagnostic criteria. The DSM-5 criteria on the clinical features of ASD fall into two core domains: impaired social communication and interaction and restricted, repetitive behaviors, interests, or activities. Today, although no definitive “cure” for ASD exists, state-of-the-art therapies and learning environments, along with medications, have resulted in reducing disease burden and quality of life for individuals affected by ASD. This review contains 3 figures, 2 tables, and 86 references. Key words: autism spectrum disorders, developmental disorders, language speech delay, social communication


2020 ◽  
Vol 27 (40) ◽  
pp. 6771-6786
Author(s):  
Geir Bjørklund ◽  
Nagwa Abdel Meguid ◽  
Maryam Dadar ◽  
Lyudmila Pivina ◽  
Joanna Kałużna-Czaplińska ◽  
...  

As a major neurodevelopmental disorder, Autism Spectrum Disorder (ASD) encompasses deficits in communication and repetitive and restricted interests or behaviors in childhood and adolescence. Its etiology may come from either a genetic, epigenetic, neurological, hormonal, or an environmental cause, generating pathways that often altogether play a synergistic role in the development of ASD pathogenesis. Furthermore, the metabolic origin of ASD should be important as well. A balanced diet consisting of the essential and special nutrients, alongside the recommended caloric intake, is highly recommended to promote growth and development that withstand the physiologic and behavioral challenges experienced by ASD children. In this review paper, we evaluated many studies that show a relationship between ASD and diet to develop a better understanding of the specific effects of the overall diet and the individual nutrients required for this population. This review will add a comprehensive update of knowledge in the field and shed light on the possible nutritional deficiencies, metabolic impairments (particularly in the gut microbiome), and malnutrition in individuals with ASD, which should be recognized in order to maintain the improved socio-behavioral habit and physical health.


Foods ◽  
2020 ◽  
Vol 10 (1) ◽  
pp. 49
Author(s):  
Hae Jin Park ◽  
Su Jin Choi ◽  
Yuri Kim ◽  
Mi Sook Cho ◽  
Yu-Ri Kim ◽  
...  

Autism spectrum disorder (ASD) is a neurodevelopmental disorder characterized by a lack of social communication and restrictive, repetitive behaviors or interests. This study aimed to examine the mealtime behaviors and food preferences of students with ASD. An online questionnaire on mealtime behavior and food preferences of ASD students was conducted by caregivers including parents, and the average age of ASD students was 14.1 ± 6.1. The analysis of mealtime behavior resulted in classification into three clusters: cluster 1, the “low-level problematic mealtime behavior group”; cluster 2, the “mid-level problematic mealtime behavior group”; and cluster 3, the “high-level problematic mealtime behavior group”. Cluster 1 included older students than other clusters and their own specific dietary rituals. Meanwhile, cluster 3 included younger students than other clusters, high-level problematic mealtime behavior, and a low preference for food. In particular, there were significant differences in age and food preference for each subdivided ASD group according to their eating behaviors. Therefore, the content and method of nutrition education for ASD students’ needs a detailed approach according to the characteristics of each group.


2021 ◽  
Vol 13 (1) ◽  
Author(s):  
Robin Sifre ◽  
Daniel Berry ◽  
Jason J. Wolff ◽  
Jed T. Elison

Abstract Background Restricted and repetitive behaviors (RRBs) are core features of autism spectrum disorder (ASD) and one of the earliest behavioral signs of ASD. However, RRBs are also present in typically developing (TD) infants, toddlers, and preschool-aged children. Past work suggests that examining change in these behaviors over time is essential to distinguish between normative manifestations of these behaviors and behaviors that denote risk for a neurodevelopmental disorder. One challenge in examining changes in these behaviors over time is that most measures of RRBs have not established longitudinal measurement invariance. The aims of this study were to (1) establish measurement invariance in the Repetitive Behavior Scales for Early Childhood (RBS-EC), a parent-report questionnaire of RRBs, and (2) model developmental change in RRBs from 8 to 36 months. Methods We collected RBS-EC responses from parents of TD infants (n = 180) from 8 to 36 months (n = 606 responses, with participants contributing an average of 3-time points). We leverage a novel methodological approach to measurement invariance testing (Bauer, Psychological Models, 22(3), 507–526, 2017), moderated nonlinear factor analysis (MNLFA), to determine whether the RBS-EC was invariant across age and sex. We then generated adjusted factor score estimates for each subscale of the RBS-EC (repetitive motor, self-directed, and higher-order behaviors), and used linear mixed effects models to estimate between- and within-person changes in the RBS-EC over time. Results The RBS-EC showed some non-invariance as a function of age. We were able to adjust for this non-invariance in order to more accurately model changes in the RBS-EC over time. Repetitive motor and self-directed behaviors showed a linear decline from 8 to 36 months, while higher-order behaviors showed a quadratic trajectory such that they began to decline later in development at around 18 months. Using adjusted factor scores as opposed to unadjusted raw mean scores provided a number of benefits, including increased within-person variability and precision. Conclusions The RBS-EC is sensitive enough to measure the presence of RRBs in a TD sample, as well as their decline with age. Using factor score estimates of each subscale adjusted for non-invariance allowed us to more precisely estimate change in these behaviors over time.


Author(s):  
Wei-Ju Chen ◽  
Zihan Zhang ◽  
Haocen Wang ◽  
Tung-Sung Tseng ◽  
Ping Ma ◽  
...  

Background: Autism spectrum disorder (ASD) is a neurodevelopmental disorder characterized by social communication deficits and restricted or repetitive behaviors. Parental perceptions of the etiology of their child’s ASD can affect provider–client relationships, bonding between parents and their children, and the prognosis, treatment, and management of children with ASD. Thus, this study sought to examine the perceptions of ASD etiology of parents of children with ASD. Methods: Forty-two parents of children diagnosed with ASD were recruited across Texas. Semi-structured interviews were conducted individually. All interviews were recorded and later transcribed verbatim for content analysis utilizing NVivo 12.0 (QSR International, Doncaster, Australia). Results: The content analysis identified the following themes regarding parental perceptions of ASD etiology: Genetic factors (40.5%), environmental factors (31.0%), problems that occurred during pregnancy or delivery (23.8%), vaccinations (16.7%), other health problems (7.1%), parental age at the time of pregnancy (4.8%), and spiritual or religious factors (2.4%). Conclusions: The parental perceptions of ASD etiology were diverse, but several views, such as vaccinations and spiritual or religious factors, were not based on scientific evidence. Health professionals and researchers can use these findings to develop and provide targeted education to parents who have children with ASD. Our findings also support policymakers in developing campaigns designed to increase parental ASD awareness and knowledge.


Sign in / Sign up

Export Citation Format

Share Document