Development and Application of Leader Identification Model Using Multimodal Information in Multi-Party Conversations

Author(s):  
Tsukasa Shiota ◽  
Kouki Honda ◽  
Kazutaka Shimada ◽  
Takeshi Saitoh

Predicting the roles of participants in conversations is a fundamental task to build a system that provides assessment results and feedback for each participant. Various role recognition models have been proposed. Nonetheless, most studies have only utilized verbal or nonverbal features even though people usually express what they think or feel with the combination of language, gestures, and tone of voice. In this paper, we aim to realize a high-performance role recognition model by combining features from various modalities. We design nonverbal features that can be extracted from video and audio data. Then, we construct a multimodal leader identification method that fuses nonverbal features proposed by us and verbal features proposed by a previous study. In our experiments, our multimodal model outperforms the baseline model that utilizes only verbal features. We also conduct some analysis, such as statistical tests and ablation studies, and verify the effectiveness of each modality and feature. In the end, we build a prototype of a feedback system and demonstrate how our study can be applied to the discussion assessment/feedback systems.

2018 ◽  
Vol 9 (03) ◽  
pp. 20553-20562
Author(s):  
Putu Ayu Diah Juliarti ◽  
Anak Agung Putu Agung ◽  
I Nengah Sudja

An employee who has a high performance and better able to support the achievement of the goals and objectives set by the company. Employees can work well if you have a high performance that can produce good work anyway. With the high- performance that employees, is expected to achieve organizational goals. This study examines the effect of compensation and work environment on employee performance with job satisfaction to be intervening variable. Data on compensation, work environment, job satisfaction, and employee performance obtained through observation, record keeping and questioner with respondents. The data obtained are then analyzed using Partial Least Squares (PLS). Statistical tests results showed  (1) the compensation proved significant positive effect on job satisfaction the path coefficient of 0.434 and T-Stats for 4.880, (2) work environment proved to be a significant positive effect on job satisfaction the path coefficient of 0.434 and T-Stats for 4.074, (3) job satisfaction proved to be a significant positive effect on employee performance the path coefficient of 0.264 and T-Stats for 2.458, (4) compensation proved positive and significant effect employee performance the path coefficient of 0.242 and T-Stats for 2.912, (5) work environment proved positive and significant effect employee performance the path coefficient of 0.378 and T-Stats for 3.343. Based on test results obtained statistical results of all variables positive and signicant impact.


2020 ◽  
Vol 38 (9A) ◽  
pp. 1342-1351
Author(s):  
Musadaq A. Hadi ◽  
Hazem I. Ali

In this paper, a new design of the model reference control scheme is proposed in a class of nonlinear strict-feedback system. First, the system is analyzed using Lyapunov stability analysis. Next, a model reference is used to improve system performance. Then, the Integral Square Error (ISE) is considered as a cost function to drive the error between the reference model and the system to zero. After that, a powerful metaheuristic optimization method is used to optimize the parameters of the proposed controller. Finally, the results show that the proposed controller can effectively compensate for the strictly-feedback nonlinear system with more desirable performance.


2017 ◽  
Vol 8 (1) ◽  
pp. 14-17
Author(s):  
Farhana Noman ◽  
AKM Asaduzzaman ◽  
Humayun Kabir Talukder ◽  
ASM Shamsul Arefin ◽  
Shamima Rahman

This study aimed to evaluate the current status of the internship assessment in medical colleges of Bangladesh. Internship acts as the pathway from being a medical student to becoming a registered doctor. Hence, a rigorous and robust internship leads to producing better doctor and in turn better healthcare. Thus, proper assessment is necessary to ensure the quality of the future medical practitioners. Unfortunately, no study has been done in Bangladesh related to this context. A cross-sectional descriptive study with pre-tested self-administered questionnaires covering study place and population and factors relevant to intern assessment (assessment after each major discipline completion, assessment techniques, and feedback) was performed. The study was carried out in 8 medical colleges (4 public and 4 non-government; 4 inside Dhaka and 4 outside). 300 completed questionnaires (250 interns, 50 supervisors) were analyzed. All the collected data were analyzed and presented with SPSS v 19.0 software. Results revealed that there was no assessment present after completion of major placement rotation (about 54% interns and 24% teachers). Furthermore, only logbook was signed as the prevailing assessment technique (more than 66% interns and 72% doctors). Moreover, assessment feedback system was not fully functional (48.7% respondent views). Hence, the overall scenario is shabby and poses questions on our future doctors' skill set.Bangladesh Journal of Medical Education Vol.8(1) 2017: 14-17


2000 ◽  
Author(s):  
Wei Wu ◽  
Suhada Jayasuriya

Abstract In this paper, we consider the sufficient and/or necessary conditions under which responses of unstable plants with zero initial conditions would be bounded under step inputs. Several possible unstable pole patterns are examined, and corresponding criteria are derived. It is shown that an unstable plant can be stabilized to have bounded responses using an alternate step input sequence. Step inputs simulate the saturated inputs in a feedback system with bounded control, where the closed-loop stability of an unstable plant is really difficult to study. Results from this open-loop study may lend some insight into the analysis and design of such feedback systems under input saturation nonlinearities.


2019 ◽  
Author(s):  
Bria Long ◽  
Patrick Wong ◽  
Michael C. Frank ◽  
Eva Lai ◽  
Peggy Chan ◽  
...  

Play is a universal behavior that is thought to be a critical way for children to learn a wide range of motor, social, and language skills. Empirical studies of play have borne out some of the predictions of classical theories, showing that children preferentially engage with surprising stimuli, will play in order to learn, and generally show a similar progression of increasingly-complex play behaviors through infancy. Past research has also characterized the types of support and guidance that parents offer during guided play with their child, as distinguished from individual free play. However, most of these studies come from Western nations, and relatively few cross-cultural comparisons have been made, despite observations of wide variability in cultural play traditions. The goal of this study is to examine the variability and consistency of play behaviors in a large sample of 1–2-year-old children—a critical period in the development of play behaviors—in two cultural contexts: the United States and Hong Kong. Our investigation covers both individual and guided play, with measures related to joint attention, stereotypical play behaviors, language use, and types of support offered by caregivers during guided play. This rich, annotated corpus of video and audio data also provides an important resource for research on early play.


Author(s):  
Andreas M. Kist ◽  
Pablo Gómez ◽  
Denis Dubrovskiy ◽  
Patrick Schlegel ◽  
Melda Kunduk ◽  
...  

Purpose High-speed videoendoscopy (HSV) is an emerging, but barely used, endoscopy technique in the clinic to assess and diagnose voice disorders because of the lack of dedicated software to analyze the data. HSV allows to quantify the vocal fold oscillations by segmenting the glottal area. This challenging task has been tackled by various studies; however, the proposed approaches are mostly limited and not suitable for daily clinical routine. Method We developed a user-friendly software in C# that allows the editing, motion correction, segmentation, and quantitative analysis of HSV data. We further provide pretrained deep neural networks for fully automatic glottis segmentation. Results We freely provide our software Glottis Analysis Tools (GAT). Using GAT, we provide a general threshold-based region growing platform that enables the user to analyze data from various sources, such as in vivo recordings, ex vivo recordings, and high-speed footage of artificial vocal folds. Additionally, especially for in vivo recordings, we provide three robust neural networks at various speed and quality settings to allow a fully automatic glottis segmentation needed for application by untrained personnel. GAT further evaluates video and audio data in parallel and is able to extract various features from the video data, among others the glottal area waveform, that is, the changing glottal area over time. In total, GAT provides 79 unique quantitative analysis parameters for video- and audio-based signals. Many of these parameters have already been shown to reflect voice disorders, highlighting the clinical importance and usefulness of the GAT software. Conclusion GAT is a unique tool to process HSV and audio data to determine quantitative, clinically relevant parameters for research, diagnosis, and treatment of laryngeal disorders. Supplemental Material https://doi.org/10.23641/asha.14575533


2002 ◽  
Vol 12 (1) ◽  
pp. 25-33
Author(s):  
K.J. Chen ◽  
E.A. Keshner ◽  
B.W. Peterson ◽  
T.C. Hain

Control of the head involves somatosensory, vestibular, and visual feedback. The dynamics of these three feedback systems must be identified in order to gain a greater understanding of the head control system. We have completed one step in the development of a head control model by identifying the dynamics of the visual feedback system. A mathematical model of human head tracking of visual targets in the horizontal plane was fit to experimental data from seven subjects performing a visual head tracking task. The model incorporates components based on the underlying physiology of the head control system. Using optimization methods, we were able to identify neural processing delay, visual control gain, and neck viscosity parameters in each experimental subject.


2020 ◽  
Vol 2020 ◽  
pp. 1-11
Author(s):  
Cheng He ◽  
Jian Wu ◽  
Jin Ying ◽  
Jiyang Dai ◽  
Zhe Zhang ◽  
...  

In order to solve the problem of unknown parameter drift in the nonlinear pure-feedback system, a novel nonlinear pure-feedback system is proposed in which an unconventional coordinate transformation is introduced and a novel unconventional dynamic surface algorithm is designed to eliminate the problem of “calculation expansion” caused by the use of backstepping in the pure-feedback system. Meanwhile, a sufficiently smooth projection algorithm is introduced to suppress the parameter drift in the nonlinear pure-feedback system. Simulation experiments demonstrate that the designed controller ensures the global and ultimate boundedness of all signals in the closed-loop system and the appropriate designed parameters can make the tracking error arbitrarily small.


Sign in / Sign up

Export Citation Format

Share Document