scholarly journals The Recognition of Teacher Behavior Based on Multimodal Information Fusion

2020 ◽  
Vol 2020 ◽  
pp. 1-8
Author(s):  
Dongli Wu ◽  
Jia Chen ◽  
Wei Deng ◽  
Yantao Wei ◽  
Heng Luo ◽  
...  
Keyword(s):  
Information Fusion ◽  
Information Overload ◽  
Recognition Accuracy ◽  
Teacher Behavior ◽  
Important Research Topic ◽  
Multimodal Information Fusion ◽  
Long Time ◽  
Teaching Efficiency ◽  
Data Source ◽  
Teaching Video

Teaching reflection based on videos is the main method in teacher education and professional development. However, it takes a long time to analyse videos, and teachers are easy to fall into the state of information overload. With the development of “AI + education,” automatic recognition of teacher behavior to support teaching reflection has become an important research topic. In this paper, taking online open classroom teaching video as the data source, we collected and constructed a teacher behavior dataset. Using this dataset, we explored the behavior recognition methods based on RGB video and skeleton information, and the information fusion between them is carried out to improve the recognition accuracy. The experimental results show that the fusion of RGB information and skeleton information can improve the recognition accuracy, and the early-fusion effect is better than the late-fusion effect. This study helps to solve the problems of time-consumption and information overload in teaching reflection and then helps teachers to optimize the teaching strategies and improve the teaching efficiency.

scholarly journals UPACARA NGABEN NINGKEB DI BANJAR KEBON DESA PAKRAMAN BLAHBATUH KECAMATAN BLAHBATUH KABUPATEN GIANYAR (Kajian Filosofis)

2017 ◽  
Vol 1 (2) ◽  
pp. 472
Author(s):  
Ni Luh Putu Yulia Sukma Yanti
Keyword(s):  
Qualitative Research ◽  
Secondary Data ◽  
Primary Data ◽  
Return Function ◽  
Primary Data Source ◽  
Long Time ◽  
Data Source ◽  
Structural Functionalism ◽  
Religious Theory ◽  
Structural Functionalism Theory

<p><em>Ngaben Ningkeb interpreted Ngaben ceremony that ended in a reversed way or called Ningkeb.Fenomena background researcher to examine the problems about the implementation of Ngaben Ningkeb Ceremony with the formulation of the problem include: 1). How is the Ngompen Ningkeb Ceremony Procession in Banjar Kebon, Pakraman Blahbatuh Village, Blahbatuh District, Gianyar Regency? 2). What is the function of Ngaben Ningkeb Ceremony in Banjar Kebon, Pakraman Blahbatuh Village, Blahbatuh District, Gianyar Regency? 3). What is the philosophical meaning contained in Ngompen Ningkeb Ceremony at Banjar Kebon, Pakraman Blahbatuh Village, Blahbatuh District, Gianyar Regency? With the aim of research can implement the science of religion obtained in the life of the community and know in general about the Procession, Functions and Meaning philosophical related Ngaben Ningkeb Ceremony.</em></p><p><em>This research is discussed using several theories, among others, Religious Theory, is used because this research includes the research of Religion, Structural Functionalism Theory, used to dissect the problems related to Ngaben Ningkeb Ceremony, and Symbol Theory, is used to study the meaning of Philosophy. This type of research is qualitative research with primary data source from the field that is by observation and interview while secondary data obtained through documentation technique.</em></p><p><em>The results of the study as follows: 1). A. The initial procession Ngaben ningkeb ceremony, among others: Nyamuh, Matur Piuning, Mapajati, Ngulapin and Nyiramin. B. Ningkeb peak procession among others: Nedunin Sawa, Towards Setra, Sprinkle various types Tirta, Ngeseng Sawa, and last Ningkeb. C. The process after the implementation of Ngaben Ningkeb, among others: Mapegat and Mecaru. 2). Function Ceremony Ngaben Ningkeb include: A. Sustainability Function, where Ngingken ningkeb ceremony can be practically can be a ceremony that deserves to be preserved because in every process is something sacred and different with Ngaben in general. B. The return function of Sanghyang Panca Mahabhuta, which outlines the elements of Panca Mahabhuta in this great realm and usher Atma (Spirit) into Pitra nature by deciding Atma's love with his world. C. Purgatory function, in this case, purification is intended as a main foundation that should be put forward in the process Ngaben ningkeb ceremony. 3). And the meaning contained in Ngingken ningkeb ceremony is a philosophical meaning, where the conception of sarira is used as the meaning of philosophy Ngaben ningkeb is the conception of Sarira according to Wrhaspati Tattwa. And the meaning of Return Panca Mahabhuta, where basically all will return by itself although not done ceremony Ngaben, but it takes a very long time, hence from cultivated to return by cremation (Ngaben).</em></p>

scholarly journals Audiovisual Emotion Recognition Using Entropy-estimation-based Multimodal Information Fusion

2021 ◽  
Author(s):  
Zhibing Xie
Keyword(s):  
Human Computer Interaction ◽  
Emotion Recognition ◽  
Information Fusion ◽  
Score Level Fusion ◽  
Information Theoretic ◽  
Multimodal Information Fusion ◽  
Multimodal Information ◽  
Feature Level Fusion ◽  
Level Fusion ◽  
Computer Interaction

Understanding human emotional states is indispensable for our daily interaction, and we can enjoy more natural and friendly human computer interaction (HCI) experience by fully utilizing human’s affective states. In the application of emotion recognition, multimodal information fusion is widely used to discover the relationships of multiple information sources and make joint use of a number of channels, such as speech, facial expression, gesture and physiological processes. This thesis proposes a new framework of emotion recognition using information fusion based on the estimation of information entropy. The novel techniques of information theoretic learning are applied to feature level fusion and score level fusion. The most critical issues for feature level fusion are feature transformation and dimensionality reduction. The existing methods depend on the second order statistics, which is only optimal for Gaussian-like distributions. By incorporating information theoretic tools, a new feature level fusion method based on kernel entropy component analysis is proposed. For score level fusion, most previous methods focus on predefined rule based approaches, which are usually heuristic. In this thesis, a connection between information fusion and maximum correntropy criterion is established for effective score level fusion. Feature level fusion and score level fusion methods are then combined to introduce a two-stage fusion platform. The proposed methods are applied to audiovisual emotion recognition, and their effectiveness is evaluated by experiments on two publicly available audiovisual emotion databases. The experimental results demonstrate that the proposed algorithms achieve improved performance in comparison with the existing methods. The work of this thesis offers a promising direction to design more advanced emotion recognition systems based on multimodal information fusion and has great significance to the development of intelligent human computer interaction systems.

scholarly journals Extending Appearance Based Gait Recognition with Depth Data

2019 ◽  
Vol 9 (24) ◽  
pp. 5529
Author(s):  
Kristijan Lenac ◽  
Diego Sušanj ◽  
Adnan Ramakić ◽  
Domagoj Pinčić
Keyword(s):  
Information Fusion ◽  
Recognition Accuracy ◽  
Gait Recognition ◽  
Computational Cost ◽  
Video Stream ◽  
Depth Data ◽  
Video Images ◽  
Extraction Step ◽  
Different Types ◽  
Subject Identification

Each individual describes unique patterns during their gait cycles. This information can be extracted from the live video stream and used for subject identification. In appearance based recognition methods, this is done by tracking silhouettes of persons across gait cycles. In recent years, there has been a profusion of sensors that in addition to RGB video images also provide depth data in real-time. When such sensors are used for gait recognition, existing RGB appearance based methods can be extended to get a substantial gain in recognition accuracy. In this paper, this is accomplished using information fusion techniques that combine features from extracted silhouettes, used in traditional appearance based methods, and the height feature that can now be estimated using depth data. The latter is estimated during the silhouette extraction step with minimal additional computational cost. Two approaches are proposed that can be implemented easily as an extension to existing appearance based methods. An extensive experimental evaluation was performed to provide insights into how much the recognition accuracy can be improved. The results are presented and discussed considering different types of subjects and populations of different height distributions.

Multimodal information fusion based on LSTM for 3D model retrieval

2020 ◽  
Vol 79 (45-46) ◽  
pp. 33943-33956
Author(s):  
Qi Liang ◽  
Ning Xu ◽  
Weijie Wang ◽  
Xingjian Long
Keyword(s):  
Information Fusion ◽  
3D Model ◽  
3D Model Retrieval ◽  
Multimodal Information Fusion ◽  
Multimodal Information ◽  
Model Retrieval

Evaluating exploratory visualization systems: A user study on how clustering-based visualization systems support information seeking from large document collections

2012 ◽  
Vol 12 (1) ◽  
pp. 25-43 ◽  
Author(s):  
Yujie Liu ◽  
Scott Barlowe ◽  
Yaqin Feng ◽  
Jing Yang ◽  
Min Jiang
Keyword(s):  
Information Seeking ◽  
User Study ◽  
Information Overload ◽  
Human Subjects ◽  
Scientific Discovery ◽  
Cognitive Learning ◽  
Document Collections ◽  
Important Research Topic ◽  
Visualization Systems ◽  
General Guidance

Iterative, opportunistic and evolving visual sense-making has been an important research topic as it assists users in overcoming ever-increasing information overload. Exploratory visualization systems (EVSs) maximize the amount of information users can gain through learning and have been widely used in scientific discovery and decision-making contexts. Although many EVSs have been developed recently, there is a lack of general guidance on how to evaluate such systems. Researchers face challenges such as understanding the cognitive learning process supported by these systems. In this paper, we present a formal user study on Newdle, a clustering-based EVS for large news collections, shedding light on a general methodology for EVS evaluation. Our approach is built upon cognitive load theory, which takes the user as well as the system as the focus of evaluation. The carefully designed procedures allow us to thoroughly examine the user’s cognitive process as well as control the variability among human subjects. Through this study, we analyse how and why clustering-based EVSs benefit (or hinder) users in a variety of information-seeking tasks. We also summarize leverage points for designing clustering-based EVSs.

Sign in / Sign up

Export Citation Format

Share Document