scholarly journals The Pupil Has Become the Master: Teacher-Student Model-Based Word Embedding Distillation with Ensemble Learning

2019 ◽  
Author(s):  
Bonggun Shin ◽  
Hao Yang ◽  
Jinho D. Choi
Keyword(s):  
Limited Resources ◽  
Master Teacher ◽  
Word Embeddings ◽  
Student Model ◽  
Neural Models ◽  
Single Model ◽  
The Core ◽  
Teacher Student ◽  
High Efficient ◽  
Future Direction

Recent advances in deep learning have facilitated the demand of neural models for real applications. In practice, these applications often need to be deployed with limited resources while keeping high accuracy. This paper touches the core of neural models in NLP, word embeddings, and presents an embedding distillation framework that remarkably reduces the dimension of word embeddings without compromising accuracy. A new distillation ensemble approach is also proposed that trains a high-efficient student model using multiple teacher models. In our approach, the teacher models play roles only during training such that the student model operates on its own without getting supports from the teacher models during decoding, which makes it run as fast and light as any single model. All models are evaluated on seven document classification datasets and show significant advantage over the teacher models for most cases. Our analysis depicts insightful transformation of word embeddings from distillation and suggests a future direction to ensemble approaches using neural models.

scholarly journals The Development of Tumor Neoantigen Vaccine Immunotherapy

2019 ◽  
Vol 78 ◽  
pp. 01005
Author(s):  
Wanqiu Wang
Keyword(s):  
Clinical Trial ◽  
Tumor Immunology ◽  
Somatic Mutations ◽  
Clinical Trial Data ◽  
Trial Data ◽  
Normal Cells ◽  
The Core ◽  
The World ◽  
Recent Clinical Trial ◽  
Future Direction

Activating the immune system to fight against cancers has long been a goal in immunology and oncology studies. Recent clinical-trial data proved that boosting the activity of endogenous T cells to destroy cancer cells has great potential in controlling the progression of a variety of human malignancies. In essence, neoantigen is at the core of tumor immunology. Autologous T lymphocytes could distinguish tumor cells from normal cells by recognizing neoantigens, which are tumor specific. Neoantigens are derived from genome somatic mutations of tumors, and there are different approaches to predict and identify them with increasing accuracy. Neoantigens are tumor specific, which are ideal and attractive targets for tumor immunotherapies; many neoantigen-based clinical trials are being carried out around the world. In this review, we will discuss the recent advances of tumor neoantigen vaccine immunotherapy, and present the potential obstacle and future direction of this approach.

Knowledge Transfer Strategy

2011 ◽  
pp. 90-107
Author(s):  
Robert Parent ◽  
Denis St-Jacques ◽  
Julie Bélievau
Keyword(s):  
Information Technology ◽  
Knowledge Transfer ◽  
Social Construction ◽  
Explicit Knowledge ◽  
Strategy Formulation ◽  
The Core ◽  
The Social ◽  
Tacit Knowledge Transfer ◽  
Future Direction ◽  
Human Actors

This chapter reviews recent literature on knowledge and knowledge transfer (KT) and proposes the emergence of a classification system of the core KT concepts, models, and contexts that helps address issues of a strategic nature. The two paradigms that inform most of the KT literature, the positivist and social construction paradigms, and their implications on strategy formulation, are discussed. The positivist paradigm views knowledge as an object that can be passed on mechanistically from the creator to a translator who then adapts and transmits it to the user. The social construction paradigm views knowledge as the dynamic by-product of interactions between human actors who are trying to understand, name, and act on reality. In keeping with this dual paradigm logic, the literature on KT can be categorized as originating either from an information technology paradigm or an organic paradigm. The chapter discusses how most of the past strategy-related KT issues focused on the transfer of explicit knowledge and indicates that the future direction implies a shift in attention towards more tacit knowledge transfer considerations.

scholarly journals Mathematical Modelling of Some Nutrient Losses during Heat Treatment of Stewed Apples

2009 ◽  
Vol 27 (Special Issue 1) ◽  
pp. S23-S26
Author(s):  
F. Courtois ◽  
L. Vedrenne ◽  
S. Georgé
Keyword(s):  
Experimental Data ◽  
Heat Treatment ◽  
Vitamin C ◽  
Mathematical Modelling ◽  
Transformation Process ◽  
Nutrient Losses ◽  
Single Model ◽  
First Order ◽  
The Core

Vitamin C (later noted VITC) and polyphenols (later noted PP) were regarded as main nutritional markers in the transformation process of stewed apples after an <I>in situ</I> measurement campaign at two leading French industrials on that matter. Experiments on pilots with the CTCPA of Avignon made it possible to create a small experimental data base whose treatment is the core of this article. The objective of this work is to check if the experimental data collected at the CTCPA facility can be represented by a single model of 2 separate first order reactions, with or without Arrhenius, under varying processing temperatures.

Research on the Informatization of Gas Source Management for Urban Gas Industry

2014 ◽  
Vol 543-547 ◽  
pp. 4149-4155
Author(s):  
Wei Qing Zhao
Keyword(s):  
Management System ◽  
Rapid Development ◽  
Gas Industry ◽  
The Core ◽  
Gas Source ◽  
High Efficient ◽  
Stable Growth ◽  
Production And Operation ◽  
Source Management

With the rapid development of gas enterprises in this natural gas era, lean management of production and operation (especially, upstream-downstream gas source allocation) became an important premise of their long-term stable growth. Purchase and sale of gas source are the core business of gas enterprises. To maintain a stable growth, gas enterprises have to enhance the informatization of gas source management by constructing an advanced and high-efficient gas management system. To provide useful suggestions to the construction of gas management system, this paper analyzed the characteristics of gas source management and associated businesses of gas enterprises and studied the system platform technology.

scholarly journals Mexico’s Automotive Industry: A Success Story?

2021 ◽  
Author(s):  
Jorge Carreto Sanginés ◽  
◽  
Margherita Russo ◽  
Annamaria Simonazzi ◽  
◽  
...  
Keyword(s):  
Automotive Industry ◽  
Autonomous Vehicles ◽  
Global Market ◽  
Success Story ◽  
The Core ◽  
Policy Choices ◽  
Core Country ◽  
The Us ◽  
Future Direction ◽  
Open Question

largest world producer of automotive vehicles. The Mexican experience is part of the more general case of the “integrated peripheries.” The development of these cannot be accounted for separately from the developments occurring in its core country. Unlike the core-periphery literature, however, our analysis emphasizes that the various clusters of cores and integrated peripheries are not alike. In the case under study, the core has been systematically lagging behind the main transformations pioneered by its competitors. The paper traces the evolution of the Mexican automotive industry, emphasizing the difficulties faced by a late-comer country in developing an independent industry, and the importance of policy choices as well as the macroeconomic context in affecting its development. NAFTA represents the culmination of an integration process that has profoundly transformed the structure of the Mexican automotive industry, deepening its dependence on the US market. While there is no doubt that it has contributed to the spectacular growth of the Mexican auto industry, whether it also increased its resilience or, rather, its dependence is still an open question. This issue is particularly relevant in view of the transformations that are taking place in the automotive sector and in the geopolitical scenario. These include the end of NAFTA and the advent of USMCA, the entry of powerful competitors into the global market, and the transition to electric and autonomous vehicles, which all entail risks and opportunities. The lens of the centre-periphery relationship can help to understand the present integration of North America and its future direction.

Core Seismic Experiment of a Full-Scale Single Model for a Fast Reactor

2016 ◽  
Author(s):  
Akihisa Iwasaki ◽  
Naoki Sawa ◽  
Shinichiro Matsubara ◽  
Seiji Kitamura ◽  
Shigeki Okamura
Keyword(s):  
Ambient Condition ◽  
Flowing Water ◽  
Single Model ◽  
Core Element ◽  
The Core ◽  
Vibration Behavior ◽  
Static Water ◽  
Core Elements ◽  
Vertical Displacements ◽  
Horizontal Displacements

A fast reactor core consists of several hundred core elements, which are hexagonal flexible beams embedded at the lower support plate in a hexagonal arrangement, separated by small gaps, and immersed in a fluid. Core elements have no support for vertical fixing in order to avoid the influence of thermal expansion and swelling. These days, in Japan, larger earthquake vibrations are postulated in seismic evaluations. So, it is necessary to consider vertical displacements (rising) and horizontal displacements of the core elements simultaneously because vertical seismic vibrations are larger than the acceleration of gravity. The 3D vibration behavior is affected by the fluid force of the ambient coolant and contact with the surrounding core elements. In this study, single-model vibration tests using a full-scale test model were conducted, and the basic characteristics of 3D vibration behavior of the core element were examined. In addition, structures restricting vertical displacements (dashpot structure) were devised, and their effectiveness was verified. As a result of the tests, the effects of the ambient condition (in air, in static water, and in flowing water), gap between the pads, vibration directions, vibration waves, and dashpot structures on the vibration behavior of the core element were examined. As regards the ambient condition, the vertical displacements were larger in flowing water that simulates the coolant flow than in air and in static water, because of upward fluid force in flowing water. As regards the gap between the pads, the larger the gaps was, the stronger the interferences due to horizontal displacements, and the smaller the vertical displacements were. The dashpot structure was verified to be suitable for reducing vertical displacements.

scholarly journals Novel Model Based on Stacked Autoencoders with Sample-Wise Strategy for Fault Diagnosis

2019 ◽  
Vol 2019 ◽  
pp. 1-10
Author(s):  
Diehao Kong ◽  
Xuefeng Yan
Keyword(s):  
Fault Diagnosis ◽  
Chemical Engineering ◽  
Ground Truth ◽  
Student Model ◽  
Teacher Student ◽  
Stacked Autoencoders ◽  
Knowledge Distillation ◽  
New Perspective ◽  
Current Student ◽  
Teacher Model

Autoencoders are used for fault diagnosis in chemical engineering. To improve their performance, experts have paid close attention to regularized strategies and the creation of new and effective cost functions. However, existing methods are modified on the basis of only one model. This study provides a new perspective for strengthening the fault diagnosis model, which attempts to gain useful information from a model (teacher model) and applies it to a new model (student model). It pretrains the teacher model by fitting ground truth labels and then uses a sample-wise strategy to transfer knowledge from the teacher model. Finally, the knowledge and the ground truth labels are used to train the student model that is identical to the teacher model in terms of structure. The current student model is then used as the teacher of next student model. After step-by-step teacher-student reconfiguration and training, the optimal model is selected for fault diagnosis. Besides, knowledge distillation is applied in training procedures. The proposed method is applied to several benchmarked problems to prove its effectiveness.

ASSUMPTION OF COGNITIVE GOALS IN SCIENCE LEARNING

2021 ◽  
Author(s):  
Mihail Calalb ◽  
Keyword(s):  
Impact Factor ◽  
Conceptual Understanding ◽  
Science Learning ◽  
Cognitive Achievement ◽  
Independent Research ◽  
Personal Learning ◽  
The Core ◽  
Teacher Student ◽  
Guided Learning ◽  
Educational Paradigms

A new didactical approach named "Learning by Being" (LBB) is proposed and its correlation with current educational paradigms in science teaching is analysed. The key idea in LBB is the assumption by the students of cognitive goals, and three components are mandatory in LBB: a) student’s personal learning effort, b) student – teacher mutual feedback and c) metacognition. In other words, the ownership of cognitive goals and students’ deep intrinsic motivation. Several didactic approaches, used within LBB, are analysed: independent research that has an impact factor on cognitive achievement equal to 83%; knowledge of success criteria (impact factor – 113%); ability to reveal similarities and patterns (impact factor – 132%). The core of LBB is guided learning effort that corresponds to the notion of teacher–student harmonic oscillator when both things – guidance from teacher and student’s effort – are equally important. Keywords: conceptual understanding, learning by being, ownership of cognitive goals, science learning.

A General Strategy for Designing Two-dimensional High-efficient Layered Thermoelectric Materials

2021 ◽  
Author(s):  
Xiwen Zhang ◽  
Yilv Guo ◽  
Zhaobo Zhou ◽  
Yunhai Li ◽  
Yunfei Chen ◽  
...  
Keyword(s):  
Thermoelectric Materials ◽  
Figure Of Merit ◽  
General Strategy ◽  
Two Dimensional ◽  
Energy Technology ◽  
The Core ◽  
High Efficient ◽  
High Figure

Two-dimensional (2D) thermoelectrics (TE) with high figure of merit (ZT > 2) is the core of the development of advanced energy technology. However, such a high ZT has never been...

Sign in / Sign up

Export Citation Format

Share Document