scholarly journals Lifelong Machine Learning Architecture for Classification

Symmetry ◽  
2020 ◽  
Vol 12 (5) ◽  
pp. 852
Author(s):  
Xianbin Hong ◽  
Sheng-Uei Guan ◽  
Ka Lok Man ◽  
Prudence W. H. Wong

Benefiting from the rapid development of big data and high-performance computing, more data is available and more tasks could be solved by machine learning now. Even so, it is still difficult to maximum the power of big data due to each dataset is isolated with others. Although open source datasets are available, algorithms’ performance is asymmetric with the data volume. Hence, the AI community wishes to raise a symmetric continuous learning architecture which can automatically learn and adapt to different tasks. Such a learning architecture also is commonly called as lifelong machine learning (LML). This learning paradigm could manage the learning process and accumulate meta-knowledge by itself during learning different tasks. The meta-knowledge is shared among all tasks symmetrically to help them to improve performance. With the growth of meta-knowledge, the performance of each task is expected to be better and better. In order to demonstrate the application of lifelong machine learning, this paper proposed a novel and symmetric lifelong learning approach for sentiment classification as an example to show how it adapts different domains and keeps efficiency meanwhile.

2021 ◽  
Vol 51 (4) ◽  
pp. 23-35
Author(s):  
Mariam Kiran ◽  
Scott Campbell ◽  
Fatema Bannat Wala ◽  
Nick Buraglio ◽  
Inder Monga

This study explores how fallout from the changing public health policy around COVID-19 has changed how researchers access and process their science experiments. Using a combination of techniques from statistical analysis and machine learning, we conduct a retrospective analysis of historical network data for a period around the stay-at-home orders that took place in March 2020. Our analysis takes data from the entire ESnet infrastructure to explore DOE high-performance computing (HPC) resources at OLCF, ALCF, and NERSC, as well as User sites such as PNNL and JLAB. We look at detecting and quantifying changes in site activity using a combination of t-Distributed Stochastic Neighbor Embedding (t-SNE) and decision tree analysis. Our findings bring insights into the working patterns and impact on data volume movements, particularly during late-night hours and weekends.


Author(s):  
Yuhang Yang ◽  
Y. Dora Cai ◽  
Qiyue Lu ◽  
Yifang Zhang ◽  
Seid Koric ◽  
...  

With the rapid development of sensing, communication, and computing technologies and infrastructure, today’s manufacturing industry is marching towards a big data era and a new generation of digitalization and intelligence. The availability of big data provides us with a golden opportunity to promote smart manufacturing. Nevertheless, the deployment and popularization of big data analytics in manufacturing is still at its nascent stage. One critical challenge results from the lack of high-performance computing (HPC) capability, which is crucial for responsive and intelligent decision-making in the modern manufacturing industry. To address this challenge, this paper proposes a framework and some general guidelines for implementing big data analytics in an HPC environment. The details of the whole workflow, from the prototype to the final application, are high-lighted. A case study for intelligent 3D sensing with real-world manufacturing data is presented to demonstrate the effectiveness of the proposed framework.


2020 ◽  
Vol 3 (2) ◽  
pp. 245-254
Author(s):  
Firuza Tahmazli-Khaligova ◽  

In a traditional High Performance Computing system, it is possible to process a huge data volume. The nature of events in classic High Performance computing is static. In Distributed Exa-scale System has a different nature. The processing Big data in a distributed exascale system evokes a new challenge. The dynamic and interactive character of a distributed exascale system changes processes status and system elements. This paper discusses the challenge that Big data attributes: volume, velocity, variety, how they influence distributed exascale system dynamic and interactive nature. While investigating the effect of the Dynamic and Interactive nature of exascale systems in computing Big data, this research work suggests the Markov chains model. This model suggests the transition matrix, which identifies system status and memory sharing. It lets us analyze the two systems convergence. As a result in both systems are explored by the influence of each other.


2018 ◽  
Vol 88 ◽  
pp. 693-695 ◽  
Author(s):  
Yulei Wu ◽  
Yang Xiang ◽  
Jingguo Ge ◽  
Peter Muller

Sign in / Sign up

Export Citation Format

Share Document