Causal and Masked Language Modeling of Javanese Language using Transformer-based Architectures

Author(s):  
Wilson Wongso ◽  
David Samuel Setiawan ◽  
Derwin Suhartono
Keyword(s):  
1994 ◽  
Author(s):  
R. Schwartz ◽  
L. Nguyen ◽  
F. Kubala ◽  
G. CHou ◽  
G. Zavaliagkos ◽  
...  

2019 ◽  
Author(s):  
Chang Liu ◽  
Zhen Zhang ◽  
Pengyuan Zhang ◽  
Yonghong Yan
Keyword(s):  

2017 ◽  
Vol 51 (2) ◽  
pp. 202-208 ◽  
Author(s):  
Jay M. Ponte ◽  
W. Bruce Croft

Author(s):  
Abdul Rehman Javed ◽  
Saif Ur Rehman ◽  
Mohib Ullah Khan ◽  
Mamoun Alazab ◽  
Habib Ullah Khan

With the recent advancement of smartphone technology in the past few years, smartphone usage has increased on a tremendous scale due to its portability and ability to perform many daily life tasks. As a result, smartphones have become one of the most valuable targets for hackers to perform cyberattacks, since the smartphone can contain individuals’ sensitive data. Smartphones are embedded with highly accurate sensors. This article proposes BetaLogger , an Android-based application that highlights the issue of leaking smartphone users’ privacy using smartphone hardware sensors (accelerometer, magnetometer, and gyroscope). BetaLogger efficiently infers the typed text (long or short) on a smartphone keyboard using Language Modeling and a Dense Multi-layer Neural Network (DMNN). BetaLogger is composed of two major phases: In the first phase, Text Inference Vector is given as input to the DMNN model to predict the target labels comprising the alphabet, and in the second phase, sequence generator module generate the output sequence in the shape of a continuous sentence. The outcomes demonstrate that BetaLogger generates highly accurate short and long sentences, and it effectively enhances the inference rate in comparison with conventional machine learning algorithms and state-of-the-art studies.


Sign in / Sign up

Export Citation Format

Share Document