scholarly journals Testing autonomous cyber-physical systems using fuzzing features from convolutional neural networks

2017 ◽  
Author(s):  
Sunny Raj ◽  
Sumit Kumar Jha ◽  
Arvind Ramanathan ◽  
Laura L. Pullum
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Cyber Physical Systems ◽  
Physical Systems

scholarly journals Assurance monitoring of learning-enabled cyber-physical systems using inductive conformal prediction based on distance learning

2021 ◽  
Vol 35 (2) ◽  
pp. 251-264
Author(s):  
Dimitrios Boursinos ◽  
Xenofon Koutsoukos
Keyword(s):  
Neural Networks ◽  
Distance Learning ◽  
Real Time ◽  
Speaker Recognition ◽  
Deep Neural Networks ◽  
Cyber Physical Systems ◽  
Error Rates ◽  
Traffic Sign ◽  
Conformal Prediction ◽  
Physical Systems

AbstractMachine learning components such as deep neural networks are used extensively in cyber-physical systems (CPS). However, such components may introduce new types of hazards that can have disastrous consequences and need to be addressed for engineering trustworthy systems. Although deep neural networks offer advanced capabilities, they must be complemented by engineering methods and practices that allow effective integration in CPS. In this paper, we proposed an approach for assurance monitoring of learning-enabled CPS based on the conformal prediction framework. In order to allow real-time assurance monitoring, the approach employs distance learning to transform high-dimensional inputs into lower size embedding representations. By leveraging conformal prediction, the approach provides well-calibrated confidence and ensures a bounded small error rate while limiting the number of inputs for which an accurate prediction cannot be made. We demonstrate the approach using three datasets of mobile robot following a wall, speaker recognition, and traffic sign recognition. The experimental results demonstrate that the error rates are well-calibrated while the number of alarms is very small. Furthermore, the method is computationally efficient and allows real-time assurance monitoring of CPS.

scholarly journals Predictive Monitoring with Logic-Calibrated Uncertainty for Cyber-Physical Systems

2021 ◽  
Vol 20 (5s) ◽  
pp. 1-25
Author(s):  
Meiyi Ma ◽  
John Stankovic ◽  
Ezio Bartocci ◽  
Lu Feng
Keyword(s):  
Neural Networks ◽  
Real World ◽  
Recurrent Neural Networks ◽  
Cyber Physical Systems ◽  
Uncertainty Estimation ◽  
Physical Systems ◽  
Confidence Levels ◽  
Novel Approach ◽  
Infinite Set

Predictive monitoring—making predictions about future states and monitoring if the predicted states satisfy requirements—offers a promising paradigm in supporting the decision making of Cyber-Physical Systems (CPS). Existing works of predictive monitoring mostly focus on monitoring individual predictions rather than sequential predictions. We develop a novel approach for monitoring sequential predictions generated from Bayesian Recurrent Neural Networks (RNNs) that can capture the inherent uncertainty in CPS, drawing on insights from our study of real-world CPS datasets. We propose a new logic named Signal Temporal Logic with Uncertainty (STL-U) to monitor a flowpipe containing an infinite set of uncertain sequences predicted by Bayesian RNNs. We define STL-U strong and weak satisfaction semantics based on whether all or some sequences contained in a flowpipe satisfy the requirement. We also develop methods to compute the range of confidence levels under which a flowpipe is guaranteed to strongly (weakly) satisfy an STL-U formula. Furthermore, we develop novel criteria that leverage STL-U monitoring results to calibrate the uncertainty estimation in Bayesian RNNs. Finally, we evaluate the proposed approach via experiments with real-world CPS datasets and a simulated smart city case study, which show very encouraging results of STL-U based predictive monitoring approach outperforming baselines.

Functional verification of cyber-physical systems containing machine-learnt components

2021 ◽  
Vol 0 (0) ◽  
Author(s):  
Farzaneh Moradkhani ◽  
Martin Fränzle
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Neural Networks ◽  
Cyber Physical Systems ◽  
Satisfiability Modulo Theories ◽  
Activation Functions ◽  
Physical Systems ◽  
Smt Solvers ◽  
Non Linear ◽  
Artificial Neural

Abstract Functional architectures of cyber-physical systems increasingly comprise components that are generated by training and machine learning rather than by more traditional engineering approaches, as necessary in safety-critical application domains, poses various unsolved challenges. Commonly used computational structures underlying machine learning, like deep neural networks, still lack scalable automatic verification support. Due to size, non-linearity, and non-convexity, neural network verification is a challenge to state-of-art Mixed Integer linear programming (MILP) solvers and satisfiability modulo theories (SMT) solvers [2], [3]. In this research, we focus on artificial neural network with activation functions beyond the Rectified Linear Unit (ReLU). We are thus leaving the area of piecewise linear function supported by the majority of SMT solvers and specialized solvers for Artificial Neural Networks (ANNs), the successful like Reluplex solver [1]. A major part of this research is using the SMT solver iSAT [4] which aims at solving complex Boolean combinations of linear and non-linear constraint formulas (including transcendental functions), and therefore is suitable to verify the safety properties of a specific kind of neural network known as Multi-Layer Perceptron (MLP) which contain non-linear activation functions.

scholarly journals On the Effectiveness of Recurrent Neural Networks for Live Modeling of Cyber-Physical Systems

2019 ◽  
Author(s):  
Srikanth Yoginath ◽  
Varisara Tansakul ◽  
Supriya Chinthavali ◽  
Curtis Taylor ◽  
Joshua Hambrick ◽  
...  
Keyword(s):  
Neural Networks ◽  
Recurrent Neural Networks ◽  
Cyber Physical Systems ◽  
Physical Systems
Sign in / Sign up

Export Citation Format

Share Document