scholarly journals Confidential machine learning on untrusted platforms: a survey

Cybersecurity ◽  
2021 ◽  
Vol 4 (1) ◽  
Author(s):  
Sharma Sagar ◽  
Chen Keke
Keyword(s):  
Machine Learning ◽  
Service Providers ◽  
Learning Models ◽  
Computing Environment ◽  
Unified Framework ◽  
Sensitive Data ◽  
Trade Offs ◽  
Model Training ◽  
Utility Cost ◽  
Machine Learning Models

AbstractWith the ever-growing data and the need for developing powerful machine learning models, data owners increasingly depend on various untrusted platforms (e.g., public clouds, edges, and machine learning service providers) for scalable processing or collaborative learning. Thus, sensitive data and models are in danger of unauthorized access, misuse, and privacy compromises. A relatively new body of research confidentially trains machine learning models on protected data to address these concerns. In this survey, we summarize notable studies in this emerging area of research. With a unified framework, we highlight the critical challenges and innovations in outsourcing machine learning confidentially. We focus on the cryptographic approaches for confidential machine learning (CML), primarily on model training, while also covering other directions such as perturbation-based approaches and CML in the hardware-assisted computing environment. The discussion will take a holistic way to consider a rich context of the related threat models, security assumptions, design principles, and associated trade-offs amongst data utility, cost, and confidentiality.

scholarly journals Using Machine Learning Methods Incorporating Individual Reader Annotations to Classify Paediatric Chest Radiographs in Epidemiological Studies

2021 ◽  
Vol 6 ◽  
pp. 309
Author(s):  
Paul Mwaniki ◽  
Timothy Kamanu ◽  
Samuel Akech ◽  
M. J. C Eijkemans
Keyword(s):  
Machine Learning ◽  
Epidemiological Studies ◽  
Chest Radiographs ◽  
World Health ◽  
Data Sets ◽  
Learning Models ◽  
Middle Income ◽  
Training Models ◽  
Model Training ◽  
Machine Learning Models

Introduction: Epidemiological studies that involve interpretation of chest radiographs (CXRs) suffer from inter-reader and intra-reader variability. Inter-reader and intra-reader variability hinder comparison of results from different studies or centres, which negatively affects efforts to track the burden of chest diseases or evaluate the efficacy of interventions such as vaccines. This study explores machine learning models that could standardize interpretation of CXR across studies and the utility of incorporating individual reader annotations when training models using CXR data sets annotated by multiple readers. Methods: Convolutional neural networks were used to classify CXRs from seven low to middle-income countries into five categories according to the World Health Organization's standardized methodology for interpreting paediatric CXRs. We compared models trained to predict the final/aggregate classification with models trained to predict how each reader would classify an image and then aggregate predictions for all readers using unweighted mean. Results: Incorporating individual reader's annotations during model training improved classification accuracy by 3.4% (multi-class accuracy 61% vs 59%). Model accuracy was higher for children above 12 months of age (68% vs 58%). The accuracy of the models in different countries ranged between 45% and 71%. Conclusions: Machine learning models can annotate CXRs in epidemiological studies reducing inter-reader and intra-reader variability. In addition, incorporating individual reader annotations can improve the performance of machine learning models trained using CXRs annotated by multiple readers.

Toward a unified framework for interpreting machine-learning models in neuroimaging

2020 ◽  
Vol 15 (4) ◽  
pp. 1399-1435 ◽  
Author(s):  
Lada Kohoutová ◽  
Juyeon Heo ◽  
Sungmin Cha ◽  
Sungwoo Lee ◽  
Taesup Moon ◽  
...  
Keyword(s):  
Machine Learning ◽  
Learning Models ◽  
Unified Framework ◽  
Machine Learning Models

scholarly journals Resource Usage and Performance Trade-offs for Machine Learning Models in Smart Environments

Sensors ◽  
2020 ◽  
Vol 20 (4) ◽  
pp. 1176 ◽  
Author(s):  
Davy Preuveneers ◽  
Ilias Tsingenopoulos ◽  
Wouter Joosen
Keyword(s):  
Machine Learning ◽  
Data Storage ◽  
Intelligent Systems ◽  
Smart Cities ◽  
Smart Environments ◽  
Learning Models ◽  
Resource Constrained ◽  
Network Bandwidth ◽  
Trade Offs ◽  
Machine Learning Models

The application of artificial intelligence enhances the ability of sensor and networking technologies to realize smart systems that sense, monitor and automatically control our everyday environments. Intelligent systems and applications often automate decisions based on the outcome of certain machine learning models. They collaborate at an ever increasing scale, ranging from smart homes and smart factories to smart cities. The best performing machine learning model, its architecture and parameters for a given task are ideally automatically determined through a hyperparameter tuning process. At the same time, edge computing is an emerging distributed computing paradigm that aims to bring computation and data storage closer to the location where they are needed to save network bandwidth or reduce the latency of requests. The challenge we address in this work is that hyperparameter tuning does not take into consideration resource trade-offs when selecting the best model for deployment in smart environments. The most accurate model might be prohibitively expensive to computationally evaluate on a resource constrained node at the edge of the network. We propose a multi-objective optimization solution to find acceptable trade-offs between model accuracy and resource consumption to enable the deployment of machine learning models in resource constrained smart environments. We demonstrate the feasibility of our approach by means of an anomaly detection use case. Additionally, we evaluate the extent that transfer learning techniques can be applied to reduce the amount of training required by reusing previous models, parameters and trade-off points from similar settings.

scholarly journals A Human-AI Loop Approach for Joint Keyword Discovery and Expectation Estimation in Micropost Event Detection

2020 ◽  
Vol 34 (03) ◽  
pp. 2451-2458
Author(s):  
Akansha Bhardwaj ◽  
Jie Yang ◽  
Philippe Cudré-Mauroux
Keyword(s):  
Machine Learning ◽  
Real World ◽  
Event Detection ◽  
State Of The Art ◽  
Regularization Parameter ◽  
Learning Models ◽  
Training Process ◽  
Model Training ◽  
Real World Datasets ◽  
Machine Learning Models

Microblogging platforms such as Twitter are increasingly being used in event detection. Existing approaches mainly use machine learning models and rely on event-related keywords to collect the data for model training. These approaches make strong assumptions on the distribution of the relevant microposts containing the keyword – referred to as the expectation of the distribution – and use it as a posterior regularization parameter during model training. Such approaches are, however, limited as they fail to reliably estimate the informativeness of a keyword and its expectation for model training. This paper introduces a Human-AI loop approach to jointly discover informative keywords for model training while estimating their expectation. Our approach iteratively leverages the crowd to estimate both keyword-specific expectation and the disagreement between the crowd and the model in order to discover new keywords that are most beneficial for model training. These keywords and their expectation not only improve the resulting performance but also make the model training process more transparent. We empirically demonstrate the merits of our approach, both in terms of accuracy and interpretability, on multiple real-world datasets and show that our approach improves the state of the art by 24.3%.

scholarly journals Kipoi: accelerating the community exchange and reuse of predictive models for genomics

2018 ◽  
Author(s):  
Žiga Avsec ◽  
Roman Kreuzhuber ◽  
Johnny Israeli ◽  
Nancy Xu ◽  
Jun Cheng ◽  
...  
Keyword(s):  
Machine Learning ◽  
Predictive Models ◽  
Genetic Variants ◽  
Large Scale ◽  
Learning Models ◽  
Unified Framework ◽  
Transcriptional Gene Regulation ◽  
Automated Software ◽  
Variant Effect Prediction ◽  
Machine Learning Models

AbstractAdvanced machine learning models applied to large-scale genomics datasets hold the promise to be major drivers for genome science. Once trained, such models can serve as a tool to probe the relationships between data modalities, including the effect of genetic variants on phenotype. However, lack of standardization and limited accessibility of trained models have hampered their impact in practice. To address this, we present Kipoi, a collaborative initiative to define standards and to foster reuse of trained models in genomics. Already, the Kipoi repository contains over 2,000 trained models that cover canonical prediction tasks in transcriptional and post-transcriptional gene regulation. The Kipoi model standard grants automated software installation and provides unified interfaces to apply and interpret models. We illustrate Kipoi through canonical use cases, including model benchmarking, transfer learning, variant effect prediction, and building new models from existing ones. By providing a unified framework to archive, share, access, use, and build on models developed by the community, Kipoi will foster the dissemination and use of machine learning models in genomics.

Improving XGBoost with Imagination Sampling

2020 ◽  
Vol 2 (1) ◽  
pp. 3-6
Author(s):  
Eric Holloway
Keyword(s):  
Machine Learning ◽  
General System ◽  
Learning Models ◽  
Starting Point ◽  
Machine Learning Models

Imagination Sampling is the usage of a person as an oracle for generating or improving machine learning models. Previous work demonstrated a general system for using Imagination Sampling for obtaining multibox models. Here, the possibility of importing such models as the starting point for further automatic enhancement is explored.

Epigenetic Target Prediction with Accurate Machine Learning Models

2021 ◽  
Author(s):  
Norberto Sánchez-Cruz ◽  
Jose L. Medina-Franco
Keyword(s):  
Machine Learning ◽  
Small Molecules ◽  
Predictive Models ◽  
Large Scale ◽  
Target Prediction ◽  
Quantitative Measure ◽  
Learning Models ◽  
Discovery Research ◽  
Drug Discovery Research ◽  
Machine Learning Models

<p>Epigenetic targets are a significant focus for drug discovery research, as demonstrated by the eight approved epigenetic drugs for treatment of cancer and the increasing availability of chemogenomic data related to epigenetics. This data represents a large amount of structure-activity relationships that has not been exploited thus far for the development of predictive models to support medicinal chemistry efforts. Herein, we report the first large-scale study of 26318 compounds with a quantitative measure of biological activity for 55 protein targets with epigenetic activity. Through a systematic comparison of machine learning models trained on molecular fingerprints of different design, we built predictive models with high accuracy for the epigenetic target profiling of small molecules. The models were thoroughly validated showing mean precisions up to 0.952 for the epigenetic target prediction task. Our results indicate that the herein reported models have considerable potential to identify small molecules with epigenetic activity. Therefore, our results were implemented as freely accessible and easy-to-use web application.</p>

Sign in / Sign up

Export Citation Format

Share Document