Random sampling

2019 ◽  
pp. 71-92
Author(s):  
Max A. Little
Keyword(s):  
Machine Learning ◽  
Signal Processing ◽  
Statistical Model ◽  
Random Sampling ◽  
Joint Distribution ◽  
Optimization Problems ◽  
Viable Alternative ◽  
Statistical Machine Learning ◽  
Digital Signals ◽  
Large Numbers

This chapter provides an overview of generating samples from random variables with a given (joint) distribution, and using these samples to find quantities of interest from digital signals. This task plays a fundamental role in many problems in statistical machine learning and signal processing. For example, effectively simulating the behaviour of the statistical model offers a viable alternative to optimization problems arising from some models for signals with large numbers of variables.

Statistical modelling and inference

2019 ◽  
pp. 93-132
Author(s):  
Max A. Little
Keyword(s):  
Machine Learning ◽  
Signal Processing ◽  
Joint Distribution ◽  
Probabilistic Models ◽  
Optimal Parameter ◽  
Statistical Modelling ◽  
Statistical Machine Learning ◽  
Central Task ◽  
Parameter Values

The modern view of statistical machine learning and signal processing is that the central task is one of finding good probabilistic models for the joint distribution over all the variables in the problem. We can then make `queries' of this model, also known as inferences, to determine optimal parameter values or signals. Hence, the importance of statistical methods to this book cannot be overstated. This chapter is an in-depth exploration of what this probabilistic modeling entails, the origins of the concepts involved, how to perform inferences and how to test the quality of a model produced this way.

scholarly journals An Overview of Machine Learning-Based Techniques for Solving Optimization Problems in Communications and Signal Processing

IEEE Access ◽  
2021 ◽  
pp. 1-1
Author(s):  
Hayssam Dahrouj ◽  
Rawan Alghamdi ◽  
Hibatallah Alwazani ◽  
Sarah Bahanshal ◽  
Alaa Alameer Ahmad ◽  
...  
Keyword(s):  
Machine Learning ◽  
Signal Processing ◽  
Optimization Problems

Mathematical foundations

2019 ◽  
pp. 1-40
Author(s):  
Max A. Little
Keyword(s):  
Mathematical Modeling ◽  
Machine Learning ◽  
Signal Processing ◽  
Mathematical Models ◽  
Applied Mathematics ◽  
Statistical Machine Learning ◽  
Mathematical Concepts ◽  
The Subject ◽  
Mathematical Foundations

Statistical machine learning and signal processing are topics in applied mathematics, which are based upon many abstract mathematical concepts. Defining these concepts clearly is the most important first step in this book. The purpose of this chapter is to introduce these foundational mathematical concepts. It also justifies the statement that much of the art of statistical machine learning as applied to signal processing, lies in the choice of convenient mathematical models that happen to be useful in practice. Convenient in this context means that the algebraic consequences of the choice of mathematical modeling assumptions are in some sense manageable. The seeds of this manageability are the elementary mathematical concepts upon which the subject is built.

Machine Learning for Signal Processing

2019 ◽  
Author(s):  
Max A. Little
Keyword(s):  
Machine Learning ◽  
Signal Processing ◽  
Applied Mathematics ◽  
Digital Signal ◽  
Statistical Modelling ◽  
Modern World ◽  
Statistical Machine Learning ◽  
Contemporary World ◽  
Mp3 Players ◽  
Intelligent Information

Digital signal processing (DSP) is one of the ‘foundational’ engineering topics of the modern world, without which technologies such the mobile phone, television, CD and MP3 players, WiFi and radar, would not be possible. A relative newcomer by comparison, statistical machine learning is the theoretical backbone of exciting technologies such as automatic techniques for car registration plate recognition, speech recognition, stock market prediction, defect detection on assembly lines, robot guidance and autonomous car navigation. Statistical machine learning exploits the analogy between intelligent information processing in biological brains and sophisticated statistical modelling and inference. DSP and statistical machine learning are of such wide importance to the knowledge economy that both have undergone rapid changes and seen radical improvements in scope and applicability. Both make use of key topics in applied mathematics such as probability and statistics, algebra, calculus, graphs and networks. Intimate formal links between the two subjects exist and because of this many overlaps exist between the two subjects that can be exploited to produce new DSP tools of surprising utility, highly suited to the contemporary world of pervasive digital sensors and high-powered and yet cheap, computing hardware. This book gives a solid mathematical foundation to, and details the key concepts and algorithms in, this important topic.

Selective Sampling and Orientation of Non-Homogeneous Tissues

1968 ◽  
Vol 26 ◽  
pp. 98-99
Author(s):  
C. C. Clawson ◽  
L. W. Anderson ◽  
R. A. Good
Keyword(s):  
Electron Microscopy ◽  
Electron Microscope ◽  
Light Microscopy ◽  
Random Sampling ◽  
New Method ◽  
Microscope Examination ◽  
Small Areas ◽  
Selective Sampling ◽  
Large Numbers ◽  
Specific Orientation

Investigations which require electron microscope examination of a few specific areas of non-homogeneous tissues make random sampling of small blocks an inefficient and unrewarding procedure. Therefore, several investigators have devised methods which allow obtaining sample blocks for electron microscopy from region of tissue previously identified by light microscopy of present here techniques which make possible: 1) sampling tissue for electron microscopy from selected areas previously identified by light microscopy of relatively large pieces of tissue; 2) dehydration and embedding large numbers of individually identified blocks while keeping each one separate; 3) a new method of maintaining specific orientation of blocks during embedding; 4) special light microscopic staining or fluorescent procedures and electron microscopy on immediately adjacent small areas of tissue.

scholarly journals Assessing the Effect of Training Sampling Design on the Performance of Machine Learning Classifiers for Land Cover Mapping Using Multi-Temporal Remote Sensing Data and Google Earth Engine

2021 ◽  
Vol 13 (8) ◽  
pp. 1433
Author(s):  
Shobitha Shetty ◽  
Prasun Kumar Gupta ◽  
Mariana Belgiu ◽  
S. K. Srivastav
Keyword(s):  
Machine Learning ◽  
Remote Sensing ◽  
Random Sampling ◽  
Sampling Design ◽  
Remote Sensing Data ◽  
Google Earth ◽  
Machine Learning Classifiers ◽  
Learning Classifiers ◽  
Multi Temporal ◽  
Google Earth Engine

Machine learning classifiers are being increasingly used nowadays for Land Use and Land Cover (LULC) mapping from remote sensing images. However, arriving at the right choice of classifier requires understanding the main factors influencing their performance. The present study investigated firstly the effect of training sampling design on the classification results obtained by Random Forest (RF) classifier and, secondly, it compared its performance with other machine learning classifiers for LULC mapping using multi-temporal satellite remote sensing data and the Google Earth Engine (GEE) platform. We evaluated the impact of three sampling methods, namely Stratified Equal Random Sampling (SRS(Eq)), Stratified Proportional Random Sampling (SRS(Prop)), and Stratified Systematic Sampling (SSS) upon the classification results obtained by the RF trained LULC model. Our results showed that the SRS(Prop) method favors major classes while achieving good overall accuracy. The SRS(Eq) method provides good class-level accuracies, even for minority classes, whereas the SSS method performs well for areas with large intra-class variability. Toward evaluating the performance of machine learning classifiers, RF outperformed Classification and Regression Trees (CART), Support Vector Machine (SVM), and Relevance Vector Machine (RVM) with a >95% confidence level. The performance of CART and SVM classifiers were found to be similar. RVM achieved good classification results with a limited number of training samples.

scholarly journals Global Transmission of COVID-19 for Classifications of Community-Acquired Outbreaks: Machine Learning and Statistical Model Analysis

2021 ◽  
Author(s):  
Wei-Chun Wang ◽  
Ting-Yu Lin ◽  
Sherry Yueh-Hsia Chiu ◽  
Chiung-Nien Chen ◽  
Pongdech Sarakarn ◽  
...  
Keyword(s):  
Machine Learning ◽  
Statistical Model ◽  
Model Analysis

Comparison of machine learning methods in sEMG signal processing for shoulder motion recognition

2021 ◽  
Vol 68 ◽  
pp. 102577
Author(s):  
Yang Zhou ◽  
Chaoyang Chen ◽  
Mark Cheng ◽  
Yousef Alshahrani ◽  
Sreten Franovic ◽  
...  
Keyword(s):  
Machine Learning ◽  
Signal Processing ◽  
Learning Methods ◽  
Semg Signal ◽  
Motion Recognition ◽  
Machine Learning Methods ◽  
Shoulder Motion

scholarly journals Practical CO2—WAG Field Operational Designs Using Hybrid Numerical-Machine-Learning Approaches

Energies ◽  
2021 ◽  
Vol 14 (4) ◽  
pp. 1055
Author(s):  
Qian Sun ◽  
William Ampomah ◽  
Junyu You ◽  
Martha Cather ◽  
Robert Balch
Keyword(s):  
Machine Learning ◽  
Oil Recovery ◽  
History Matching ◽  
Optimization Problems ◽  
Learning Technologies ◽  
Petroleum Engineering ◽  
Support Vector ◽  
Learning Approaches ◽  
Field Development ◽  
Proxy Models

Machine-learning technologies have exhibited robust competences in solving many petroleum engineering problems. The accurate predictivity and fast computational speed enable a large volume of time-consuming engineering processes such as history-matching and field development optimization. The Southwest Regional Partnership on Carbon Sequestration (SWP) project desires rigorous history-matching and multi-objective optimization processes, which fits the superiorities of the machine-learning approaches. Although the machine-learning proxy models are trained and validated before imposing to solve practical problems, the error margin would essentially introduce uncertainties to the results. In this paper, a hybrid numerical machine-learning workflow solving various optimization problems is presented. By coupling the expert machine-learning proxies with a global optimizer, the workflow successfully solves the history-matching and CO2 water alternative gas (WAG) design problem with low computational overheads. The history-matching work considers the heterogeneities of multiphase relative characteristics, and the CO2-WAG injection design takes multiple techno-economic objective functions into accounts. This work trained an expert response surface, a support vector machine, and a multi-layer neural network as proxy models to effectively learn the high-dimensional nonlinear data structure. The proposed workflow suggests revisiting the high-fidelity numerical simulator for validation purposes. The experience gained from this work would provide valuable guiding insights to similar CO2 enhanced oil recovery (EOR) projects.

Sign in / Sign up

Export Citation Format

Share Document