scholarly journals Text Assisted Insight Ranking Using Context-Aware Memory Network

2019 ◽  
Vol 33 ◽  
pp. 427-434
Author(s):  
Qi Zeng ◽  
Liangchen Luo ◽  
Wenhao Huang ◽  
Yang Tang
Keyword(s):  
Data Analysis ◽  
Business Intelligence ◽  
Training Data ◽  
Context Information ◽  
Context Aware ◽  
Statistical Features ◽  
Ranking Problem ◽  
Main Challenge ◽  
Ranking Model ◽  
Memory Network

Extracting valuable facts or informative summaries from multi-dimensional tables, i.e. insight mining, is an important task in data analysis and business intelligence. However, ranking the importance of insights remains a challenging and unexplored task. The main challenge is that explicitly scoring an insight or giving it a rank requires a thorough understanding of the tables and costs a lot of manual efforts, which leads to the lack of available training data for the insight ranking problem. In this paper, we propose an insight ranking model that consists of two parts: A neural ranking model explores the data characteristics, such as the header semantics and the data statistical features, and a memory network model introduces table structure and context information into the ranking process. We also build a dataset with text assistance. Experimental results show that our approach largely improves the ranking precision as reported in multi evaluation metrics.

scholarly journals Data-driven deep density estimation

2021 ◽  
Author(s):  
Patrik Puchert ◽  
Pedro Hermosilla ◽  
Tobias Ritschel ◽  
Timo Ropinski
Keyword(s):  
Data Analysis ◽  
Density Estimation ◽  
Population Data ◽  
Training Data ◽  
Data Driven ◽  
Discrete Observations ◽  
Efficient Manner ◽  
Continuous Models ◽  
3D Scans ◽  
Spatial Locations

AbstractDensity estimation plays a crucial role in many data analysis tasks, as it infers a continuous probability density function (PDF) from discrete samples. Thus, it is used in tasks as diverse as analyzing population data, spatial locations in 2D sensor readings, or reconstructing scenes from 3D scans. In this paper, we introduce a learned, data-driven deep density estimation (DDE) to infer PDFs in an accurate and efficient manner, while being independent of domain dimensionality or sample size. Furthermore, we do not require access to the original PDF during estimation, neither in parametric form, nor as priors, or in the form of many samples. This is enabled by training an unstructured convolutional neural network on an infinite stream of synthetic PDFs, as unbound amounts of synthetic training data generalize better across a deck of natural PDFs than any natural finite training data will do. Thus, we hope that our publicly available DDE method will be beneficial in many areas of data analysis, where continuous models are to be estimated from discrete observations.

scholarly journals k-Nearest Neighbor Learning with Graph Neural Networks

Mathematics ◽  
2021 ◽  
Vol 9 (8) ◽  
pp. 830
Author(s):  
Seokho Kang
Keyword(s):  
Neural Network ◽  
Nearest Neighbor ◽  
Learning Algorithm ◽  
Weighting Function ◽  
High Sensitivity ◽  
Training Data ◽  
K Nearest Neighbor ◽  
Main Challenge ◽  
Benchmark Datasets ◽  
Graph Neural Networks

k-nearest neighbor (kNN) is a widely used learning algorithm for supervised learning tasks. In practice, the main challenge when using kNN is its high sensitivity to its hyperparameter setting, including the number of nearest neighbors k, the distance function, and the weighting function. To improve the robustness to hyperparameters, this study presents a novel kNN learning method based on a graph neural network, named kNNGNN. Given training data, the method learns a task-specific kNN rule in an end-to-end fashion by means of a graph neural network that takes the kNN graph of an instance to predict the label of the instance. The distance and weighting functions are implicitly embedded within the graph neural network. For a query instance, the prediction is obtained by performing a kNN search from the training data to create a kNN graph and passing it through the graph neural network. The effectiveness of the proposed method is demonstrated using various benchmark datasets for classification and regression tasks.

scholarly journals Context-Aware Human Activity Recognition in Industrial Processes

Sensors ◽  
2021 ◽  
Vol 22 (1) ◽  
pp. 134
Author(s):  
Friedrich Niemann ◽  
Stefan Lüdtke ◽  
Christian Bartelt ◽  
Michael ten Hompel
Keyword(s):  
Activity Recognition ◽  
Time Management ◽  
Recognition Performance ◽  
Context Information ◽  
Context Aware ◽  
Recognition Model ◽  
Movement Data ◽  
Information Activity ◽  
The Subject ◽  
Motion Capturing

The automatic, sensor-based assessment of human activities is highly relevant for production and logistics, to optimise the economics and ergonomics of these processes. One challenge for accurate activity recognition in these domains is the context-dependence of activities: Similar movements can correspond to different activities, depending on, e.g., the object handled or the location of the subject. In this paper, we propose to explicitly make use of such context information in an activity recognition model. Our first contribution is a publicly available, semantically annotated motion capturing dataset of subjects performing order picking and packaging activities, where context information is recorded explicitly. The second contribution is an activity recognition model that integrates movement data and context information. We empirically show that by using context information, activity recognition performance increases substantially. Additionally, we analyse which of the pieces of context information is most relevant for activity recognition. The insights provided by this paper can help others to design appropriate sensor set-ups in real warehouses for time management.

scholarly journals Boosting Intelligent Data Analysis in Smart Sensors by Integrating Knowledge and Machine Learning

Sensors ◽  
2021 ◽  
Vol 21 (18) ◽  
pp. 6168
Author(s):  
Piotr Łuczak ◽  
Przemysław Kucharski ◽  
Tomasz Jaworski ◽  
Izabela Perenc ◽  
Krzysztof Ślot ◽  
...  
Keyword(s):  
Machine Learning ◽  
Data Analysis ◽  
Layer Structure ◽  
Recognition Performance ◽  
Conjunctive Normal Form ◽  
Hybrid Structure ◽  
Training Data ◽  
Intelligent Data Analysis ◽  
Feed Forward Neural Network ◽  
Sensor Devices

The presented paper proposes a hybrid neural architecture that enables intelligent data analysis efficacy to be boosted in smart sensor devices, which are typically resource-constrained and application-specific. The postulated concept integrates prior knowledge with learning from examples, thus allowing sensor devices to be used for the successful execution of machine learning even when the volume of training data is highly limited, using compact underlying hardware. The proposed architecture comprises two interacting functional modules arranged in a homogeneous, multiple-layer architecture. The first module, referred to as the knowledge sub-network, implements knowledge in the Conjunctive Normal Form through a three-layer structure composed of novel types of learnable units, called L-neurons. In contrast, the second module is a fully-connected conventional three-layer, feed-forward neural network, and it is referred to as a conventional neural sub-network. We show that the proposed hybrid structure successfully combines knowledge and learning, providing high recognition performance even for very limited training datasets, while also benefiting from an abundance of data, as it occurs for purely neural structures. In addition, since the proposed L-neurons can learn (through classical backpropagation), we show that the architecture is also capable of repairing its knowledge.

scholarly journals Study of a Context Quality Model for UbiPri Middleware

2020 ◽  
Author(s):  
Diandre de Paula ◽  
Daniel Saraiva ◽  
Romeiro Natália ◽  
Nuno Garcia ◽  
Valderi Leithardt
Keyword(s):  
Quality Indicators ◽  
Data Privacy ◽  
Context Information ◽  
Adaptation Process ◽  
Context Aware ◽  
Quality Model ◽  
Context Aware Computing ◽  
Quality Of Context ◽  
The Impact

With the growth of ubiquitous computing, context-aware computing-based applications are increasingly emerging, and these applications demonstrate the impact that context has on the adaptation process. From the context, it will be possible to adapt the application according to the requirements and needs of its users. Therefore, the quality of the context information must be guaranteed so that the application does not have an incorrect or unexpected adaptation process. But like any given data, there is the possibility of inaccuracy and/or uncertainty and so Quality of Context (QoC) plays a key role in ensuring the quality of context information and optimizing the adaptation process. To guarantee the Quality of Context it is necessary to study a quality model to be created, which will have the important function of evaluating the context information. Thus, it is necessary to ensure that the parameters and quality indicators to be used and evaluated are the most appropriate for a given type of application. This paper aims to study a context quality model for the UbiPri middleware, defining its quality indicators to ensure its proper functioning in the process of adaptation in granting access to ubiquitous environments. Keywords: QoC, Model, Context-Aware, Data, Privacy

Data Analysis on the Influencing Factors of the Real Estate Price

2021 ◽  
pp. 52-66
Author(s):  
Huang-Mei He ◽  
Yi Chen ◽  
Jia-Ying Xiao ◽  
Xue-Qing Chen ◽  
Zne-Jung Lee
Keyword(s):  
Data Analysis ◽  
Real Estate ◽  
Influencing Factors ◽  
Real Estate Market ◽  
Training Data ◽  
Market Demand ◽  
Data Set ◽  
The Real ◽  
The Real Estate ◽  
Real Estate Price

China has carried out a large number of real estate market reforms that change the real estate market demand considerably. At the same time, the real estate price has soared in some cities and has surpassed the spending power of many ordinary people. As the real estate price has received widespread attention from society, it is important to understand what factors affect the real estate price. Therefore, we propose a data analysis method for finding out the influencing factors of real estate prices. The method performs data cleaning and conversion on the used data first. To discretize the real estate price, we use the mean ± standard deviation (SD), mean ± 0.5 SD, and mean ± 2 SD of the price and divide it into three categories as the output variable. Then, we establish the decision tree and random forest model for six different situations for comparison. When the data set is divided into training data (70%) and testing data (30%), it has the highest testing accuracy. In addition, by observing the importance of each input variable, it is found that the main influencing factors of real estate price are cost, interior decoration, location, and status. The results suggest that both the real estate industry and buyers should pay attention to these factors to adjust or purchase real estate.

Sign in / Sign up

Export Citation Format

Share Document