Data Classification

2017 ◽  
pp. 34-51 ◽  
Author(s):  
A. Sheik Abdullah ◽  
R. Suganya ◽  
S. Selvakumar ◽  
S. Rajaram
Keyword(s):  
Big Data ◽  
Data Analysis ◽  
Data Classification ◽  
Large Data ◽  
Classification Problem ◽  
Data Sets ◽  
Credit Risk Analysis ◽  
Predicted Values ◽  
Class Labels ◽  
The One

Classification is considered to be the one of the data analysis technique which can be used over many applications. Classification model predicts categorical continuous class labels. Clustering mainly deals with grouping of variables based upon similar characteristics. Classification models are experienced by comparing the predicted values to that of the known target values in a set of test data. Data classification has many applications in business modeling, marketing analysis, credit risk analysis; biomedical engineering and drug retort modeling. The extension of data analysis and classification makes the insight into big data with an exploration to processing and managing large data sets. This chapter deals with various techniques, methodologies that correspond to the classification problem in data analysis process and its methodological impacts to big data.

scholarly journals Tweaking Business Planning With Artificial Intelligence

2021 ◽  
Vol 2 (4) ◽  
pp. 1-22
Author(s):  
Jing Rui Chen ◽  
P. S. Joseph Ng
Keyword(s):  
Artificial Intelligence ◽  
Big Data ◽  
Data Analysis ◽  
Learning Experience ◽  
Compulsory Education ◽  
Large Data ◽  
Data Sets ◽  
Chinese Market ◽  
Artificial Intelligence Technology ◽  
Education Support

Griffith AI&BD is a technology company that uses big data platform and artificial intelligence technology to produce products for schools. The company focuses on primary and secondary school education support and data analysis assistance system and campus ARTIFICIAL intelligence products for the compulsory education stage in the Chinese market. Through big data, machine learning and data mining, scattered on campus and distributed systems enable anyone to sign up to join the huge data processing grid, and access learning support big data analysis and matching after helping students expand their knowledge in a variety of disciplines and learning and promotion. Improve the learning process based on large data sets of students, and combine ai technology to develop AI electronic devices. To provide schools with the best learning experience to survive in a competitive world.

Tensor Numerical Methods: Actual Theory and Recent Applications

2019 ◽  
Vol 19 (1) ◽  
pp. 1-4 ◽  
Author(s):  
Ivan Gavrilyuk ◽  
Boris N. Khoromskij
Keyword(s):  
Numerical Modeling ◽  
Big Data ◽  
Data Analysis ◽  
Numerical Methods ◽  
Differential Equations ◽  
Numerical Solution ◽  
Large Data ◽  
High Dimensional ◽  
Data Sets ◽  
Integral Differential Equations

AbstractMost important computational problems nowadays are those related to processing of the large data sets and to numerical solution of the high-dimensional integral-differential equations. These problems arise in numerical modeling in quantum chemistry, material science, and multiparticle dynamics, as well as in machine learning, computer simulation of stochastic processes and many other applications related to big data analysis. Modern tensor numerical methods enable solution of the multidimensional partial differential equations (PDE) in {\mathbb{R}^{d}} by reducing them to one-dimensional calculations. Thus, they allow to avoid the so-called “curse of dimensionality”, i.e. exponential growth of the computational complexity in the dimension size d, in the course of numerical solution of high-dimensional problems. At present, both tensor numerical methods and multilinear algebra of big data continue to expand actively to further theoretical and applied research topics. This issue of CMAM is devoted to the recent developments in the theory of tensor numerical methods and their applications in scientific computing and data analysis. Current activities in this emerging field on the effective numerical modeling of temporal and stationary multidimensional PDEs and beyond are presented in the following ten articles, and some future trends are highlighted therein.

scholarly journals FinTech as an innovation challenge: from big data to sustainable development

2020 ◽  
Vol 166 ◽  
pp. 13027
Author(s):  
Anzhela Ignatyuk ◽  
Olena Liubkina ◽  
Tetiana Murovana ◽  
Alina Magomedova
Keyword(s):  
Big Data ◽  
Data Analysis ◽  
Large Data ◽  
Big Data Analysis ◽  
Current Approach ◽  
Data Sets ◽  
Human Society ◽  
Public And Private ◽  
Global Trends ◽  
Green Business

Driving force of human society development is elimination contradiction between unlimited usage of natural resources during economic activity of enterprises, environment pollution as a result of such activity and limited natural, energy and other resources. Research results on economic and environmental issues of green business management showed that there are several basic types of problems at present which arise at enterprises during collecting and processing data on the results of their activities. The authors analyzed how public sector and green business is catching up on global trend towards broader use of the big data analysis to serve public interests and increase efficiency of business activities. In order to detect current approach to big data analysis in public and private sectors authors conduct interviews with stakeholders. The paper concludes with the analysis what changes in approaches to the big data analysis in public and private sectors have to be made in order to comply with the global trends in greening the economy. Application of FinTech, methods of processing large data sets and tools for implementing the principles of greening the economy will enable to increase the investment attractiveness of green business and will simplify the interaction between the state and enterprises.

scholarly journals Deep Learning Security Systems

2019 ◽  
Vol 8 (6S3) ◽  
pp. 1823-1826
Keyword(s):  
Big Data ◽  
Deep Learning ◽  
Data Analysis ◽  
Data Analytics ◽  
Big Data Analytics ◽  
Large Data ◽  
Large Data Sets ◽  
Data Sets ◽  
Security Systems ◽  
Abstract Knowledge

Big Data Analytics and Deep Learning are not supposed to be two entirely different concepts. Big Data means extremely huge large data sets that can be analyzed to find patterns, trends. One technique that can be used for data analysis so that able to help us find abstract patterns in Big Data is Deep Learning. If we apply Deep Learning to Big Data, we can find unknown and useful patterns that were impossible so far. With the help of Deep Learning, AI is getting smart. There is a hypothesis in this regard, the more data, the more abstract knowledge. So a handy survey of Big Data, Deep Learning and its application in Big Data is necessary.

scholarly journals Data Science Methods for Psychology

Psychology ◽  
2020 ◽  
Author(s):  
Jeffrey Stanton
Keyword(s):  
Machine Learning ◽  
Big Data ◽  
Data Analysis ◽  
Data Collection ◽  
Data Science ◽  
Large Data ◽  
Large Data Sets ◽  
Predictive Analysis ◽  
Data Sets ◽  
The Impact

The term “data science” refers to an emerging field of research and practice that focuses on obtaining, processing, visualizing, analyzing, preserving, and re-using large collections of information. A related term, “big data,” has been used to refer to one of the important challenges faced by data scientists in many applied environments: the need to analyze large data sources, in certain cases using high-speed, real-time data analysis techniques. Data science encompasses much more than big data, however, as a result of many advancements in cognate fields such as computer science and statistics. Data science has also benefited from the widespread availability of inexpensive computing hardware—a development that has enabled “cloud-based” services for the storage and analysis of large data sets. The techniques and tools of data science have broad applicability in the sciences. Within the field of psychology, data science offers new opportunities for data collection and data analysis that have begun to streamline and augment efforts to investigate the brain and behavior. The tools of data science also enable new areas of research, such as computational neuroscience. As an example of the impact of data science, psychologists frequently use predictive analysis as an investigative tool to probe the relationships between a set of independent variables and one or more dependent variables. While predictive analysis has traditionally been accomplished with techniques such as multiple regression, recent developments in the area of machine learning have put new predictive tools in the hands of psychologists. These machine learning tools relax distributional assumptions and facilitate exploration of non-linear relationships among variables. These tools also enable the analysis of large data sets by opening options for parallel processing. In this article, a range of relevant areas from data science is reviewed for applicability to key research problems in psychology including large-scale data collection, exploratory data analysis, confirmatory data analysis, and visualization. This bibliography covers data mining, machine learning, deep learning, natural language processing, Bayesian data analysis, visualization, crowdsourcing, web scraping, open source software, application programming interfaces, and research resources such as journals and textbooks.

Big data as a challenge for man and statistics

2015 ◽  
Vol 60 (8) ◽  
pp. 1-11
Author(s):  
Mirosław Szreder
Keyword(s):  
Big Data ◽  
Technological Progress ◽  
Large Data ◽  
Data Sets ◽  
Internet Users ◽  
Analytical Work ◽  
Protection Of Human Rights ◽  
The Will ◽  
The One ◽  
Privacy And Anonymity

The phenomenon of ”big data”, understood as the collection and processing of large data sets, in order to extract from them new knowledge, develops independently of the will of individuals and societies. The driving force behind this development is, on the one hand, rapid technological progress in the field of IT, and on the other the desire of many organizations to gain access to the knowledge accumulated in more and more electronic databases of Internet users, facebook, or twitter. The fact that the challenge is this phenomenon for man and for the statistics, the methodology can in these conditions prove less adequate, treats article. The author tries to argue that in case of protection of individuals and society, devoid of attribute privacy and anonymity, technological progress raises previously unknown threats. As statisticians analytical work hardly keep up with the possibilities offered by ”big data”, as well as the protection of human rights is merely a belated response to the dynamic world of electronic data.

scholarly journals Challenges of Big Data analysis

2014 ◽  
Vol 1 (2) ◽  
pp. 293-314 ◽  
Author(s):  
Jianqing Fan ◽  
Fang Han ◽  
Han Liu
Keyword(s):  
Big Data ◽  
Data Analysis ◽  
Measurement Errors ◽  
Modern Society ◽  
Big Data Analysis ◽  
Small Scale ◽  
Paradigm Change ◽  
Statistical Inferences ◽  
The One ◽  
And Storage

Abstract Big Data bring new opportunities to modern society and challenges to data scientists. On the one hand, Big Data hold great promises for discovering subtle population patterns and heterogeneities that are not possible with small-scale data. On the other hand, the massive sample size and high dimensionality of Big Data introduce unique computational and statistical challenges, including scalability and storage bottleneck, noise accumulation, spurious correlation, incidental endogeneity and measurement errors. These challenges are distinguished and require new computational and statistical paradigm. This paper gives overviews on the salient features of Big Data and how these features impact on paradigm change on statistical and computational methods as well as computing architectures. We also provide various new perspectives on the Big Data analysis and computation. In particular, we emphasize on the viability of the sparsest solution in high-confidence set and point out that exogenous assumptions in most statistical methods for Big Data cannot be validated due to incidental endogeneity. They can lead to wrong statistical inferences and consequently wrong scientific conclusions.

scholarly journals A multilevel approach to big data analysis using analytic tools and actor network theory

2018 ◽  
Vol 20 (1) ◽  
Author(s):  
Tiko Iyamu
Keyword(s):  
Big Data ◽  
Data Analysis ◽  
Network Theory ◽  
Data Analytics ◽  
Big Data Analytics ◽  
Actor Network Theory ◽  
Big Data Analysis ◽  
Data Sets ◽  
Multilevel Approach ◽  
Actor Network

Background: Over the years, big data analytics has been statically carried out in a programmed way, which does not allow for translation of data sets from a subjective perspective. This approach affects an understanding of why and how data sets manifest themselves into various forms in the way that they do. This has a negative impact on the accuracy, redundancy and usefulness of data sets, which in turn affects the value of operations and the competitive effectiveness of an organisation. Also, the current single approach lacks a detailed examination of data sets, which big data deserve in order to improve purposefulness and usefulness.Objective: The purpose of this study was to propose a multilevel approach to big data analysis. This includes examining how a sociotechnical theory, the actor network theory (ANT), can be complementarily used with analytic tools for big data analysis.Method: In the study, the qualitative methods were employed from the interpretivist approach perspective.Results: From the findings, a framework that offers big data analytics at two levels, micro- (strategic) and macro- (operational) levels, was developed. Based on the framework, a model was developed, which can be used to guide the analysis of heterogeneous data sets that exist within networks.Conclusion: The multilevel approach ensures a fully detailed analysis, which is intended to increase accuracy, reduce redundancy and put the manipulation and manifestation of data sets into perspectives for improved organisations’ competitiveness.

scholarly journals ReactomeFIViz: the Reactome FI Cytoscape app for pathway and network-based data analysis

F1000Research ◽  
2014 ◽  
Vol 3 ◽  
pp. 146 ◽  
Author(s):  
Guanming Wu ◽  
Eric Dawson ◽  
Adrian Duong ◽  
Robin Haw ◽  
Lincoln Stein
Keyword(s):  
Experimental Data ◽  
Data Analysis ◽  
Graphical Models ◽  
High Throughput ◽  
Interaction Network ◽  
Large Data ◽  
Relevant Information ◽  
Data Sets ◽  
Data Types ◽  
Biological Studies

High-throughput experiments are routinely performed in modern biological studies. However, extracting meaningful results from massive experimental data sets is a challenging task for biologists. Projecting data onto pathway and network contexts is a powerful way to unravel patterns embedded in seemingly scattered large data sets and assist knowledge discovery related to cancer and other complex diseases. We have developed a Cytoscape app called “ReactomeFIViz”, which utilizes a highly reliable gene functional interaction network and human curated pathways from Reactome and other pathway databases. This app provides a suite of features to assist biologists in performing pathway- and network-based data analysis in a biologically intuitive and user-friendly way. Biologists can use this app to uncover network and pathway patterns related to their studies, search for gene signatures from gene expression data sets, reveal pathways significantly enriched by genes in a list, and integrate multiple genomic data types into a pathway context using probabilistic graphical models. We believe our app will give researchers substantial power to analyze intrinsically noisy high-throughput experimental data to find biologically relevant information.

scholarly journals Bought and Sold: Exploring the Effects of Big Data on User Agency and Commodification

2021 ◽  
Author(s):  
Kristia M. Pavlakos
Keyword(s):  
Social Sciences ◽  
Big Data ◽  
Data Privacy ◽  
Large Data ◽  
Data Sets ◽  
Privacy Regulation ◽  
Scholarly Literature ◽  
User Interests ◽  
The Social ◽  
The Relationship

Big Data1is a phenomenon that has been increasingly studied in the academy in recent years, especially in technological and scientific contexts. However, it is still a relatively new field of academic study; because it has been previously considered in mainly technological contexts, more attention needs to be drawn to the contributions made in Big Data scholarship in the social sciences by scholars like Omar Tene and Jules Polonetsky, Bart Custers, Kate Crawford, Nick Couldry, and Jose van Dijk. The purpose of this Major Research Paper is to gain insight into the issues surrounding privacy and user rights, roles, and commodification in relation to Big Data in a social sciences context. The term “Big Data” describes the collection, aggregation, and analysis of large data sets. While corporations are usually responsible for the analysis and dissemination of the data, most of this data is user generated, and there must be considerations regarding the user’s rights and roles. In this paper, I raise three main issues that shape the discussion: how users can be more active agents in data ownership, how consent measures can be made to actively reflect user interests instead of focusing on benefitting corporations, and how user agency can be preserved. Through an analysis of social sciences scholarly literature on Big Data, privacy, and user commodification, I wish to determine how these concepts are being discussed, where there have been advancements in privacy regulation and the prevention of user commodification, and where there is a need to improve these measures. In doing this, I hope to discover a way to better facilitate the relationship between data collectors and analysts, and user-generators. 1 While there is no definitive resolution as to whether or not to capitalize the term “Big Data”, in capitalizing it I chose to conform with such authors as boyd and Crawford (2012), Couldry and Turow (2014), and Dalton and Thatcher (2015), who do so in the scholarly literature.

Sign in / Sign up

Export Citation Format

Share Document