Big Data Issues and Challenges

Author(s):  
Shweta Kaushik

The library plays a vital role for the students, researchers, and academician as a central data storage which is utilized for accessing any required data within less time and effort. Academic libraries are rich in primary and secondary data with lots of content, which may include data from other resources also such as internet and other media. This large amount of data must provide a valuable information to the user, but it may not be same format. Librarians need to transform and analyse all the available data to the same format so that it becomes easier for the user to facilitate the required knowledge. For example, they need to create a dataset in a manner that is easy to visualize and accessible. In this regard, big data analytics tools such as information visualisation tools help the user in mining the intended information. In any case, it is assumed that the confinements and conceivable outcomes of Big data innovation are being considered and that relationships are acknowledged as precise. This chapter focus on all the possibilities of various issues and challenges that may arise while using big data with library.

2020 ◽  
pp. 016555152091851 ◽  
Author(s):  
A Y M Atiquil Islam ◽  
Khurshid Ahmad ◽  
Muhammad Rafi ◽  
Zheng JianMing

The concept of big data has been extensively considered as a technological modernisation in organisations and educational institutes. Thus, the purpose of this study is to determine whether the modified technology acceptance model (MTAM) is viable for evaluating the performance of librarians in the use of big data analytics in academic libraries. This study used an empirical research method for collecting data from 211 librarians working in Pakistan’s universities. On the basis of the findings of the MTAM analysis by structural equation modelling, the performances of the academic libraries were comprehended through the process of big data. The main influential components of the performance analysis in this study were the big data analytics capabilities, perceived ease of access and the usefulness of big data practices in academic libraries. Subsequently, the utilisation of big data was significantly affected by skills, perceived ease of access and the usefulness of academic libraries. The results also suggested that the various components of the academic libraries lead to effective organisational performance when linked to big data analytics.


2020 ◽  
Vol 37 (4) ◽  
pp. 1-5
Author(s):  
Nove E. Variant Anna ◽  
Endang Fitriyah Mannan

Purpose The purpose of this paper is to analyse the publication of big data in the library from Scopus database by looking at the writing time period of the papers, author's country, the most frequently occurring keywords, the article theme, the journal publisher and the group of keywords in the big data article. The methodology used in this study is a quantitative approach by extracting data from Scopus database publications with the keywords “big data” and “library” in May 2019. The collected data was analysed using Voxviewer software to show the keywords or terms. The results of the study stated that articles on big data have appeared since 2012 and are increasing in number every year. The big data authors are mostly from China and America. Keywords that often appear are based on the results of terminology visualization are including, “big data”, “libraries”, “library”, “data handling”, “data mining”, “university libraries”, “digital libraries”, “academic libraries”, “big data applications” and “data management”. It can be concluded that the number of publications related to big data in the library is still small; there are still many gaps that need to be researched on the topic. The results of the research can be used by libraries in using big data for the development of library innovation. Design/methodology/approach The Scopus database was accessed on 24 May 2019 by using the keyword “big data” and “library” in the search box. The authors only include papers, which title contain of big data in library. There were 74 papers, however, 1 article was dropped because of it not meeting the criteria (affiliation and abstract were not available). The papers consist of journal articles, conference papers, book chapters, editorial and review. Then the data were extracted into excel and analysed as follows (by the year, by the author/s’s country, by the theme and by the publisher). Following that the collected data were analysed using VOX viewer software to see the relationship between big data terminology and library, terminology clustering, keywords that often appear, countries that publish big data, number of big data authors, year of publication and name of journals that publish big data and library articles (Alagu and Thanuskodi, 2019). Findings It can be concluded that the implementation of big data in libraries is still in an early stage, it is shown from the limited number of practical implementation of big data analytics in library. Not many libraries that use big data to support innovation and services since there were lack of librarian skills of big data analytics. The library manager’s view of big data is still not necessary to do. It is suggested for academic libraries to start their adoption of big data analytics to support library services especially research data. To do so, librarians can enhance their skills and knowledge by following some training in big data analytics or research data management. The information technology infrastructure also needs to be upgraded since big data need big IT capacity. Finally, the big data management policy should be made to ensure the implementation goes well. Originality/value This paper discovers the adoption and implementation of big data in library, many papers talk big data in business and technology context. This is offering new idea for many libraries especially academic library about the adoption of big data to support their services. They can adopt the big data analytics technology and technique that suitable for their library.


2019 ◽  
Vol 8 (3) ◽  
pp. 4384-4392

Big data is being generating in a wide variety of formats at an exponential rate. Big data analytics deals with processing and analyzing voluminous data to provide useful insight for guided decision making. The traditional data storage and management tools are not well-equipped to handle big data and its application. Apache Hadoop is a popular open-source platform that supports storage and processing of extremely large datasets. For the purposes of big data analytics, Hadoop ecosystem provides a variety of tools. However, there is a need to select a tool that is best suited for a specific requirement of big data analytics. The tools have their own advantages and drawbacks over each other. Some of them have overlapping business use cases however they differ in critical functional areas. So, there is a need to consider the trade-offs between usability and suitability while selecting a tool from Hadoop ecosystem. This paper identifies the requirements for Big Data Analytics (BDA) and maps tools of the Hadoop framework that are best suited for them. For this, we have categorized Hadoop tools according to their functionality and usage. Different Hadoop tools are discussed from the users’ perspective along with their pros and cons, if any. Also, for each identified category, comparison of Hadoop tools based on important parameters is presented. The tools have been thoroughly studied and analyzed based on their suitability for the different requirements of big data analytics. A mapping of big data analytics requirements to the Hadoop tools has been established for use by the data analysts and predictive modelers.


2019 ◽  
Vol 59 (6) ◽  
pp. 415-429 ◽  
Author(s):  
JUAN-PEDRO CABRERA-SÁNCHEZ ◽  
ÁNGEL F VILLAREJO-RAMOS

ABSTRACT With the total quantity of data doubling every two years, the low price of computing and data storage, make Big Data analytics (BDA) adoption desirable for companies, as a tool to get competitive advantage. Given the availability of free software, why have some companies failed to adopt these techniques? To answer this question, we extend the unified theory of technology adoption and use of technology model (UTAUT) adapted for the BDA context, adding two variables: resistance to use and perceived risk. We used the level of implementation of these techniques to divide companies into users and non-users of BDA. The structural models were evaluated by partial least squares (PLS). The results show the importance of good infrastructure exceeds the difficulties companies face in implementing it. While companies planning to use Big Data expect strong results, current users are more skeptical about its performance.


Author(s):  
Balasree K ◽  
Dharmarajan K

In rapid development of Big Data technology over the recent years, this paper discussing about the Machine Learning (ML) playing role that is based on methods and algorithms to Big Data Processing and Big Data Analytics. In evolutionary fields and computing fields of developments that both are complementing each other. Big Data: The rapid growth of such data solutions needed to be studied and provided to handle then to gain the knowledge from datasets and extracting values due to the data sets are very high in velocity and variety. The Big data analytics are involving and indicating the appropriate data storage and computational outline that enhanced by using Scalable Machine Learning Algorithms and Big Data Analytics then the analytics to reveal the massive amounts of hidden data’s and secret correlations. This type of Analytic information useful for organizations and companies to gain deeper knowledge, development and getting advantages over the competition. When using this Analytics we can predict the accurate implementation over the data. This paper presented about the detailed review of state-of-the-art developments and overview of advantages and challenges in Machine Learning Algorithms over big data analytics.


Web Services ◽  
2019 ◽  
pp. 89-104
Author(s):  
Priya P. Panigrahi ◽  
Tiratha Raj Singh

In this digital and computing world, data formation and collection rate are growing very rapidly. With these improved proficiencies of data storage and fast computation along with the real-time distribution of data through the internet, the usual everyday ingestion of data is mounting exponentially. With the continuous advancement in data storage and accessibility of smart devices, the impact of big data will continue to develop. This chapter provides the fundamental concepts of big data, its benefits, probable pitfalls, big data analytics and its impact in Bioinformatics. With the generation of the deluge of biological data through next generation sequencing projects, there is a need to handle this data trough big data techniques. The chapter also presents a discussion of the tools for analytics, development of a novel data life cycle on big data, details of the problems and challenges connected with big data with special relevance to bioinformatics.


Author(s):  
Priya P. Panigrahi ◽  
Tiratha Raj Singh

In this digital and computing world, data formation and collection rate are growing very rapidly. With these improved proficiencies of data storage and fast computation along with the real-time distribution of data through the internet, the usual everyday ingestion of data is mounting exponentially. With the continuous advancement in data storage and accessibility of smart devices, the impact of big data will continue to develop. This chapter provides the fundamental concepts of big data, its benefits, probable pitfalls, big data analytics and its impact in Bioinformatics. With the generation of the deluge of biological data through next generation sequencing projects, there is a need to handle this data trough big data techniques. The chapter also presents a discussion of the tools for analytics, development of a novel data life cycle on big data, details of the problems and challenges connected with big data with special relevance to bioinformatics.


2019 ◽  
Vol 19 (3) ◽  
pp. 16-24 ◽  
Author(s):  
Ivan P. Popchev ◽  
Daniela A. Orozova

Abstract The issues related to the analysis and management of Big Data, aspects of the security, stability and quality of the data, represent a new research, and engineering challenge. In the present paper, techniques for Big Data storage, search, analysis and management in the area of the virtual e-Learning space and the problems in front of them are considered. A numerical example for explorative analysis of data about the students from Burgas Free University is applied, using instrument for Data Mining of Orange. The analysis is a base for a system for localization of students at risk.


2018 ◽  
Vol 13 (2) ◽  
pp. 153-163
Author(s):  
Claudia Ogrean

AbstractOver the last few decades Big Data has impetuously penetrated almost every domain of human interest/action and it has (more or less consciously) become a ubiquitous presence of day to day life. The main questions this exploratory paper seeks to address (throughout its two parts) are the following: What is the (actual) impact of Big Data on Business & Management and How can businesses (through their management) leverage the potential of Big Data to their benefit? A gradual, step by step approach (based on literature review and a variety of secondary data) will guide the paper in search for answers to the abovementioned questions: starting with a concise history of the topic Big Data as reflected in academia and a critical content analysis of the Big Data concept, the paper will then continue by emphasizing some of the most significant realities and trends that characterize the supply-side of the big data industry; the second part of the paper is dedicated to the investigation of the demand-side of the big data industry – by highlighting some evidences (and projections) on the impact of big data analytics on Business & Management (both at aggregate and granular level) and exploring what companies could and should do (through their management) in order to best capitalize on the opportunities of big data and avoid/minimize the impact of its threats.


2022 ◽  
pp. 1578-1596
Author(s):  
Gunasekaran Manogaran ◽  
Chandu Thota ◽  
Daphne Lopez

Big Data has been playing a vital role in almost all environments such as healthcare, education, business organizations and scientific research. Big data analytics requires advanced tools and techniques to store, process and analyze the huge volume of data. Big data consists of huge unstructured data that require advance real-time analysis. Thus, nowadays many of the researchers are interested in developing advance technologies and algorithms to solve the issues when dealing with big data. Big Data has gained much attention from many private organizations, public sector and research institutes. This chapter provides an overview of the state-of-the-art algorithms for processing big data, as well as the characteristics, applications, opportunities and challenges of big data systems. This chapter also presents the challenges and issues in human computer interaction with big data analytics.


Sign in / Sign up

Export Citation Format

Share Document