Driving Big Data with Hadoop Technologies

Author(s):  
Siddesh G. M. ◽  
Srinidhi Hiriyannaiah ◽  
K. G. Srinivasa

The world of Internet has driven the computing world from a few gigabytes of information to terabytes, petabytes of information turning into a huge volume of information. These volumes of information come from a variety of sources that span over from structured to unstructured data formats. The information needs to update in a quick span of time and be available on demand with the cheaper infrastructures. The information or the data that spans over three Vs, namely Volume, Variety, and Velocity, is called Big Data. The challenge is to store and process this Big Data, running analytics on the stored Big Data, making critical decisions on the results of processing, and obtaining the best outcomes. In this chapter, the authors discuss the capabilities of Big Data, its uses, and processing of Big Data using Hadoop technologies and tools by Apache foundation.

Author(s):  
Ashok Kumar Wahi ◽  
Yajulu Medury ◽  
Rajnish Kumar Misra

Big data has taken the world by storm. Everyone from every industry is not only talking about the impact of big data but is looking for ways to effectively leverage the power of big data. This challenge has heightened with the huge amount of unstructured data flowing from every direction, bringing along with it the increasing pressure to make data driven decisions rather than the gut-driven decisions. This article sheds light on how big data can be an enabler for smart enterprises if the organization is able to address the challenges posed by big data. Enterprises need to equip themselves with relevant technology, desired skills and a supporting managerial attitude to swim through the challenges of big data. It also highlights the need for all enterprises making the journey from 1.0 stage to Enterprise 2.0 to master the art of Big Data if they have to make the transition successful.


Web Services ◽  
2019 ◽  
pp. 1588-1600
Author(s):  
Manjunath Thimmasandra Narayanapppa ◽  
A. Channabasamma ◽  
Ravindra S. Hegadi

The amount of data around us in three sixty degrees getting increased second on second and the world is exploding as a result the size of the database used in today's enterprises, which is growing at an exponential rate day by day. At the same time, the need to process and analyze the bulky data for business decision making has also increased. Several business and scientific applications generate terabytes of data which have to be processed in efficient manner on daily bases. Data gets collected and stored at unprecedented rates. Moreover the challenge here is not only to store and manage the huge amount of data, but even to analyze and extract meaningful values from it. This has contributed to the problem of big data faced by the industry due to the inability of usual software tools and database systems to manage and process the big data sets within reasonable time limits. The main focus of the chapter is on unstructured data analysis.


Author(s):  
Mayushi Chouhan ◽  
Rohit Singh Nain

Organizations create 2.5 Quintilian bytes of data. So much that 90% of the data in the world today has been set up in the last two years alone. What is Big Data? Big Data is large volumes of structured and unstructured data. This data is what organizations collect on a daily basis. The amount of data is not the important part, but the information gathered from that data is the key. Collecting and analyzing Big Data gives organizations enhanced insight, decision making, and process automation. Approximately each one can agree that big data has taken the business world by storm, but what’s next?  Will data continue to grow?  What technologies will develop around it? Or will big data become a relic as quickly as the next trend — cognitive technology? Fast data? - appears on the horizon. I believe, am that big data is only going to get bigger and those companies that ignore it will be left further and further behind. This paper studies about what is big data, how does it helps organizations to extract information, its tools and technologies and its future.


2020 ◽  
Vol 17 (2) ◽  
pp. 248-254
Author(s):  
Rokhmat Taufiq Hidayat ◽  
Akhmad Khabibi

In an era where information technology is developing so rapidly as it is now, contact with technology is inevitable. One that may often be heard is the use of big data. Although the development of big data has begun long before, its growth began rapidly since the Oxford Dictionary included the definition of big data in 2013. The use of big data is thought to have a big influence on the business world, and anything that influences the business world will certainly affect the world of accounting. Does the accountant anticipate these changes? In this article, the author tries to explore what allusions might occur between the world of accounting and big data. Big data will increase the complexity of the accounting world by adding unstructured data in the accounting cycle. This presents a challenge for accountants but can also provide far greater added value if accountants are able to use it well. The results of this study indicate that there are at least 3 areas in the field of accounting that are very likely to be exposed to the use of big data, namely in the process of financial accounting, managerial accounting, and auditing


Author(s):  
Manjunath Thimmasandra Narayanapppa ◽  
A. Channabasamma ◽  
Ravindra S. Hegadi

The amount of data around us in three sixty degrees getting increased second on second and the world is exploding as a result the size of the database used in today's enterprises, which is growing at an exponential rate day by day. At the same time, the need to process and analyze the bulky data for business decision making has also increased. Several business and scientific applications generate terabytes of data which have to be processed in efficient manner on daily bases. Data gets collected and stored at unprecedented rates. Moreover the challenge here is not only to store and manage the huge amount of data, but even to analyze and extract meaningful values from it. This has contributed to the problem of big data faced by the industry due to the inability of usual software tools and database systems to manage and process the big data sets within reasonable time limits. The main focus of the chapter is on unstructured data analysis.


Author(s):  
Stephen H. Kiasler ◽  
William H. Money ◽  
Stephen J. Cohen

The world of data has been evolving due to the expansion of operations and the complexity of the data processed by systems. Big Data is no longer numbers and characters but are now unstructured data types collected by a variety of devices. Recent work has postulated that the Big Data evolutionary process is making a conceptual leap to incorporate intelligence. This challenges system engineers with new issues as they envision and create service systems to process and incorporate these new data sets and structures. This article proposes that Big Data has not yet made a complete evolutionary leap, but rather that a new class of data—a higher level of abstraction—is needed to integrate this “intelligence” concept. This article examines previous definitions of Smart Data, offers a new conceptualization for smart objects (SO), examines the smart data concept, and identifies issues and challenges of understanding smart objects as a new data managed software paradigm. It concludes that smart objects incorporate new features and have different properties from passive and inert Big Data.


1966 ◽  
Vol 05 (03) ◽  
pp. 142-146
Author(s):  
A. Kent ◽  
P. J. Vinken

A joint center has been established by the University of Pittsburgh and the Excerpta Medica Foundation. The basic objective of the Center is to seek ways in which the health sciences community may achieve increasingly convenient and economical access to scientific findings. The research center will make use of facilities and resources of both participating institutions. Cooperating from the University of Pittsburgh will be the School of Medicine, the Computation and Data Processing Center, and the Knowledge Availability Systems (KAS) Center. The KAS Center is an interdisciplinary organization engaging in research, operations, and teaching in the information sciences.Excerpta Medica Foundation, which is the largest international medical abstracting service in the world, with offices in Amsterdam, New York, London, Milan, Tokyo and Buenos Aires, will draw on its permanent medical staff of 54 specialists in charge of the 35 abstracting journals and other reference works prepared and published by the Foundation, the 700 eminent clinicians and researchers represented on its International Editorial Boards, and the 6,000 physicians who participate in its abstracting programs throughout the world. Excerpta Medica will also make available to the Center its long experience in the field, as well as its extensive resources of medical information accumulated during the Foundation’s twenty years of existence. These consist of over 1,300,000 English-language _abstract of the world’s biomedical literature, indexes to its abstracting journals, and the microfilm library in which complete original texts of all the 3,000 primary biomedical journals, monitored by Excerpta Medica in Amsterdam are stored since 1960.The objectives of the program of the combined Center include: (1) establishing a firm base of user relevance data; (2) developing improved vocabulary control mechanisms; (3) developing means of determining confidence limits of vocabulary control mechanisms in terms of user relevance data; 4. developing and field testing of new or improved media for providing medical literature to users; 5. developing methods for determining the relationship between learning and relevance in medical information storage and retrieval systems’; and (6) exploring automatic methods for retrospective searching of the specialized indexes of Excerpta Medica.The priority projects to be undertaken by the Center are (1) the investigation of the information needs of medical scientists, and (2) the development of a highly detailed Master List of Biomedical Indexing Terms. Excerpta Medica has already been at work on the latter project for several years.


2020 ◽  
Vol 10 (2) ◽  
pp. 1-4
Author(s):  
Evgeny Soloviov ◽  
Alexander Danilov

The Phygital word itself is the combination pf physical and digital technology application.This paper will highlight the detail of phygital world and its importance, also we will discuss why its matter in the world of technology along with advantages and disadvantages.It is the concept and technology is the bridge between physical and digital world which bring unique experience to the users by providing purpose of phygital world. It is the technology used in 21st century to bring smart data as opposed to big data and mix into the broader address of array of learning styles. It can bring new experience to every sector almost like, retail, medical, aviation, education etc. to maintain some reality in today’s world which is developing technology day to day. It is a general reboot which can keep economy moving and guarantee the wellbeing of future in terms of both online and offline.


Sign in / Sign up

Export Citation Format

Share Document