scholarly journals Big Data Challenges in Climate Science: Improving the next-generation cyberinfrastructure

2016 ◽  
Vol 4 (3) ◽  
pp. 10-22 ◽  
Author(s):  
John L. Schnase ◽  
Tsengdar J. Lee ◽  
Chris A. Mattmann ◽  
Christopher S. Lynnes ◽  
Luca Cinquini ◽  
...  
2013 ◽  
Vol 63 (3) ◽  
Author(s):  
Jelena Fiosina ◽  
Maxims Fiosins, Jörg P. Müller

The deployment of future Internet and communication technologies (ICT) provide intelligent transportation systems (ITS) with huge volumes of real-time data (Big Data) that need to be managed, communicated, interpreted, aggregated and analysed. These technologies considerably enhance the effectiveness and user friendliness of ITS, providing considerable economic and social impact. Real-world application scenarios are needed to derive requirements for software architecture and novel features of ITS in the context of the Internet of Things (IoT) and cloud technologies. In this study, we contend that future service- and cloud-based ITS can largely benefit from sophisticated data processing capabilities. Therefore, new Big Data processing and mining (BDPM) as well as optimization techniques need to be developed and applied to support decision-making capabilities. This study presents real-world scenarios of ITS applications, and demonstrates the need for next-generation Big Data analysis and optimization strategies. Decentralised cooperative BDPM methods are reviewed and their effectiveness is evaluated using real-world data models of the city of Hannover, Germany. We point out and discuss future work directions and opportunities in the area of the development of BDPM methods in ITS.


Author(s):  
M. Mazhar Rathore ◽  
Anand Paul ◽  
Awais Ahmad ◽  
Gwanggil Jeon

Recently, a rapid growth in the population in urban regions demands the provision of services and infrastructure. These needs can be come up wit the use of Internet of Things (IoT) devices, such as sensors, actuators, smartphones and smart systems. This leans to building Smart City towards the next generation Super City planning. However, as thousands of IoT devices are interconnecting and communicating with each other over the Internet to establish smart systems, a huge amount of data, termed as Big Data, is being generated. It is a challenging task to integrate IoT services and to process Big Data in an efficient way when aimed at decision making for future Super City. Therefore, to meet such requirements, this paper presents an IoT-based system for next generation Super City planning using Big Data Analytics. Authors have proposed a complete system that includes various types of IoT-based smart systems like smart home, vehicular networking, weather and water system, smart parking, and surveillance objects, etc., for dada generation. An architecture is proposed that includes four tiers/layers i.e., 1) Bottom Tier-1, 2) Intermediate Tier-1, 3) Intermediate Tier 2, and 4) Top Tier that handle data generation and collections, communication, data administration and processing, and data interpretation, respectively. The system implementation model is presented from the generation and collection of data to the decision making. The proposed system is implemented using Hadoop ecosystem with MapReduce programming. The throughput and processing time results show that the proposed Super City planning system is more efficient and scalable.


2021 ◽  
Author(s):  
Charles Stern ◽  
Ryan Abernathey ◽  
Joseph Hamman ◽  
Rachel Wegener ◽  
Chiara Lepore ◽  
...  

Pangeo Forge is a new community-driven platform that accelerates science by providing high-level recipe frameworks alongside cloud compute infrastructure for extracting data from provider archives, transforming it into analysis-ready, cloud-optimized (ARCO) data stores, and providing a human- and machine-readable catalog for browsing and loading. In abstracting the scientific domain logic of data recipes from cloud infrastructure concerns, Pangeo Forge aims to open a door for a broader community of scientists to participate in ARCO data production. A wholly open-source platform composed of multiple modular components, Pangeo Forge presents a foundation for the practice of reproducible, cloud-native, big-data ocean, weather, and climate science without relying on proprietary or cloud-vendor-specific tooling.


2016 ◽  
Vol 128 (38) ◽  
pp. 11575-11578 ◽  
Author(s):  
Shin-ichi Ohkoshi ◽  
Asuka Namai ◽  
Marie Yoshikiyo ◽  
Kenta Imoto ◽  
Kazunori Tamazaki ◽  
...  

2016 ◽  
Vol 125 (4) ◽  
pp. 236-244 ◽  
Author(s):  
Sinchita Roy-Chowdhuri ◽  
Somak Roy ◽  
Sara E. Monaco ◽  
Mark J. Routbort ◽  
Liron Pantanowitz

Biotechnology ◽  
2019 ◽  
pp. 804-837
Author(s):  
Hithesh Kumar ◽  
Vivek Chandramohan ◽  
Smrithy M. Simon ◽  
Rahul Yadav ◽  
Shashi Kumar

In this chapter, the complete overview and application of Big Data analysis in the field of health care industries, Clinical Informatics, Personalized Medicine and Bioinformatics is provided. The major tools and databases used for the Big Data analysis are discussed in this chapter. The development of sequencing machines has led to the fast and effective ways of generating DNA, RNA, Whole Genome data, Transcriptomics data, etc. available in our hands in just a matter of hours. The complete Next Generation Sequencing (NGS) huge data analysis work flow for the medicinal plants are discussed in the chapter. This chapter serves as an introduction to the big data analysis in Next Generation Sequencing and concludes with a summary of the topics of the remaining chapters of this book.


Sign in / Sign up

Export Citation Format

Share Document