scholarly journals IR-TEx: An Open Source Data Integration Tool for Big Data Transcriptomics Designed for the Malaria Vector Anopheles gambiae

10.3791/60721 ◽  
2020 ◽  
Author(s):  
Victoria A. Ingham ◽  
Andrew Bennett ◽  
Duo Peng ◽  
Simon C. Wagstaff ◽  
Hilary Ranson
Keyword(s):  
Big Data ◽  
Data Integration ◽  
Anopheles Gambiae ◽  
Open Source ◽  
Malaria Vector ◽  
Open Source Data ◽  
Source Data

scholarly journals Comparative Study of Open Source Data Mining Software for Big Data

2016 ◽  
Vol 07 (03) ◽  
pp. 31-33
Author(s):  
ATIF AZIZ ◽  
◽  
RAJEEV ARYA ◽  
SANA SHAFIQUE ◽  
◽  
...  
Keyword(s):  
Data Mining ◽  
Big Data ◽  
Comparative Study ◽  
Open Source ◽  
Open Source Data ◽  
Source Data

scholarly journals Indian Premier League Dataset Analytics using Hadoop-Hive

2019 ◽  
Vol 9 (2) ◽  
pp. 3999-4004
Keyword(s):  
Big Data ◽  
Open Source ◽  
Database Systems ◽  
Huge Amount ◽  
Premier League ◽  
Open Source Data ◽  
Open Source Framework ◽  
Source Data ◽  
Set Up ◽  
Processing Techniques

Big Data is a term used to represent huge volume of both unstructured and structured data which cannot be processed by the traditional data processing techniques. This data is too huge, grows exponentially and doesn't fit into the structure of the traditional database systems. Analyzing Big Data is a very challenging task since it involves the processing of huge amount of data. As the industry or its business grows, the data related to the industries also tend to grow on a larger scale. Prominent data analysis tools are required to analyze the data in order to gain value out of it. Hadoop is a sought-after open source framework that uses MapReduce techniques to store and process huge datasets. However, the programs written using MapReduce techniques are not flexible and also require maintenance. This problem is overcome by making use of HiveQL. In order to execute queries in HiveQL, the platform required is Hive. It is an open-source data warehousing set-up built on Hadoop. HiveQL queries are compiled into MapReduce jobs that are executed utilizing Hadoop. In this paper we have analyzed the Indian Premier League dataset using HiveQL and compared its execution time with that of traditional SQL queries. It was found that the HiveQL provided better performance with larger dataset while SQL performed better with smaller datasets

Open Source Software (OSS) for Big Data

2021 ◽  
pp. 858-875
Author(s):  
Richard S. Segall
Keyword(s):  
Big Data ◽  
Data Processing ◽  
Open Source ◽  
Open Source Software ◽  
Statistical Software ◽  
Big Data Processing ◽  
Open Source Data ◽  
Source Data ◽  
And Storage ◽  
Aggregation Analysis

This chapter discusses Open Source Software and associated technologies for the processing of Big Data. This includes discussions of Hadoop-related projects, the current top open source data tools and frameworks such as SMACK that is acronym for open source technologies Spark, Mesos, Akka, Cassandra, and Kafka that together compose the ingestion, aggregation, analysis, and storage layers for Big Data processing. Tabular summaries and categories for 38 Open Source Statistical Software (OSSS) are provided that include for each listing of features and URLs for free downloads. The current challenges of Big Data and Open Source Software are also discussed.

Open Source Software (OSS) for Big Data

2020 ◽  
pp. 50-72
Author(s):  
Richard S. Segall
Keyword(s):  
Big Data ◽  
Data Processing ◽  
Open Source ◽  
Open Source Software ◽  
Statistical Software ◽  
Big Data Processing ◽  
Open Source Data ◽  
Source Data ◽  
And Storage ◽  
Aggregation Analysis

This chapter discusses Open Source Software and associated technologies for the processing of Big Data. This includes discussions of Hadoop-related projects, the current top open source data tools and frameworks such as SMACK that is acronym for open source technologies Spark, Mesos, Akka, Cassandra, and Kafka that together compose the ingestion, aggregation, analysis, and storage layers for Big Data processing. Tabular summaries and categories for 38 Open Source Statistical Software (OSSS) are provided that include for each listing of features and URLs for free downloads. The current challenges of Big Data and Open Source Software are also discussed.

NYenviroScreen: An open-source data driven method for identifying potential environmental justice communities in New York State

2021 ◽  
Vol 124 ◽  
pp. 348-358
Author(s):  
Michael Petroni ◽  
Sarah Howard ◽  
I. Brielle Howell ◽  
Mary B. Collins
Keyword(s):  
New York ◽  
Environmental Justice ◽  
Open Source ◽  
New York State ◽  
Data Driven ◽  
York State ◽  
Open Source Data ◽  
Source Data

Using Open-Source Data in Correlative Species Distribution Modeling of Marine Species

2018 ◽  
Vol 80 (6) ◽  
pp. 457-461
Author(s):  
Carlos A. Morales-Ramirez ◽  
Pearlyn Y. Pang
Keyword(s):  
Open Source ◽  
Species Distribution ◽  
Open Source Software ◽  
Species Distribution Modeling ◽  
Science Research ◽  
Marine Species ◽  
Distribution Modeling ◽  
Open Source Data ◽  
Rapid Changes ◽  
Source Data

Open-source data are information provided free online. It is gaining popularity in science research, especially for modeling species distribution. MaxEnt is an open-source software that models using presence-only data and environmental variables. These variables can also be found online and are generally free. Using all of these open-source data and tools makes species distribution modeling (SDM) more accessible. With the rapid changes our planet is undergoing, SDM helps understand future habitat suitability for species. Due to increasing interest in biogeographic research, SDM has increased for marine species, which were previously not commonly found in this modeling. Here we provide examples of where to obtain the data and how the modeling can be performed and taught.

Modelling urban energy requirements using open source data and models

2018 ◽  
Vol 231 ◽  
pp. 1100-1108 ◽  
Author(s):  
Alaa Alhamwi ◽  
Wided Medjroubi ◽  
Thomas Vogt ◽  
Carsten Agert
Keyword(s):  
Open Source ◽  
Energy Requirements ◽  
Open Source Data ◽  
Source Data ◽  
Urban Energy
Sign in / Sign up

Export Citation Format

Share Document