scholarly journals An Analysis of the Performance and Configuration Features of MySQL Document Store and Elasticsearch as an Alternative Backend in a Data Replication Solution

2021 ◽  
Vol 11 (24) ◽  
pp. 11590
Author(s):  
Doina R. Zmaranda ◽  
Cristian I. Moisi ◽  
Cornelia A. Győrödi ◽  
Robert Ş. Győrödi ◽  
Livia Bandici
Keyword(s):  
Data Storage ◽  
Relational Databases ◽  
Data Replication ◽  
Real Situation ◽  
Nosql Databases ◽  
Spring Framework ◽  
Java Programming ◽  
Efficient Data ◽  
Study Application

In recent years, with the increase in the volume and complexity of data, choosing a suitable database for storing huge amounts of data is not easy, because it must consider aspects such as manageability, scalability, and extensibility. Nowadays, the NoSQL databases have gained immense popularity for their efficiency in managing such datasets compared to relational databases. However, relational databases also exhibit some advantages in certain circumstances, therefore many applications use a combined approach: relational and non-relational. This paper performs a comparative evaluation of two popular open-source DBMSs: MySQL Document Store and Elasticsearch as non-relational DBMSs; this comparison is based on a detailed analysis of CRUD operations for different amounts of data showing how the databases could be modeled and used in an application. A case-study application was developed for this purpose in Java programming language and Spring framework using for data storage both relational MySQL and non-relational Elasticsearch and MySQL Document Store. To model the real situation encountered in several developed applications that use both relational and non-relational databases, a data replication solution that imports data from the primary relational MySQL database into Elasticsearch and MySQL Document Store as possible alternatives for more efficient data search was proposed and implemented.

Formalizing the Mapping of UML Conceptual Schemas to Column-Oriented Databases

2018 ◽  
Vol 14 (3) ◽  
pp. 44-68 ◽  
Author(s):  
Fatma Abdelhedi ◽  
Amal Ait Brahim ◽  
Gilles Zurfluh
Keyword(s):  
Big Data ◽  
Data Warehouse ◽  
Relational Databases ◽  
Traditional Approach ◽  
Physical Models ◽  
Decision Making Process ◽  
Nosql Databases ◽  
Care Field ◽  
Sufficient Degree

Nowadays, most organizations need to improve their decision-making process using Big Data. To achieve this, they have to store Big Data, perform an analysis, and transform the results into useful and valuable information. To perform this, it's necessary to deal with new challenges in designing and creating data warehouse. Traditionally, creating a data warehouse followed well-governed process based on relational databases. The influence of Big Data challenged this traditional approach primarily due to the changing nature of data. As a result, using NoSQL databases has become a necessity to handle Big Data challenges. In this article, the authors show how to create a data warehouse on NoSQL systems. They propose the Object2NoSQL process that generates column-oriented physical models starting from a UML conceptual model. To ensure efficient automatic transformation, they propose a logical model that exhibits a sufficient degree of independence so as to enable its mapping to one or more column-oriented platforms. The authors provide experiments of their approach using a case study in the health care field.

Modeling and Indexing Spatiotemporal Trajectory Data in Non-Relational Databases

2016 ◽  
pp. 133-162 ◽  
Author(s):  
Berkay Aydin ◽  
Vijay Akkineni ◽  
Rafal A Angryk
Keyword(s):  
Data Storage ◽  
Relational Databases ◽  
Large Scale ◽  
Database Systems ◽  
Distributed Database ◽  
Data Models ◽  
Trajectory Data ◽  
Nosql Databases ◽  
Distributed Database Systems ◽  
Partitioned Data

With the ever-growing nature of spatiotemporal data, it is inevitable to use non-relational and distributed database systems for storing massive spatiotemporal datasets. In this chapter, the important aspects of non-relational (NoSQL) databases for storing large-scale spatiotemporal trajectory data are investigated. Mainly, two data storage schemata are proposed for storing trajectories, which are called traditional and partitioned data models. Additionally spatiotemporal and non-spatiotemporal indexing structures are designed for efficiently retrieving data under different usage scenarios. The results of the experiments exhibit the advantages of utilizing data models and indexing structures for various query types.

scholarly journals IMPLEMENTASI WEBSITE PENCARIAN KOS DENGAN NoSQL

2017 ◽  
Vol 2 (2) ◽  
pp. 103
Author(s):  
Danny Kriestanto ◽  
Alif Benden Arnado
Keyword(s):  
Data Storage ◽  
Structure Data ◽  
Relational Databases ◽  
New Technology ◽  
Unstructured Data ◽  
Nosql Databases ◽  
Storage Technology ◽  
Nosql Database ◽  
Boarding House ◽  
New Type

The new technology of database has moved forward the relational databases. Now, the massive and unstructured data encourage experts to create a new type of database without using query. One of this technology is called NoSQL (Not Only SQL). One of the developing RDBMS that using this technique is MongoDB, which already supporting data storage technology that is no longer need for structured tables and rigid-typed of data. The schema was made flexible to handle the changes of data. The MongoDB data collecting characteristics in the form of arrays is considered suitable for the implementation of boarding house searching where each of the boarding houses have their own scenario structures. MongoDB also supports several programming language, including PHP with Bootstrap material as interface. The results of the research showed that there are alot of difference in implementing a NoSQL database with the regular relational one. NoSQL databases considered alot more complicated in structure, data type, even the CRUD system. The results also showed that in order to view an array inside another array will need two processes.

scholarly journals Comparative study of NoSQL databases for big data storage

2018 ◽  
Vol 7 (2.6) ◽  
pp. 83
Author(s):  
Gourav Bathla ◽  
Rinkle Rani ◽  
Himanshu Aggarwal
Keyword(s):  
Big Data ◽  
Data Storage ◽  
Relational Databases ◽  
Large Scale ◽  
Technology Selection ◽  
Business Organizations ◽  
Nosql Databases ◽  
Real Solutions ◽  
Adequate Knowledge ◽  
Long Time

Big data is a collection of large scale of structured, semi-structured and unstructured data. It is generated due to Social networks, Business organizations, interaction and views of social connected users. It is used for important decision making in business and research organizations. Storage which is efficient to process this large scale of data to extract important information in less response time is the need of current competitive time. Relational databases which have ruled the storage technology for such a long time seems not suitable for mixed types of data. Data can not be represented just in the form of rows and columns in tables. NoSQL (Not only SQL) is complementary to SQL technology which can provide various formats for storage that can be easily compatible with high velocity,large volume and different variety of data. NoSQL databases are categorized in four techniques- Column oriented, Key Value based, Graph based and Document oriented databases. There are approximately 120 real solutions existing for these categories; most commonly used solutions are elaborated in Introduction section. Several research works have been carried out to analyze these NoSQL technology solutions. These studies have not mentioned the situations in which a particular data storage technique is to be chosen. In this study and analysis, we have tried our best to provide answer on technology selection based on specific requirement to the reader. In previous research, comparisons amongNoSQL data storage techniques have been described by using real examples like MongoDB, Neo4J etc. Our observation is that if users have adequate knowledge of NoSQL categories and their comparison, then it is easy for them to choose best suitable category and then real solutions can be selected from this category.

scholarly journals A NOVEL TECHNIQUE IN NoSQL DATA EXTRACTION

2014 ◽  
Vol 1 (1) ◽  
pp. 51-58
Author(s):  
Renu Chaudhary ◽  
Gagangeet Singh
Keyword(s):  
Data Storage ◽  
Relational Databases ◽  
Data Extraction ◽  
Query Languages ◽  
Data Sets ◽  
Volume Data ◽  
Nosql Databases ◽  
Advantages And Disadvantages ◽  
Data Store ◽  
Concurrent User

NoSQL databases (commonly interpreted by developers as „not only SQL databases‟ and not „no SQL‟) is an emerging alternative to the most widely used relational databases. As the name suggests, it does not completely replace SQL but compliments it in such a way that they can co-exist. In this paper we will be discussing the NoSQL data model, types of NoSQL data stores, characteristics and features of each data store, query languages used in NoSQL, advantages and disadvantages of NoSQL over RDBMS and the future prospects of NoSQL. Motivation/Background:NoSQL systems exhibit the ability to store and index arbitrarily big data sets while enabling a large amount of concurrent user requests. Method:Many people think NoSQL is a derogatory term created to poke at SQL. In reality, the term means Not Only SQL. The idea is that both technologies can coexist and each has its place. Results:Large-scale data processing (parallel processing over distributed systems); Embedded IR (basic machine-to-machine information look-up & retrieval); Exploratory analytics on semi-structured data (expert level); Large volume data storage (unstructured, semi-structured, small-packet structured). Conclusions:This study report motivation to provide an independent understanding of the strengths and weaknesses of various NoSQL database approaches to supporting applications that process huge volumes of data; as well as to provide a global overview of this non-relational  NoSQL databases.

scholarly journals An adaptive spark-based framework for querying large-scale NoSQL and relational databases

PLoS ONE ◽  
2021 ◽  
Vol 16 (8) ◽  
pp. e0255562
Author(s):  
Eman Khashan ◽  
Ali Eldesouky ◽  
Sally Elghamrawy
Keyword(s):  
Big Data ◽  
Data Storage ◽  
Relational Databases ◽  
Large Scale ◽  
Query Languages ◽  
Heterogeneous Data ◽  
Query Execution ◽  
Database Queries ◽  
Nosql Databases ◽  
Complex Queries

The growing popularity of big data analysis and cloud computing has created new big data management standards. Sometimes, programmers may interact with a number of heterogeneous data stores depending on the information they are responsible for: SQL and NoSQL data stores. Interacting with heterogeneous data models via numerous APIs and query languages imposes challenging tasks on multi-data processing developers. Indeed, complex queries concerning homogenous data structures cannot currently be performed in a declarative manner when found in single data storage applications and therefore require additional development efforts. Many models were presented in order to address complex queries Via multistore applications. Some of these models implemented a complex unified and fast model, while others’ efficiency is not good enough to solve this type of complex database queries. This paper provides an automated, fast and easy unified architecture to solve simple and complex SQL and NoSQL queries over heterogeneous data stores (CQNS). This proposed framework can be used in cloud environments or for any big data application to automatically help developers to manage basic and complicated database queries. CQNS consists of three layers: matching selector layer, processing layer, and query execution layer. The matching selector layer is the heart of this architecture in which five of the user queries are examined if they are matched with another five queries stored in a single engine stored in the architecture library. This is achieved through a proposed algorithm that directs the query to the right SQL or NoSQL database engine. Furthermore, CQNS deal with many NoSQL Databases like MongoDB, Cassandra, Riak, CouchDB, and NOE4J databases. This paper presents a spark framework that can handle both SQL and NoSQL Databases. Four scenarios’ benchmarks datasets are used to evaluate the proposed CQNS for querying different NoSQL Databases in terms of optimization process performance and query execution time. The results show that, the CQNS achieves best latency and throughput in less time among the compared systems.

Comparative Analysis of Nosql Specimen with Relational Data Store for Big Data in Cloud

2015 ◽  
Vol 3 (1) ◽  
Author(s):  
Sangeeta Gupta
Keyword(s):  
Comparative Analysis ◽  
Data Storage ◽  
Relational Databases ◽  
Traditional Approach ◽  
Modern World ◽  
Nosql Databases ◽  
Complex Queries ◽  
Data Formats ◽  
Data Store ◽  
Storage Technologies

The massive amount of data collected by various fields is a challenging aspect for analysis using the available storage technologies. Relational databases are a traditional approach of data storage more suitable for structured data formats and are constrained by ACID properties. As the modern world data in the form of word documents, pdf files, audio and video formats is unstructured, where tables and schema definition is not a major concern. Relational databases such as Mysql may not be suitable to serve such Bigdata. An alternate approach is to use the emerging Nosql databases. This paper presents a comparative analysis of Nosql types such as Hbase, Mongodb, Simple DB and Big Table with relational database like Mysql and specifies their limitations when applied to real world problems. It also proposes solution to overcome these limitations using an integrated data store which serve to be beneficial over the mentioned Nosql and Mysql stores in terms of efficiently implementing simple and complex queries yielding better performance.

NOSQL DATABASES AS A DATA WAREHOUSE FOR DECISION SUPPORT SYSTEMS

2017 ◽  
Vol 185 (3) ◽  
pp. 124-131
Author(s):  
Jarosław KURPANIK
Keyword(s):  
Decision Support ◽  
Decision Support Systems ◽  
Data Warehouse ◽  
Data Storage ◽  
Relational Databases ◽  
Support Systems ◽  
Large Data ◽  
Daily Basis ◽  
Nosql Databases ◽  
Big Data Storage

Nowadays, to some extent decision support systems are forced to base their operation on large data warehouses whose analysis is difficult and time consuming. This is why where data are stored becomes vital. The use of an efficient and productive data warehouse for this purpose can significantly improve application/system operation. Currently one of the most common solutions used in Big Data storage and quick processing are non-relational databases NoSQL. They are a relatively new solution, however, their development is dy-namic and their market share is increased on a daily basis, which means that it worth in-vestigating what they offer.

scholarly journals Comparison between SQL and NoSQL Databases and Their Relationship with Big Data Analytics

2019 ◽  
pp. 1-10 ◽  
Author(s):  
Wajid Ali ◽  
Muhammad Usman Shafique ◽  
Muhammad Arslan Majeed ◽  
Ali Raza
Keyword(s):  
Big Data ◽  
Data Storage ◽  
Data Analytics ◽  
Relational Databases ◽  
Web Applications ◽  
Distributed Storage ◽  
Big Data Analytics ◽  
Nosql Databases ◽  
Advantages And Disadvantages ◽  
The World

A key ingredient in the world of cloud computing is a database that can be used by a great number of users. Distributed storage mechanisms become the de-facto method for data storage used by companies for the new generation of web applications. In the world of data storage, NoSQL (usually interpreted as "not only SQL" by developers) database is a growing trend. It is said that NoSQL alternates with the most widely used relational databases for the data storage, but, as the name implies, it does not fully replace the SQL. In this paper we will discuss about SQL and NoSQL databases, comparison of traditional SQL with NoSQL databases for Big Data analytics, NoSQL data models, types of NoSQL data stores, characteristics and features of each data store, advantages and disadvantages of NoSQL and RDBMS.

scholarly journals State-of-the-Art Geospatial Information Processing in NoSQL Databases

2020 ◽  
Vol 9 (5) ◽  
pp. 331
Author(s):  
Dongming Guo ◽  
Erling Onstein
Keyword(s):  
Data Processing ◽  
Data Storage ◽  
Relational Databases ◽  
Response Times ◽  
State Of The Art ◽  
Query Languages ◽  
Geospatial Data ◽  
Geospatial Information ◽  
Nosql Databases ◽  
Data Formats

Geospatial information has been indispensable for many application fields, including traffic planning, urban planning, and energy management. Geospatial data are mainly stored in relational databases that have been developed over several decades, and most geographic information applications are desktop applications. With the arrival of big data, geospatial information applications are also being modified into, e.g., mobile platforms and Geospatial Web Services, which require changeable data schemas, faster query response times, and more flexible scalability than traditional spatial relational databases currently have. To respond to these new requirements, NoSQL (Not only SQL) databases are now being adopted for geospatial data storage, management, and queries. This paper reviews state-of-the-art geospatial data processing in the 10 most popular NoSQL databases. We summarize the supported geometry objects, main geometry functions, spatial indexes, query languages, and data formats of these 10 NoSQL databases. Moreover, the pros and cons of these NoSQL databases are analyzed in terms of geospatial data processing. A literature review and analysis showed that current document databases may be more suitable for massive geospatial data processing than are other NoSQL databases due to their comprehensive support for geometry objects and data formats and their performance, geospatial functions, index methods, and academic development. However, depending on the application scenarios, graph databases, key-value, and wide column databases have their own advantages.

Sign in / Sign up

Export Citation Format

Share Document