Data management issues for large scale, distributed workflow systems on the Internet

1998 ◽  
Vol 29 (4) ◽  
pp. 22-32 ◽  
Author(s):  
J. Leon Zhao ◽  
Akhil Kumar
Keyword(s):  
Data Management ◽  
Large Scale ◽  
The Internet ◽  
Workflow Systems ◽  
Distributed Workflow ◽  
Management Issues

Data Management in Scientific Workflows

2012 ◽  
pp. 177-187
Author(s):  
Ewa Deelman ◽  
Ann Chervenak
Keyword(s):  
Data Management ◽  
Gravitational Wave ◽  
Large Scale ◽  
Real Life ◽  
Scientific Workflows ◽  
Workflow Systems ◽  
Automated Generation ◽  
Workflow Execution ◽  
Data Products ◽  
Workflow Planning

Scientific applications such as those in astronomy, earthquake science, gravitational-wave physics, and others have embraced workflow technologies to do large-scale science. Workflows enable researchers to collaboratively design, manage, and obtain results that involve hundreds of thousands of steps, access terabytes of data, and generate similar amounts of intermediate and final data products. Although workflow systems are able to facilitate the automated generation of data products, many issues still remain to be addressed. These issues exist in different forms in the workflow lifecycle. This chapter describes a workflow lifecycle as consisting of a workflow generation phase where the analysis is defined, the workflow planning phase where resources needed for execution are selected, the workflow execution part, where the actual computations take place, and the result, metadata, and provenance storing phase. The authors discuss the issues related to data management at each step of the workflow cycle. They describe challenge problems and illustrate them in the context of real-life applications. They discuss the challenges, possible solutions, and open issues faced when mapping and executing large-scale workflows on current cyberinfrastructure. They particularly emphasize the issues related to the management of data throughout the workflow lifecycle.

PENGELOLAAN DATA ANGGOTA BERBASIS WEBSITE DI YAMAHA VIXION CLUB CABANG BANDUNG

2020 ◽  
Vol 2 (2) ◽  
pp. 113-127
Author(s):  
Nova Indrayana Yusman
Keyword(s):  
Data Management ◽  
Organizational Structure ◽  
Human Resource Development ◽  
Human Resource ◽  
Programming Language ◽  
The Internet ◽  
Web Based ◽  
Management Software ◽  
The City ◽  
Data Management Software

Yamaha Vixion Club Bandung (YVCB) was formed on July 7, 2007 in the city of Bandung, as a place of friendship between Yamaha Vixion motorcyclists. In its organizational structure, YVCB has a Human Resource Development (HRD) division. Until now, there are more than 800 Yamaha Vixion Club Bandung members. This software is made to facilitate the work of the Yamaha Vixion Club Bandung HRD Division in processing member data. Created using Microsoft Webmatrix as an editor with the PHP programming language. The database uses MySQL with PHPMyAdmin as the software. The method used in making this software is prototyping so that between developers and customers can understand each other what the customer wants. The purpose of making web-based member data management software is that in terms of managing member data it can be done anytime and anywhere by just accessing the internet. In the use of the program, the author chose to use PHP, because PHP is the best and easiest to use in website programming language. Based on the last paragraph, the author intends to make aplication based computerized attendance so that become effective and efficient in terms of time.

scholarly journals Sensor System: A Survey of Sensor Type, Ad Hoc Network Topology and Energy Harvesting Techniques

Electronics ◽  
2021 ◽  
Vol 10 (2) ◽  
pp. 219
Author(s):  
Phuoc Duc Nguyen ◽  
Lok-won Kim
Keyword(s):  
Energy Harvesting ◽  
Large Scale ◽  
Ad Hoc ◽  
Sensor Nodes ◽  
Sensor System ◽  
Wireless Sensor ◽  
The Internet ◽  
Original Research ◽  
Energy Scavenging ◽  
Term Operation

People nowadays are entering an era of rapid evolution due to the generation of massive amounts of data. Such information is produced with an enormous contribution from the use of billions of sensing devices equipped with in situ signal processing and communication capabilities which form wireless sensor networks (WSNs). As the number of small devices connected to the Internet is higher than 50 billion, the Internet of Things (IoT) devices focus on sensing accuracy, communication efficiency, and low power consumption because IoT device deployment is mainly for correct information acquisition, remote node accessing, and longer-term operation with lower battery changing requirements. Thus, recently, there have been rich activities for original research in these domains. Various sensors used by processing devices can be heterogeneous or homogeneous. Since the devices are primarily expected to operate independently in an autonomous manner, the abilities of connection, communication, and ambient energy scavenging play significant roles, especially in a large-scale deployment. This paper classifies wireless sensor nodes into two major categories based the types of the sensor array (heterogeneous/homogeneous). It also emphasizes on the utilization of ad hoc networking and energy harvesting mechanisms as a fundamental cornerstone to building a self-governing, sustainable, and perpetually-operated sensor system. We review systems representative of each category and depict trends in system development.

scholarly journals PowerSystems.jl — A power system data management package for large scale modeling

SoftwareX ◽  
2021 ◽  
Vol 15 ◽  
pp. 100747
Author(s):  
José Daniel Lara ◽  
Clayton Barrows ◽  
Daniel Thom ◽  
Dheepak Krishnamurthy ◽  
Duncan Callaway
Keyword(s):  
Power System ◽  
Data Management ◽  
Large Scale ◽  
Scale Modeling ◽  
System Data ◽  
Large Scale Modeling

scholarly journals Internet of Vehicles: Commencing Intellectual Hoarse Towards Self-Regulating Cars and Vehicular Clouds for Smart Transportation Structure [Vehicular Ad-Hoc Network: A Review and Application in the Internet of Vehicles]

2018 ◽  
Vol 7 (3.12) ◽  
pp. 545
Author(s):  
Risabh Mishra ◽  
M Safa ◽  
Aditya Anand
Keyword(s):  
Internet Of Things ◽  
Wireless Communication ◽  
Automobile Industry ◽  
Information Exchange ◽  
Large Scale ◽  
Intelligent Transportation System ◽  
Information Service ◽  
The Internet ◽  
Internet Of Vehicles ◽  
The Internet Of Things

Recent advances in wireless communication technologies and automobile industry have triggered a significant research interest in the field of Internet of Vehicles over the past few years.The advanced period of the Internet of Things is guiding the development of conventional Vehicular Networks to the Internet of Vehicles.In the days of Internet connectivity there is need to be in safe and problem-free environment.The Internet of Vehicles (IoV) is normally a mixing of three networks: an inter-vehicleNetwork, an intra-vehicle network, and a vehicle to vehicle network.Based on  idea of three networks combining into one, we define  Internet of Vehicles as a large-scale distributed system to wireless communication and information exchange between vehicle2X (X: vehicle, road, human and internet).It is a combined   network for supporting intelligent traffic management, intelligent dynamic information service, and intelligent vehicle control, representation of an application of the Internet of Things (IoT) technology for intelligent transportation system (ITS).  

scholarly journals ALVIC versus the Internet: Redesigning a Networked Virtual Environment Architecture

2008 ◽  
Vol 2008 ◽  
pp. 1-9 ◽  
Author(s):  
Peter Quax ◽  
Jeroen Dierckx ◽  
Bart Cornelissen ◽  
Wim Lamotte
Keyword(s):  
Virtual Environment ◽  
Large Scale ◽  
Virtual Communities ◽  
Real Life ◽  
Point Of View ◽  
The Internet ◽  
Generic Framework ◽  
Short Period ◽  
Networked Virtual Environment ◽  
Near Future

The explosive growth of the number of applications based on networked virtual environment technology, both games and virtual communities, shows that these types of applications have become commonplace in a short period of time. However, from a research point of view, the inherent weaknesses in their architectures are quickly exposed. The Architecture for Large-Scale Virtual Interactive Communities (ALVICs) was originally developed to serve as a generic framework to deploy networked virtual environment applications on the Internet. While it has been shown to effectively scale to the numbers originally put forward, our findings have shown that, on a real-life network, such as the Internet, several drawbacks will not be overcome in the near future. It is, therefore, that we have recently started with the development of ALVIC-NG, which, while incorporating the findings from our previous research, makes several improvements on the original version, making it suitable for deployment on the Internet as it exists today.

scholarly journals A DHT-Based Discovery Service for the Internet of Things

2012 ◽  
Vol 2012 ◽  
pp. 1-11 ◽  
Author(s):  
Federica Paganelli ◽  
David Parlanti
Keyword(s):  
Internet Of Things ◽  
Large Scale ◽  
Future Internet ◽  
Peer To Peer ◽  
The Internet ◽  
Dangerous Goods ◽  
Discovery Service ◽  
Single Attribute ◽  
Smart Things ◽  
The Internet Of Things

Current trends towards the Future Internet are envisaging the conception of novel services endowed with context-aware and autonomic capabilities to improve end users’ quality of life. The Internet of Things paradigm is expected to contribute towards this ambitious vision by proposing models and mechanisms enabling the creation of networks of “smart things” on a large scale. It is widely recognized that efficient mechanisms for discovering available resources and capabilities are required to realize such vision. The contribution of this work consists in a novel discovery service for the Internet of Things. The proposed solution adopts a peer-to-peer approach for guaranteeing scalability, robustness, and easy maintenance of the overall system. While most existing peer-to-peer discovery services proposed for the IoT support solely exact match queries on a single attribute (i.e., the object identifier), our solution can handle multiattribute and range queries. We defined a layered approach by distinguishing three main aspects: multiattribute indexing, range query support, peer-to-peer routing. We chose to adopt an over-DHT indexing scheme to guarantee ease of design and implementation principles. We report on the implementation of a Proof of Concept in a dangerous goods monitoring scenario, and, finally, we discuss test results for structural properties and query performance evaluation.

Sign in / Sign up

Export Citation Format

Share Document