Architectures for Large Scale Distributed Systems

Author(s):  
Valentin Cristea ◽  
Ciprian Dobre ◽  
Corina Stratan ◽  
Florin Pop

This chapter introduces the macroscopic views on distributed systems’ components and their inter-relations. The importance of the architecture for understanding, designing, implementing, and maintaining distributed systems is presented first. Then the currently used architectures and their derivatives are analyzed. The presentation refers to the client-server (with details about Multi-tiered, REST, Remote Evaluation, and Code-on-Demand architectures), hierarchical (with insights in the protocol oriented Grid architecture), service-oriented architectures including OGSA (Open Grid Service Architecture), cloud, cluster, and peer-to-peer (with its versions: hierarchical, decentralized, distributed, and event-based integration architectures). Due to the relation between architecture and application categories supported, the chapter’s structure is similar to that of Chapter 1. Nevertheless, the focus is different. In the current chapter, for each architecture the model, advantages, disadvantages and areas of applicability are presented. Also the chapter includes concrete cases of use (namely actual distributed systems and platforms), and clarifies the relation between the architecture and the enabling technology used in its instantiation. Finally, Chapter 2 frames the discussion in the other chapters, which refer to specific components and services for large scale distributed systems.

Author(s):  
Neven Vrcek ◽  
Ivan Magdalenic

Many benefits from implementation of e-business solutions are related to network effects which means that there are many interconnected parties utilizing the same or compatible technologies. The large-scale adoption of e-business practices in public sectors and in small and medium enterprises (SMEs)-prevailing economic environments will be successful if appropriate support in the form of education, adequate legislative, directions, and open source applications is provided. This case study describes the adoption of e-business in public sectors and SMEs by using an integrated open source approach called e-modules. E-module is a model which has process properties, data properties, and requirements on technology. Therefore e-module presents a holistic framework for deployment of e-business solutions and such e-module structure mandates an approach which requires reengineering of business processes and adoption of strong standardization that solves interoperability issues. E-module is based on principles of service-oriented architectures with guidelines for introduction into business processes and integration with ERP systems. Such an open source approach enables the spreading of compatible software solutions across any given country, thus, increasing e-business adoption. This paper presents a methodology for defining and building e-modules.


Author(s):  
Andrew Targowski

The enterprise system approach is defined by its evolution and major milestones of architectural planning. The ES architectures are multi-faceted solutions, hence it is defined in the scope of the enterprise organization architecture (EOA), enterprise functional architecture (EFA), enterprise processive architecture (EPA), enterprise information architecture (EIA), enterprise software architecture (ESA), enterprise network architecture (ENA), enterprise service architecture (ESA), business component architecture (BCA), enterprise information infrastructure (EII), and enterprise configurations. A composite ES architecture is presented as a transitional architecture, which is currently practiced by most enterprises. The near future of the ES approach will be rather limited to the ways of delivering ES’ applications within a framework of service-oriented architecture (SOA) and the cloud computing, which satisfies effective large-scale operations. The progressive process of organization/business virtualization and the urgent need for more sustainable enterprise development should lead to new development of enterprise systems.


2015 ◽  
Vol 2015 ◽  
pp. 1-20 ◽  
Author(s):  
Xiao Song ◽  
Yulin Wu ◽  
Yaofei Ma ◽  
Yong Cui ◽  
Guanghong Gong

Big data technology has undergone rapid development and attained great success in the business field. Military simulation (MS) is another application domain producing massive datasets created by high-resolution models and large-scale simulations. It is used to study complicated problems such as weapon systems acquisition, combat analysis, and military training. This paper firstly reviewed several large-scale military simulations producing big data (MS big data) for a variety of usages and summarized the main characteristics of result data. Then we looked at the technical details involving the generation, collection, processing, and analysis of MS big data. Two frameworks were also surveyed to trace the development of the underlying software platform. Finally, we identified some key challenges and proposed a framework as a basis for future work. This framework considered both the simulation and big data management at the same time based on layered and service oriented architectures. The objective of this review is to help interested researchers learn the key points of MS big data and provide references for tackling the big data problem and performing further research.


2011 ◽  
Vol 50 (05) ◽  
pp. 408-419 ◽  
Author(s):  
B. Volckaert ◽  
B. Dhoedt ◽  
F. De Turck ◽  
S. Van Hoecke

SummaryBackground: E-homecare creates opportunities to provide care faster, at lower cost and higher levels of convenience for patients. As e-homecare services are time-critical, stringent requirements are imposed in terms of total response time and reliability, this way requiring a characterization of their network load and usage behavior. However, it is usually hard to build testbeds on a realistic scale in order to evaluate large-scale e-home-care applications.Objective: This paper describes the design and evaluation of the Network Simulator for Web Services (WS-NS), an NS2-based simulator capable of accurately modeling service-oriented architectures that can be used to evaluate the performance of e-homecare architectures.Methods: WS-NS is applied to the Coplintho e-homecare use case, based on the results of the field trial prototype which targeted diabetes and multiple sclerosis patients. Network-unaware and network-aware service selection algorithms are presented and their performance is tested.Results: The results show that when selecting a service to execute the request, suboptimal decisions can be made when selection is solely based on the service’s properties and status. Taking into account the network links interconnecting the services leads to better selection strategies. Based on the results, the e-homecare broker design is optimized from a centralized design to a hierarchical region-based design, resulting in an important decrease of average response times.Conclusions: The WS-NS simulator can be used to analyze the load and response times of large-scale e-homecare architectures. An optimization of the e-homecare architecture of the Coplintho project resulted in optimized network overhead and more than 45% lower response times.


Author(s):  
Gunnar Thies ◽  
Gottfried Vossen

Web-oriented Architectures (WOAs) provide a way of designing an IT system by using a variety of Web Procedures, i.e., procedures (or services) called over the Web. The idea of (typically atomic) components that are black boxes, have interfaces, and can be assembled into a larger process is fundamental and has existed since the early days of distributed systems. Two particular types of modern distributed systems are Service-oriented Architectures and Resource-oriented Architectures, which are built on specific technology stacks and define their own concepts. A WOA uses the best of both worlds plus specifics like Web APIs to build an interconnected IT system in the easiest way possible. In this article, the authors introduce the concept behind a WOA, the topology of a WOA, and possible integration scenarios within an enterprise. More importantly, the authors discuss what a methodology for building a WOA can look like and how control can be achieved, by using a logical software element called the Web Architecture Controller, which specifies the Web-centric core elements of a WOA. Lastly, the cost of implementing and running such a system is briefly addressed.


2011 ◽  
pp. 397-426 ◽  
Author(s):  
Andrew Targowski

The enterprise system approach is defined by its evolution and major milestones of architectural planning. The ES architectures are multi-faceted solutions, hence it is defined in the scope of the enterprise organization architecture (EOA), enterprise functional architecture (EFA), enterprise processive architecture (EPA), enterprise information architecture (EIA), enterprise software architecture (ESA), enterprise network architecture (ENA), enterprise service architecture (ESA), business component architecture (BCA), enterprise information infrastructure (EII), and enterprise configurations. A composite ES architecture is presented as a transitional architecture, which is currently practiced by most enterprises. The near future of the ES approach will be rather limited to the ways of delivering ES’ applications within a framework of service-oriented architecture (SOA) and the cloud computing, which satisfies effective large-scale operations. The progressive process of organization/business virtualization and the urgent need for more sustainable enterprise development should lead to new development of enterprise systems.


Author(s):  
HALUK DEMIRKAN ◽  
MICHAEL GOUL

The service orientation — coupled with dynamic choreography of business processes, service oriented architectures and service oriented infrastructures — is a developing structure that carries with it the potential to improve agility in today's complex business environments. But because of the newness of the concept and the limited number of large-scale organizations ready or willing to be "early adopters," it is difficult to predict the organizational and technical impacts, understand the critical issues, or perform rigorous research on services computing. So, how should a company begin assessing the real impacts of these service orientation paradigm shifts? In this article, we established an integrated assessment process for creating an organizational roadmap to realize visions of how to deliver reliable, scalable enterprise processes built upon services-computing.


Author(s):  
Spyridon V. Gogouvitis ◽  
Kleopatra G. Konstanteli ◽  
Dimosthenis Kyriazis ◽  
Gregory Katsaros ◽  
Tommaso Cucinotta ◽  
...  

With the advent of Service Oriented Architectures, more applications are built in a distributed manner based on loose coupled services. In this context, Workflow Management Systems play an important role as they are the means to both define the processes that realize the application goals as well as implement the orchestration of the different services. The purpose of the chapter is to give an overview of various solutions regarding workflow semantics and languages, as well as their enactment within the scope of distributed systems. To this end, major focus is given to solutions that are aimed at Grid environments. Scheduling algorithms and advance reservation techniques are also discussed as these are among the hottest research topics in Workflow Management Systems.


2018 ◽  
Vol 18 (5-6) ◽  
pp. 846-873 ◽  
Author(s):  
ROBERTA CALEGARI ◽  
ENRICO DENTI ◽  
STEFANO MARIANI ◽  
ANDREA OMICINI

AbstractNew generations of distributed systems are opening novel perspectives for logic programming (LP): On the one hand, service-oriented architectures represent nowadays the standard approach for distributed systems engineering; on the other hand, pervasive systems mandate for situated intelligence. In this paper, we introduce the notion ofLogic Programming as a Service(LPaaS) as a means to address the needs of pervasive intelligent systems through logic engines exploited as a distributed service. First, we define the abstract architectural model by re-interpreting classical LP notions in the new context; then we elaborate on the nature of LP interpreted as a service by describing the basic LPaaS interface. Finally, we show how LPaaS works in practice by discussing its implementation in terms of distributed tuProlog engines, accounting for basic issues such as interoperability and configurability.


2019 ◽  
Vol 214 ◽  
pp. 03033 ◽  
Author(s):  
Jaroslava Schovancová ◽  
Alessandro Di Girolamo ◽  
Aristeidis Fkiaras ◽  
Valentina Mancinelli

HammerCloud is a testing service and framework to commission, run continuous tests or on-demand large-scale stress tests, and benchmark computing resources and components of various distributed systems with realistic full-chain experiment workflows. HammerCloud, used by the ATLAS and CMS experiments in production, has been a useful service to commission both compute resources and various components of the complex distributed systems of the LHC experiments, as well as integral partof the monitoring suite that is essential for the computing operations of the experiments and their automation. In this contribution we review recent developments of the HammerCloud service that allow use of HammerCloud infrastructure to test Data Centre resources in the early phases of the infrastructure and services commissioning process. One of thebenefits we believe HammerCloud can provide is to be able to tune the commissioning of the new infrastructure, functional and also stress testing, as well as benchmarking with "standard candle" workflows, with experiment realistic workloads, that can be heavy for CPU, or I/O, or IOPS, or everything together. This extension of HammerCloud has been successfully usedin CERN IT during the prototype phase of the "BEER" Batch on EOS (Evaluation of Resources) project, and is being integrated with the continuous integration/continuous deployment suite for Batch service VMs.


Sign in / Sign up

Export Citation Format

Share Document