scholarly journals Using Trellis software to enhance high-quality large-scale network data collection in the field

2021 ◽  
Vol 66 ◽  
pp. 171-184
Author(s):  
Alina Lungeanu ◽  
Mark McKnight ◽  
Rennie Negron ◽  
Wolfgang Munar ◽  
Nicholas A. Christakis ◽  
...  
2012 ◽  
Vol 546-547 ◽  
pp. 1453-1458
Author(s):  
Hai Yan Liu ◽  
Zhao Hong Yang ◽  
Hong Liu Cai

In Large-scale network applications, transmission data collection is the basis for audit, analysis and evaluation of systems and users. Transmission data collection can be carried out either on the link line or on the host where the network application is running. Collecting at different locations, the types of data acquired are different, thus need different processing. This paper first analyzes the different transmission data collection methods, their advantages as well as disadvantages. Then analyzes the structure of those network applications that are basing on transmission dynamic linked library, promotes the intermediate DLL method. Finally through an example it shows how to define the intermediate DLL to collect transferred data on application layer without affecting the original system function.


Author(s):  
H. Rakha ◽  
M. Van Aerde ◽  
L. Bloomberg ◽  
X. Huang

The objective of this paper is threefold. First, the feasibility of modeling a large-scale network at a microscopic level of detail is presented. Second, the unique data collection challenges that are involved in constructing and calibrating a large-scale network microscopically are described. Third, the unique opportunities and applications from the use of a microscopic as opposed to a macroscopic simulation tool are described. The possibility and feasibility of modeling a large-scale network using a microscopic simulation model is demonstrated. The requirements of a validated microscopic model for large-scale modeling are: ( a) the model must be capable of modeling origin-destination demand tables, ( b) the model must be capable of modeling dynamic traffic routing, and ( c) the model must be capable of modeling the dynamic interaction of freeway/arterial facilities. The data collection and coding exercise for microscopic models is more intensive than for macroscopic models. The calibration exercise for a microscopic model to a large-scale network, although feasible, is by no means an easy task and does require expert assistance. The Salt Lake metropolitan region study has demonstrated that the data collection, coding, and calibration exercise is approximately a 4-person-year exercise. Model execution times during peak periods are still quite high (from 2 to 17 times the simulation time depending on the number of vehicles) for the PC platform (Pentium 200 with 64 megabytes of random-access memory). Consequently, tools that can extract portions of the large-scale network can allow the modeler to conduct various types of sensitivity analyses within a more realistic time frame.


2020 ◽  
Vol 245 ◽  
pp. 07019
Author(s):  
Silvio Pardi

Belle II has started the Phase 3 data taking with a fully equipped detector. The data flow at the maximum luminosity is expected to be 12PB of data/year and will be analysed by a cutting-edge computing infrastructure spread over 26 Countries. Several of the major computing centres for HEP in Europe, USA and Canada will store the second copy of RAW data. In this scenario, the international network infrastructure for research plays a key role in supporting and orchestrating all the activities of data analysis and replication. The large-scale network data challenge will also take advantage from LHCONE VRF service and the support of network experts of KEKCC, Belle II sites and NREN. The program of major upgrade in 2019 empowered the connection among Japan, Europe and USA over a 100Gb geographic ring. In this work, we summarize the network requirements needed to accomplish all the tasks provided by the Belle II computing model. We also highlight the status of the major network links that support and advance Belle II. Lastly, we present the results of the last Network Data Challenge campaign performed between KEK and the main RAW data centres with the additional usage of the Data Transfer Node service provided by GÉANT.


MIS Quarterly ◽  
2016 ◽  
Vol 40 (4) ◽  
pp. 849-868 ◽  
Author(s):  
Kunpeng Zhang ◽  
◽  
Siddhartha Bhattacharyya ◽  
Sudha Ram ◽  
◽  
...  

Sign in / Sign up

Export Citation Format

Share Document