Free Evaluation System Framework (Freva) - New Features and Development

Author(s):  
Etor E. Lucio-Eceiza ◽  
Christopher Kadow ◽  
Martin Bergemann ◽  
Mahesh Ramadoss ◽  
Sebastian Illing ◽  
...  

<p>The Free Evaluation System Framework (Freva - freva.met.fu-berlin.de , xces.dkrz.de , www-regiklim.dkrz.de - https://github.com/FREVA-CLINT/Freva) is a software infrastructure for standardized data and tool solutions in Earth system science. Freva runs on high performance computers (HPC) to handle customizable evaluation systems of research projects, institutes or universities. It combines different software technologies into one common hybrid infrastructure, where all its features are accessible via shell and web environment. Freva indexes different data projects into one common search environment by storing the metadata information of the self-describing model, reanalysis and observational data sets in a database. The database interface satisfies the international standards provided by the Earth System Grid Federation (ESGF). This implemented metadata system with its advanced but easy-to-handle search tool supports users, developers and their plugins to retrieve the required information. A generic application programming interface (API) allows scientific developers to connect their analysis tools with the evaluation system independently of the programming language used. Facilitation of the provision and usage of tools and climate data automatically increases the number of scientists working with the data sets and identifying discrepancies. Plugins are also able to integrate their e.g. post-processed results into the database of the user. This allows e.g. post-processing plugins to feed statistical analysis plugins, which fosters an active exchange between plugin developers of a research project. Additionally, the history and configuration sub-system stores every analysis performed with the evaluation system in a database. Configurations and results of the tools can be shared among scientists via shell or web system. Therefore, plugged-in tools benefit from transparency and reproducibility. Furthermore, the system suggests existing results already produced by other users – saving CPU hours, I/O, disk space and time. An integrated web shell (shellinabox) adds a degree of freedom in the choice of the working environment and can be used as a gate to the research projects on a HPC. Freva efficiently frames the interaction between different technologies thus improving the Earth system modeling science. New Features and aspects of further development and collaboration are discussed.</p>

Author(s):  
Christopher Kadow ◽  
Sebastian Illing ◽  
Oliver Kunst ◽  
Thomas Schartner ◽  
Jens Grieger ◽  
...  

<p>The Free Evaluation System Framework (Freva - freva.met.fu-berlin.de) is a software infrastructure for standardized data and tool solutions in Earth system science. Freva runs on high performance computers to handle customizable evaluation systems of research projects, institutes or universities. It combines different software technologies into one common hybrid infrastructure, including all features present in the shell and web environment. The database interface satisfies the international standards provided by the Earth System Grid Federation (ESGF). Freva indexes different data projects into one common search environment by storing the meta data information of the self-describing model, reanalysis and observational data sets in a database. This implemented meta data system with its advanced but easy-to-handle search tool supports users, developers and their plugins to retrieve the required information. A generic application programming interface (API) allows scientific developers to connect their analysis tools with the evaluation system independently of the programming language used. Users of the evaluation techniques benefit from the common interface of the evaluation system without any need to understand the different scripting languages. Facilitation of the provision and usage of tools and climate data automatically increases the number of scientists working with the data sets and identifying discrepancies. The integrated webshell (shellinabox) adds a degree of freedom in the choice of the working environment and can be used as a gate to the research projects HPC. Plugins are able to integrate their e.g. post-processed results into the database of the user. This allows e.g. post-processing plugins to feed statistical analysis plugins, which fosters an active exchange between plugin developers of a research project. Additionally, the history and configuration sub-systemstores every analysis performed with the evaluation system in a database. Configurations and results of the toolscan be shared among scientists via shell or web system. Therefore, plugged-in tools benefit from transparency and reproducibility. Furthermore, if configurations match while starting an evaluation plugin, the system suggests touse results already produced by other users – saving CPU/h, I/O, disk space and time. The efficient interaction between different technologies improves the Earth system modeling science framed by Freva.</p><p>New Features and aspects of further development and collaboration are discussed.</p><p> </p>


2021 ◽  
Author(s):  
Etor E. Lucio-Eceiza ◽  
Christopher Kadow ◽  
Martin Bergemann ◽  
Mahesh Ramadoss ◽  
Brian Lewis ◽  
...  

<p>The number of damaging events caused by natural disasters are increasing because of climate change. Projects of public interest such as ClimXtreme (Climate Change and Extreme Events [1, 2]), aim to improve our knowledge of extreme events, the influence of environmental changes and their societal impacts.</p> <p>ClimXtreme takes a holistic approach this problem through different knowledge areas. For that, projects like this need a coordinate effort from many interdisciplinary groups. On the other hand, the continuous improvement of numerical models and increase on observational data availability provides researchers with a growing amount of data to analyze, and the need for greater resources to host, access, and evaluate them efficiently through High Performance Computing (HPC) infrastructures is growing more than ever. Finally, the emphasis these last years on FAIR data principles [3] and the easy reproducibility of evaluation workflows also requires a framework that facilitates these tasks. Freva (Free Evaluation System Framework [4, 5]) is an efficient solution to handle customizable evaluation systems of large research projects, institutes or universities in the Earth system community [6-8] over the HPC environment and in a centralized manner.</p> <p>Freva is a scientific software infrastructure for standardized data and analysis tools (plugins) that provides all its available features both in a shell and web environment. Written in python, is equipped with a standardized model database, an application-programming interface (API) and a history of evaluations, among others:</p> <ul> <li>An implemented metadata system in SOLR with its own search tool allows scientists and their plugins to retrieve the required information from a centralized database. The databrowser interface satisfies the international standards provided by the Earth System Grid Federation (ESGF, e.g. [9]).</li> <li>An API allows scientific developers to connect their plugins with the evaluation system independently of the programming language. The connected plugins are able to access from and integrate their results back to the database, allowing for a concatenation of plugins as well. This ecosystem increases the number of scientists involved in the studies, boosting the interchange of results and ideas. It also fosters an active collaboration between plugin developers.</li> <li>The history and configuration sub-system stores every analysis performed with Freva in a MySQL database. Analysis configurations and results can be searched and shared among the scientists, offering transparency and reproducibility, and saving CPU hours, I/O, disk space and time.</li> </ul> <p>The usage of Freva in the context of ongoing large projects like ClimXtreme will be discussed. Additionally, major updates of the software, system deployment, and core functionalities will be presented.</p> <p><strong> </strong></p> <p><strong>References:</strong></p> <p>[1] https://www.fona.de/de/massnahmen/foerdermassnahmen/climxtreme.php</p> <p>[2] https://www.climxtreme.net/index.php/en/</p> <p>[3] https://www.go-fair.org/fair-principles/</p> <p>[4] Kadow, C. et al. , 2021. Introduction to Freva – A Free Evaluation System Framework for Earth System Modeling. <em>JORS</em>. http://doi.org/10.5334/jors.253</p> <p>[5] gitlab.dkrz.de/freva</p> <p>[6] freva.met.fu-berlin.de</p> <p>[7] https://www.xces.dkrz.de/</p> <p>[8] www-regiklim.dkrz.de</p> <p>[9] https://esgf-data.dkrz.de/projects/esgf-dkrz/</p>


2021 ◽  
Vol 9 ◽  
Author(s):  
Christopher Kadow ◽  
Sebastian Illing ◽  
Etor E. Lucio-Eceiza ◽  
Martin Bergemann ◽  
Mahesh Ramadoss ◽  
...  

Geophysics ◽  
2016 ◽  
Vol 81 (3) ◽  
pp. P23-P31 ◽  
Author(s):  
Rik Noorlandt ◽  
Guy Drijkoningen

The geometry of the contact between a vibrator and the earth underneath influences the dynamics of the vibrator. Although a vibrator might appear to be well-coupled with the earth on a macroscale, perfect coupling certainly does not occur on the microscale. With the aid of contact mechanical modeling and concepts, it can be shown that this lack of contact at the microscale, or rather the change thereof during a sweep, can have a significant effect on the dynamics of the vibrator-earth system. Modeling of such changing contact predicts that the dynamic behavior varies considerably with the vibrator drive level. The most significant effect predicted by the model is a decrease in the base-plate resonance frequency with an increasing drive level. Extensive drive-level tests carried out in a field experiment confirm this change of resonance behavior with drive level.


2014 ◽  
Vol 29 ◽  
pp. 1515-1524 ◽  
Author(s):  
Dali Wang ◽  
Joseph Schuchart ◽  
Tomislav Janjusic ◽  
Frank Winkler ◽  
Yang Xu ◽  
...  

2019 ◽  
Vol 9 (4) ◽  
pp. 189
Author(s):  
Xiaoping Huang ◽  
Yang-Zi Chen

In the construction of “Double First-Class” universities, how to establish an evaluation system of universities’ scientific and technological innovation capacity with Chinese characteristics and international standards will determine the direction and level of improvement of Chinese university’s technological innovation capacity. The system of scientific and technological innovation in university is a complex system, and the existing evaluation index and evaluation system may be difficult to meet the actual needs of the national construction of “Double First-Class” universities in the new situation, so the evaluation index should be a breakthrough and innovation. This paper probes into the existing problems in the evaluation system of scientific research in China, systematically investigate the common and different features of scientific research evaluation in Britain, America, France and Australia, puts forward the new connotation of the structure dimension of Chinese universities’ scientific and technological innovation capacity, and points out the basic criterion of constructing the evaluation system of university scientific and technological innovation capacity: First, design of indicators should reflect the development trend of the world, and reflect the cultural characteristics and historical background of Chinese universities. Second, it is necessary to according to the “world standard”, reflect the value orientation and practice standard of Chinese university construction. Third, taking differentiated design and establishing a classification evaluation standard. Fourth, the evaluative dimension should reflect the diversification of evaluation content, especially considering to optimize overall scientific research ecology.


Author(s):  
Supercomputing Support

JUWELS is a multi-petaflop modular supercomputer operated by Jülich Supercomputing Centre at Forschungszentrum Jülich as a European and national supercomputing resource for the Gauss Centre for Supercomputing. In addition, JUWELS serves the Earth system modeling community within the Helmholtz Association. The first module deployed in 2018, is a Cluster module based on the BullSequana X1000 architecture with Intel Xeon Skylake-SP processors and Mellanox EDR InfiniBand. An extension by a second Booster module is scheduled for deployment in 2020.


Sign in / Sign up

Export Citation Format

Share Document