scholarly journals An improved multivariable integrated evaluation method and NCL code for multimodel intercomparison (MVIETool version 1.0)

2020 ◽  
Author(s):  
Meng-Zhuo Zhang ◽  
Zhongfeng Xu ◽  
Ying Han ◽  
Weidong Guo
Keyword(s):  
Vector Fields ◽  
Evaluation Method ◽  
Comprehensive Evaluation ◽  
Model Performance ◽  
Field Evaluation ◽  
Scalar Fields ◽  
Skill Score ◽  
Global Evaluation ◽  
Evaluation Tool ◽  
Multiple Variables

Abstract. An evaluation of a model's overall performance in simulating multiple fields is fundamental to model intercomparison and development. A multivariable integrated evaluation (MVIE) method was proposed previously based on a vector field evaluation (VFE) diagram, which can provide quantitative and comprehensive evaluation on multiple fields. In this study, we make further improvements to this method from the following aspects. (1) We take area weighting into account in the definition of statistics in the VFE diagram and MVIE method, which is particularly important for a global evaluation. (2) We consider the combination of multiple scalar fields and vector fields against multiple scalar fields alone in the previous MVIE method. (3) A multivariable integrated skill score (MISS) is proposed as a flexible index to measure a model’s ability to simulate multiple fields. Compared with the MIEI proposed in the previous study, MISS is a normalized index that can adjust the relative importance of different aspects of model performance. (4) A simple-to-use and straightforward tool, the Multivariable Integrated Evaluation Tool (MVIETool), is developed to facilitate an intercomparison of the performance of various models. The tool is coded with the open-source NCAR Command Language (NCL), which provides a calculation of MVIE statistics and plotting. With the support of this tool, one can easily evaluate model performance in terms of each individual variable and/or multiple variables.

scholarly journals An improved multivariable integrated evaluation method and tool (MVIETool) v1.0 for multimodel intercomparison

2021 ◽  
Vol 14 (5) ◽  
pp. 3079-3094
Author(s):  
Meng-Zhuo Zhang ◽  
Zhongfeng Xu ◽  
Ying Han ◽  
Weidong Guo
Keyword(s):  
Vector Fields ◽  
Evaluation Method ◽  
Comprehensive Evaluation ◽  
Model Performance ◽  
Field Evaluation ◽  
Scalar Fields ◽  
Skill Score ◽  
Global Evaluation ◽  
Evaluation Tool ◽  
Multiple Variables

Abstract. An evaluation of a model's overall performance in simulating multiple fields is fundamental to model intercomparison and development. A multivariable integrated evaluation (MVIE) method was proposed previously based on a vector field evaluation (VFE) diagram, which can provide quantitative and comprehensive evaluation on multiple fields. In this study, we make further improvements to this method from the following aspects. (1) We take area weighting into account in the definition of statistics in the VFE diagram and MVIE method, which is particularly important for a global evaluation. (2) We consider the combination of multiple scalar fields and vector fields against multiple scalar fields alone in the previous MVIE method. (3) A multivariable integrated skill score (MISS) is proposed as a flexible index to measure a model's ability to simulate multiple fields. Compared with the multivariable integrated evaluation index (MIEI) proposed in the previous study, MISS is a normalized index that can adjust the relative importance of different aspects of model performance. (4) A simple-to-use and straightforward tool, the Multivariable Integrated Evaluation Tool (MVIETool version 1.0), is developed to facilitate an intercomparison of the performance of various models. Users can use the tool coded either with the open-source NCAR Command Language (NCL) or Python3 to calculate the MVIE statistics and plotting. With the support of this tool, one can easily evaluate model performance in terms of each individual variable and/or multiple variables.

scholarly journals Multivariable Integrated Evaluation of Model Performance with the Vector Field Evaluation Diagram

2017 ◽  
Author(s):  
Zhongfeng Xu ◽  
Ying Han ◽  
Congbin Fu
Keyword(s):  
Vector Field ◽  
Root Mean Square ◽  
Climate Model ◽  
Model Performance ◽  
Field Evaluation ◽  
Scalar Fields ◽  
General Idea ◽  
Evaluation Methodology ◽  
Mean Square ◽  
Pattern Similarity

Abstract. This paper develops a multivariable integrated evaluation (MVIE) method to measure the overall performance of climate model in simulating multiple fields. The general idea of MVIE is to group various scalar fields into a vector field and compare the constructed vector field against the observed one using the vector field evaluation (VFE) diagram. The VFE diagram was devised based on the cosine relationship between three statistical quantities: root mean square length (RMSL) of a vector field, vector field similarity coefficient, and root mean square vector deviation (RMSVD). The three statistical quantities can reasonably represent the corresponding statistics between two multidimensional vector fields. Therefore, one can summarize the three statistics of multiple scalar fields using VFE diagram and facilitate the intercomparison of model performances. The VFE diagram can illustrate how much the overall root mean square deviation of various fields is attributable to the differences in the root mean square value and how much is due to the poor pattern similarity. The MVIE method can be flexibly applied to full fields (including both the mean and anomaly) or anomaly fields depending on the application. We also propose a multivariable integrated evaluation index (MIEI) which takes the amplitude and pattern similarity of multiple scalar fields into account. The MIEI is expected to provide a more accurate evaluation of model performance in simulating multiple fields. The MIEI, VFE diagram, and commonly used statistical metrics for individual variables constitute a hierarchical evaluation methodology, which can provide a more comprehensive evaluation on model performance.

scholarly journals Evaluation of innovative technology market potential on the basis of technology audit

2019 ◽  
Vol 15 (2) ◽  
pp. 30-41
Author(s):  
Oleksandra Kosenko ◽  
Victoriia Cherepanova ◽  
Iryna Dolyna ◽  
Viktoriia Matrosova ◽  
Olena Kolotiuk
Keyword(s):  
Business Processes ◽  
Evaluation Method ◽  
Comprehensive Evaluation ◽  
Market Potential ◽  
Innovation Activity ◽  
Innovative Technology ◽  
Evaluation Tool ◽  
Enterprise Innovation ◽  
Technology Market ◽  
Structure Evaluation

Enterprise innovation activity supposes coordinated technical and business processes of decision-making and its performance required for successful transformation of new product or service from concept to market. The purpose of this study is to develop valuation methods of innovative technology market potential and prospects of their introduction into the production enterprise activity. In order to achieve this goal, we used brand new evaluation tool, this is technology audit conception, application of which increased significantly the accuracy and reliability of technology market potential evaluation. Clarification of terminological essence of technological audit allowed the authors to discover the content of technology audit components required for the market research and thereupon to develop evaluation mechanism for innovative technology market potential using technology audit. This mechanism is built on structure evaluation table of technology market potential level detection as an object of commercialization. To ensure the efficiency of practical effect of the mechanism proposed, the authors systematized and completed methods of functional analysis and scanning of market environment for the purpose of qualitative comprehensive evaluation and innovative technology market potential forecasting.Introduction of the proposed evaluation method for technology market potential will result in the improvement of efficiency of enterprise innovation activity due to more rational distribution of available resources and immediate financing of developments with greater market potential.

scholarly journals Academic Management Android Application For Student Performance Analytics: A Comprehensive Evaluation Using Iso 25010:2011

2019 ◽  
Vol 8 (12) ◽  
pp. 5085-5089
Keyword(s):  
Student Performance ◽  
Software Quality ◽  
Comprehensive Evaluation ◽  
Model Performance ◽  
Department Heads ◽  
Evaluation Tool ◽  
Online Student ◽  
Software Quality Management ◽  
Tracer System

Software quality standards are very significant matters nowadays, especially that this era reigns with software technology and systems to innovate the work process in any institution. Assessments are conducted to measure the quality of services as well as products. This paper focuses on the comparison of the assessment of an existing alumni tracer system and online student portal using ISO/IEC 25010 model, but only seven dimensions was used namely functional suitability, performance efficiency, usability, reliability, security, maintainability and portability. Twenty I.T. experts were invited to test the existing systems and fill in the survey. The results as describe in this paper shows the significant differences of systems as evaluated by the respondents using the ISO/IEC 25010 model. Performance Assessment is very vital to the academic progress of a student. It should be monitored, and evaluated to allow both professors and students create pre-emptive measures to ensure their success rate. This paper focuses on the assessment of the developed system using ISO 25010:2011 Software Quality Management. The following criteria were used Functionality, Usability, Reliability, Portability and Security. 84 respondents comprising of Professors, Department Heads and IT Professionals assessed and evaluated the system through the use of an adapted evaluation tool. The results shown in this paper shows the evaluation of the respondents to the developed system

scholarly journals Multivariable integrated evaluation of model performance with the vector field evaluation diagram

2017 ◽  
Vol 10 (10) ◽  
pp. 3805-3820 ◽  
Author(s):  
Zhongfeng Xu ◽  
Ying Han ◽  
Congbin Fu
Keyword(s):  
Vector Field ◽  
Root Mean Square ◽  
Climate Model ◽  
Model Performance ◽  
Field Evaluation ◽  
Scalar Fields ◽  
General Idea ◽  
Evaluation Methodology ◽  
Mean Square ◽  
Pattern Similarity

Abstract. This paper develops a multivariable integrated evaluation (MVIE) method to measure the overall performance of climate model in simulating multiple fields. The general idea of MVIE is to group various scalar fields into a vector field and compare the constructed vector field against the observed one using the vector field evaluation (VFE) diagram. The VFE diagram was devised based on the cosine relationship between three statistical quantities: root mean square length (RMSL) of a vector field, vector field similarity coefficient, and root mean square vector deviation (RMSVD). The three statistical quantities can reasonably represent the corresponding statistics between two multidimensional vector fields. Therefore, one can summarize the three statistics of multiple scalar fields using the VFE diagram and facilitate the intercomparison of model performance. The VFE diagram can illustrate how much the overall root mean square deviation of various fields is attributable to the differences in the root mean square value and how much is due to the poor pattern similarity. The MVIE method can be flexibly applied to full fields (including both the mean and anomaly) or anomaly fields depending on the application. We also propose a multivariable integrated evaluation index (MIEI) which takes the amplitude and pattern similarity of multiple scalar fields into account. The MIEI is expected to provide a more accurate evaluation of model performance in simulating multiple fields. The MIEI, VFE diagram, and commonly used statistical metrics for individual variables constitute a hierarchical evaluation methodology, which can provide a more comprehensive evaluation of model performance.

scholarly journals Method of Desulfurization Process Selection Based on Improved Fuzzy Comprehensive Evaluation: A Case Study of Papermaking Desulfurization in China

Processes ◽  
2019 ◽  
Vol 7 (7) ◽  
pp. 446 ◽  
Author(s):  
Wang ◽  
Wang ◽  
Zhu ◽  
Gong
Keyword(s):  
Evaluation System ◽  
Evaluation Method ◽  
Comprehensive Evaluation ◽  
Fuzzy Comprehensive Evaluation ◽  
Process Selection ◽  
Evaluation Tool ◽  
Comprehensive Evaluation Method ◽  
Implementation Processes ◽  
Desulfurization Process

With the increasingly prominent global energy and environmental problems, more and more enterprises have been required to desulfurize the exhausted gases. Different enterprises have different demands for the desulfurization process, thus the choice of desulfurization process methods has become a focus of attention. Since the evaluation of the desulfurization process involves many factors, this paper proposes an improved fuzzy comprehensive evaluation method to evaluate the selection of desulfurization process when the traditional evaluation method is not applicable. Firstly, an evaluation system with two rating indicators was constructed, which considers the subjective and objective weights comprehensively. Secondly using the two hierarchical indicators, an effective desulfurization process method was obtained according to the principle of maximum membership degree. Finally, we took a real papermaking factory as an example to illustrate the detailed implementation processes of this method. The result shows that the model could be used as a comprehensive evaluation tool to select desulfurization scheme or optimize the desulfurization process.

Evaluation of CMIP6 Models Toward Dynamical Downscaling Over Eight CORDEX Domains

2021 ◽  
Author(s):  
Meng-Zhuo Zhang ◽  
Zhongfeng Xu ◽  
Ying Han ◽  
Weidong Guo
Keyword(s):  
Model Selection ◽  
Large Scale ◽  
Evaluation Method ◽  
Climate Model ◽  
Dynamical Downscaling ◽  
Global Climate ◽  
Global Climate Model ◽  
Model Performance ◽  
Uncertainty Range ◽  
Multiple Variables

Abstract Both reliability and independence of global climate model (GCM) simulation are essential for model selection to generate a reasonable uncertainty range of dynamical downscaling simulations. In this study, we evaluate the performance and interdependency of 37 GCMs from the Coupled Model Intercomparison Project Phase 6 (CMIP6) in terms of seven key large-scale driving fields over eight CORDEX domains. A multivariable integrated evaluation method is used to evaluate and rank the models’ ability to simulate multiple variables in terms of their climatological mean and interannual variability. The results suggest that the model performance varies considerably with seasons, domains, and variables evaluated, and no model outperforms in all aspects. However, the multi-model ensemble mean performs much better than any individual model. Among 37 CMIP6 models, the MPI-ESM1-2-HR, FIO-ESM-2-0, and MPI-ESM1-2-LR rank top three due to their overall good performance across all domains. To measure the model interdependency in terms of multiple fields, we define the similarity of multivariate error fields between pairwise models. Our results indicate that the dependence exists between most of the CMIP6 models, and the models sharing the same idea or/and concept generally show less independence. Furthermore, we hierarchically cluster the top 15 models based on the similarity of multivariate error fields to facilitate the model selection. Our evaluation can provide useful guidance on the selection of CMIP6 models based on their performance and relative independence, which helps to generate a more reliable ensemble of dynamical downscaling simulations with reasonable inter-model spread.

A fuzzy evaluation method of road vehicle automatic weighing instrument in dynamic force metrological performance

2020 ◽  
Vol 64 (1-4) ◽  
pp. 1365-1372
Author(s):  
Xiaohui Mao ◽  
Liping Fei ◽  
Xianping Shang ◽  
Jie Chen ◽  
Zhihao Zhao
Keyword(s):  
Evaluation Method ◽  
Comprehensive Evaluation ◽  
Evaluation Model ◽  
Dynamic Performance ◽  
Dynamic Force ◽  
Fuzzy Evaluation ◽  
Road Vehicle ◽  
Evaluation Standard ◽  
The Road ◽  
Metrological Performance

The measurement performance of road vehicle automatic weighing instrument installed on highways is directly related to the safety of roads and bridges. The fuzzy number indicates that the uncertain quantization problem has obvious advantages. By analyzing the factors affecting the metrological performance of the road vehicle automatic weighing instrument, combined with the fuzzy mathematics theory, the weight evaluation model of the dynamic performance evaluation of the road vehicle automatic weighing instrument is proposed. The factors of measurement performance are summarized and calculated, and the comprehensive evaluation standard of the metering performance of the weighing equipment is obtained, so as to realize the quantifiable analysis and evaluation of the metering performance of the dynamic road vehicle automatic weighing instrument in use, and provide data reference for adopting a more scientific measurement supervision method.

scholarly journals The hydrochemical characteristics and quality assessment of groundwater in Shuangliao City, China

2019 ◽  
Vol 98 ◽  
pp. 01034 ◽  
Author(s):  
Mingjun Liu ◽  
Changlai Xiao ◽  
Xiujuan Liang
Keyword(s):  
Groundwater Quality ◽  
Human Activities ◽  
Evaluation Method ◽  
Comprehensive Evaluation ◽  
Fuzzy Comprehensive Evaluation ◽  
Hydrochemical Characteristics ◽  
Analytic Hierarchy ◽  
Liaohe River ◽  
Geological Conditions ◽  
Type Water

In this study, a hydrochemical investigation was conducted in Shuangliao city to identify the hydrochemical characteristics and the quality of groundwater using descriptive statistics and correlation matrices. And on that basis, combined with Analytic hierarchy process (AHP), an improved two-level fuzzy comprehensive evaluation method is used to evaluate the groundwater quality. The results indicate that the major cations and anions in groundwater are Ca2+ and HCO3-, respectively. The chemical types are mainly HCO3—Ca type water, some areas are complicated due to the influence of human activities. The evaluation results show that the water quality in the area is mostly III type water, and the groundwater quality in some areas is IV or V water due to the influence of primary geological conditions or human activities. The groundwater quality in the East Liaohe River Valley and Shuangliao urban area is relatively poor, and in the northwest part which is the saline alkali soil area is also relatively poor.

Sign in / Sign up

Export Citation Format

Share Document