Representation of Socio-historical Context to Support the Authoring and Presentation of Multimodal Narratives: The Mingei Online Platform

In this article, the Mingei Online Platform is presented as an authoring platform for the representation of social and historic context encompassing a focal topic of interest. The proposed representation is employed in the contextualised presentation of a given topic, through documented narratives that support its presentation to diverse audiences. Using the obtained representation, the documentation and digital preservation of social and historical dimensions of Cultural Heritage are demonstrated. The implementation follows the Human-Centred Design approach and has been conducted under an iterative design and evaluation approach involving both usability and domain experts.

Fault Injection Attack Emulation Framework for Early Evaluation of IC Designs

Fault injection attack (FIA) has become a serious threat to the confidentiality and fault tolerance of integrated circuits (ICs). Circuit designers need an effective method to evaluate the countermeasures of the IC designs against the FIAs at the design stage. To address the need, this article, based on FPGA emulation, proposes an in-circuit early evaluation framework, in which FIAs are emulated with parameterized fault models. To mimic FIAs, an efficient scan approach is proposed to inject faults at any time at any circuit nodes, while both the time and area overhead of fault injection are reduced. After the circuit design under test (CUT) is submitted to the framework, the scan chains insertion, fault generation, and fault injection are executed automatically, and the evaluation result of the CUT is generated, making the evaluation a transparent process to the designers. Based on the framework, the confidentiality and fault-tolerance evaluations are demonstrated with an information-based evaluation approach. Experiment results on a set of ISCAS89 benchmark circuits show that on average, our approach reduces the area overhead by 41.08% compared with the full scan approach and by over 20.00% compared with existing approaches. The confidentiality evaluation experiments on AES-128 and DES-56 and the fault-tolerance evaluation experiments on two CNN circuits, a RISC-V core, a Cordic core, and the float point arithmetic units show the effectiveness of the proposed framework.

Do You Ever Get Off Track in a Conversation? The Conversational System’s Anatomy and Evaluation Metrics

Conversational systems are now applicable to almost every business domain. Evaluation is an important step in the creation of dialog systems so that they may be readily tested and prototyped. There is no universally agreed upon metric for evaluating all dialog systems. Human evaluation, which is not computerized, is now the most effective and complete evaluation approach. Data gathering and analysis are evaluation activities that need human intervention. In this work, we address the many types of dialog systems and the assessment methods that may be used with them. The benefits and drawbacks of each sort of evaluation approach are also explored, which could better help us understand the expectations associated with developing an automated evaluation system. The objective of this study is to investigate conversational agents, their design approaches and evaluation metrics. This approach can help us to better understand the overall process of dialog system development, and future possibilities to enhance user experience. Because human assessment is costly and time consuming, we emphasize the need of having a generally recognized and automated evaluation model for conversational systems, which may significantly minimize the amount of time required for analysis.

Integrative Smart Grids’ Assessment System

The COVID-19 pandemic has significantly affected the energy sector. The new behavior of industrial and non-commercial consumers changes the energy consumption model. In addition, the constraints associated with the coronavirus crisis have led to environmental effects from declining economic activity. The research is based on evidence from around the world showing significant reductions in emissions and improved air quality. This situation requires rethinking the energy development strategy, particularly the construction of smart grids as a leading direction of energy development. Evaluating the efficiency of smart grids is a vital tool for disseminating successful experience in improving their management. This paper proposes an approach to a comprehensive assessment of smart grids based on a comparative analysis of existing methods, taking into account the changes that need to be considered after the experience gained from the COVID-19 pandemic. The approach provides an accurate set of efficiency indicators for assessing smart grids to account for the direct and indirect effects of smart grids’ implementation. This evaluation approach can be helpful to policymakers in developing energy efficiency programs and implementing energy policy.

Using rapid evaluation methods to assess service delivery changes: Lessons learned for evaluation practice during the COVID-19 pandemic

The COVID-19 pandemic required large-scale service delivery changes for government, and provided the opportunity for evaluators to step up and support decision makers to understand the impact of these changes. Rapid evaluation methods (REM) provide a pragmatic approach for generating timely information for evidence-based policy and decision-making. Grounded in developmental and utilisation-focused evaluation theory, REM incorporates a team-based, mixed methods design, executed over a 6–8-week period. Customised rubrics were used to rigorously assess effectiveness and scalability of practice changes to inform COVID-19 response planning. REM is an alternative approach to full-scale evaluation models frequently implemented to assess policies and programs. Adapted use of REM suggests that meaningful insights can be gained through use of smaller scale evaluations. This article shares lessons learned from a novel rapid evaluation method applied in the context of the COVID-19 pandemic. The rapid evaluation approach was implemented to provide real-time insights and evaluative conclusions for 15 program and practice adaptations across Victorian health and human service settings. The article shares insights about the practical applicability of balancing rigour and timeliness when implementing a rapid evaluation, and strengths and limitations of working within a fast-paced evaluation framework. Findings can inform evaluative practice in resource and time-limited settings.

Part 1 - Looking Back and Looking Around: How Parents, Coaches and Athletes See Psychosocial Development in Adolescent Performance Sport.

Sport has the potential to support psychosocial development in young people. However, extant studies have tended to evaluate purpose-built interventions, leaving regular organised sport relatively overlooked. Moreover, previous work has tended to concentrated on a narrow range of outcomes. To address these gaps, we conducted a season-long ethnography of a youth performance sport club based on a novel Realist Evaluation approach [1]. We construed the club as a social intervention within a complex system of agents and structures. In this - Part 1 - account we detail the perceptions of former and current club parents, players and coaches, using them to build a set of programme theories. The resulting network of outcomes (i.e. self, emotional, social, moral and cognitive) and generative mechanisms (i.e., the attention factory, the greenhouse for growth, the personal boost, and the real-life simulator) spanning across multiple contextual layers provides a nuanced understanding of stakeholders’ views and experiences. This textured perspective of the multi-faceted process of development provides new insights for administrators, coaches and parents to maximise the developmental properties of youth sport, and signposts new avenues for research in this area.

Integration of Energy Oriented Manufacturing Simulation into the Life Cycle Evaluation of Lightweight Body Parts

Recent years introduced process and material innovations in the design and manufacturing of lightweight body parts for larger scale manufacturing. However, lightweight materials and new manufacturing technologies often carry a higher environmental burden in earlier life cycle stages. The prospective life cycle evaluation of lightweight body parts remains to this day a challenging task. Yet, a functioning evaluation approach in early design stages is the prerequisite for integrating assessment results in engineering processes and thus allowing for a life cycle oriented decision making. The current paper aims to contribute to the goal of a prospective life cycle evaluation of fiber-reinforced lightweight body parts by improving models that enable to predict energy and material flows in the manufacturing stage. To this end, a modeling and simulation approach has been developed that integrates bottom-up process models into a process chain model. The approach is exemplarily applied on a case study of a door concept. In particular, the energy intensity of compression molding of glass fiber and carbon fiber sheet molding compounds has been analyzed and compared over the life cycle with a steel reference part.

Unified Website Accessibility Assessment Framework

In this chapter, a unified web accessibility assessment (UWAA) framework and its software has been proposed. UWAA framework was developed by considering Web Content Accessibility Guideline 2.0 to evaluate accessibility of web sites by integrating more than one evaluation approach. Achecker tool as an automated evaluation approach and barrier walkthrough (BW) as an expert-based evaluation approach were integrated in the UWAA framework. The framework also provides suggestions to recover from the problems determined to the evaluators. The websites of three universities were evaluated to determine the framework's accuracy and consistency. It was revealed that the results obtained from automated and expert-based evaluation methods were consistent and complementary with each other. Furthermore, it has been demonstrated that problems which cannot be determined by an automated tool but which can be detected by an expert can be identified by BW method.