scholarly journals New Formats and Interfaces for Multi-Document News Summarization and its Evaluation

2014 ◽  
pp. 231-255 ◽  
Author(s):  
Bettina Berendt ◽  
Mark Last ◽  
Ilija Subašić ◽  
Mathias Verbeke
Keyword(s):  
Evaluation Process ◽  
Evaluation Framework ◽  
User Studies ◽  
News Production ◽  
Graphical Interfaces ◽  
Summary Representation ◽  
News Summarization ◽  
The One ◽  
Hardware Platforms ◽  
Automated Methods

News production, delivery, and consumption are increasing in ubiquity and speed, spreading over more software and hardware platforms, in particular mobile devices. This has led to an increasing interest in automated methods for multi-document summarization. The authors start this chapter with discussing several new alternatives for automated news summarization, with a particular focus on temporal text mining, graph-based methods, and graphical interfaces. Then they present automated and user-centric frameworks for cross-evaluating summarization methods that output different summary formats and describe the challenges associated with each evaluation framework. Based on the results of the user studies, the authors argue that it is crucial for effective summarization to integrate the user into sense-making through usable, entertaining, and ultimately useful interactive summarization-plus-document-search interfaces. In particular, graph-based methods and interfaces may be a better preparation for people to concentrate on what is essential in a collection of texts, and thus may be a key to enhancing the summary evaluation process by replacing the “one gold standard fits all” approach with carefully designed user studies built upon a variety of summary representation formats.

scholarly journals Competences of teachers of natural-physical sciences. An analysis from the perception of the students

2020 ◽  
Vol 1674 (1) ◽  
pp. 012020
Author(s):  
R Prada-Núñez ◽  
E T Ayala ◽  
W R Avendaño-Castro
Keyword(s):  
Educational Institution ◽  
Evaluation Process ◽  
Future Research ◽  
Physical Sciences ◽  
Four Dimensions ◽  
State Tests ◽  
Need To Evaluate ◽  
The Subject ◽  
The One ◽  
And Control

Abstract This article arises as a proposal in view of the need to evaluate the scientific competences promoted by teachers of the subject of physics at the level of basic secondary and secondary technical education. A valid questionnaire was designed from the application of scalar analysis, factorial analysis and content analysis, which is composed of 49 items evaluated by means of a Likert scale with five levels of response. It was applied in a sample of 249 students enrolled in a public educational institution during 2019, characterized by their good results in the area of physics in state tests. The results allowed the identification of strengths in the four dimensions proposed by the Ministerio de Educación Nacional, Colombia (pedagogical, didactic, disciplinary and behavioural), in contrast with some weaknesses within which the evaluation process stands out as the one with the greatest impact, since the students state that this process is assumed by the teacher as a mechanism of pressure and control. When investigating the teachers in a complementary way, positions were determined that were totally opposite to those held by the students, then it is suggested for future research to consider both the students and the teachers as informants and a supervision of the students’ notes as the end of triangulating the results to refine the conclusions, on which future improvement plans will depend.

Enhancing Accessibility to E-Government Processes

2010 ◽  
pp. 169-188
Author(s):  
Stefan Richter ◽  
Norbert Kuhn ◽  
Stefan Naumann ◽  
Michael Schmidt
Keyword(s):  
Speech Synthesis ◽  
Assistive Technologies ◽  
Electronic Government ◽  
Standard Document ◽  
Web Access ◽  
Software And Hardware ◽  
Scanned Images ◽  
Governmental Institutions ◽  
The One ◽  
Hardware Platforms

Many governmental institutions have started to provide their customers with access to governmental documents by electronic means. This changes the way of interaction between authorities and citizens considerably. Hence, it is worthwhile to look at both the chances and the risks that this process of change implies for disabled citizens. Due to different laws or legal directives governmental authorities have a particular responsibility to consider also the needs of handicapped persons. Therefore, they need to apply appropriate techniques for these groups to avoid an “Accessibility Divide”. This discussion is built on the observation that governmental processes are mostly based on the exchange of forms between authorities and citizens. Authors state that such processes can be distinguished into three scenarios, with the use of paper as means of transport on the one end and complete electronic treatment at the other end. For each scenario there exist tools to improve accessibility for people with certain disabilities. These tools include standard technologies like improved Web access by magnifying characters, assistive technologies like document cameras, and more sophisticated approaches like integrated solutions for handling forms and government processes. This chapter focuses on approaches that provide access to governmental processes for people with visual impairments, elderly people, illiterates, or immigrants. Additionally, it sees a chance to enable electronic government processes in developing countries where the citizens have less experience in handling IT-based processes. The main part of the chapter describes an approach to combine scanned images of paper-based forms containing textual information and textto- speech synthesis yielding an audio-visual document representation. It exploits standard document formats based on XML and web service technology to achieve independency from software and hardware platforms. This is also helpful for conventional governmental processes because people within the group of interest stated above often also have problems to access non-digitized information, for instance when they have to read announcements within public administration offices.

Evaluation of (power) side-channels in cryptographic implementations

2019 ◽  
Vol 61 (1) ◽  
pp. 15-28
Author(s):  
Florian Bache ◽  
Christina Plump ◽  
Jonas Wloka ◽  
Tim Güneysu ◽  
Rolf Drechsler
Keyword(s):  
Evaluation System ◽  
Evaluation Process ◽  
Physical Reality ◽  
Evaluation Framework ◽  
Side Channel ◽  
Side Channel Attacks ◽  
Side Channels ◽  
Efficient Data ◽  
Attack Surface ◽  
The Internet Of Things

Abstract Side-channel attacks enable powerful adversarial strategies against cryptographic devices and encounter an ever-growing attack surface in today’s world of digitalization and the internet of things. While the employment of provably secure side-channel countermeasures like masking have become increasingly popular in recent years, great care must be taken when implementing these in actual devices. The reasons for this are two-fold: The models on which these countermeasures rely do not fully capture the physical reality and compliance with the requirements of the countermeasures is non-trivial in complex implementations. Therefore, it is imperative to validate the SCA-security of concrete instantiations of cryptographic devices using measurements on the actual device. In this article we propose a side-channel evaluation framework that combines an efficient data acquisition process with state-of-the-art confidence interval based leakage assessment. Our approach allows a sound assessment of the potential susceptibility of cryptographic implementations to side-channel attacks and is robust against noise in the evaluation system. We illustrate the steps in the evaluation process by applying them to a protected implementation of AES.

scholarly journals Evaluating and Planning Green Infrastructure: A Strategic Perspective for Sustainability and Resilience

2019 ◽  
Vol 11 (10) ◽  
pp. 2726 ◽  
Author(s):  
Angioletta Voghera ◽  
Benedetta Giudice
Keyword(s):  
Case Studies ◽  
Green Infrastructure ◽  
Evaluation Process ◽  
Ecological Indicators ◽  
Social Ecological ◽  
The Social ◽  
The One ◽  
Strategic Perspective ◽  
Social Components

In the light of the current changing global scenarios, green infrastructure is obtaining increasing relevance in planning policies, especially due to its ecological, environmental and social components which contribute to pursuing sustainable and resilient planning and designing of cities and territories. The issue of green infrastructure is framed within the conceptual contexts of sustainability and resilience, which are described through the analysis of their common aspects and differences with a particular focus on planning elements. In particular, the paper uses two distinct case studies of green infrastructure as representative: the green infrastructure of the Region Languedoc-Roussillon in France and the one of the Province of Turin in Italy. The analysis of two case studies focuses on the evaluation process carried on about the social-ecological system and describes the methodologies and the social-ecological indicators used to define the green infrastructure network. We related these indicators to their possible contribution to the measurement of sustainability and resilience. The analysis of this relationship led us to outline some conclusive considerations on the complex role of the design of green infrastructure with reference to sustainability and resilience.

scholarly journals Multi Criteria Evaluation Framework for Prioritizing Indian Railway Stations Using Modified Rough AHP-Mabac Method

2018 ◽  
Vol 19 (2) ◽  
pp. 113-127 ◽  
Author(s):  
Haresh Kumar Sharma ◽  
Jagannath Roy ◽  
Samarjit Kar ◽  
Olegas Prentkovskis
Keyword(s):  
Multiple Criteria Decision Making ◽  
Evaluation Process ◽  
Evaluation Framework ◽  
Analytic Hierarchy ◽  
Railway Stations ◽  
Validity Testing ◽  
Multi Criteria Evaluation ◽  
Criteria Weights ◽  
Indian Railway ◽  
Hierarchy Process

Abstract This study proposes a hybrid multiple criteria decision making (MCDM) methodology for evaluating the performance of the Indian railway stations (IRS). Since the customers are heterogeneous and their requirements are often imprecise, the evaluation process is a critical step for prioritizing the IRS. To improve the existing approaches, an efficient evaluation technique has been proposed by integrating rough numbers, analytic hierarchy process (AHP) and multi-attribute border approximation area comparison (MABAC) methods in rough environment. The relative criteria weights based on their preferences given by experts is determined by rough AHP whereas evaluation of the alternatives based on these criteria are done by the modified rough MABAC method. A case study of prioritizing different railway stations in India is provided to demonstrate the efficiency and applicability of the proposed method. Among different criteria “proactively” is observed to be the most important criteria in our analysis, followed by ‘Railfanning’ and ‘DMO’ is found to be the best among the forty IRS in this study. Finally, a comparative analysis and validity testing of the proposed method are elaborated and the methodology provides a standard to select IRS on the basis of different criteria.

scholarly journals Improved White Blood Cells Classification based on Pre-trained Deep Learning Models

2020 ◽  
Vol 16 (1) ◽  
pp. 37-45 ◽  
Author(s):  
Ensaf H. Mohamed ◽  
Wessam H. El-Behaidy ◽  
Ghada Khoriba ◽  
Jie Li
Keyword(s):  
Machine Learning ◽  
Blood Cells ◽  
White Blood Cells ◽  
Evaluation Process ◽  
Cell Detection ◽  
Learning Classifier ◽  
Proposed Model ◽  
Higher Rank ◽  
Fully Connected ◽  
Automated Methods

Leukocytes, or white blood cells (WBCs), are microscopic organisms that fight against infectious disease, bacteria, viruses, and others. The manual method to classify and count WBCs is tedious, time-consuming and may has inaccurate results, whereas the automated methods are costly. The objective of this work is to automatically identify and classify WBCs in a microscopic image into four types with higher accuracy. BCCD is the used dataset in this study, which is a scaled down blood cell detection dataset. BCCD is firstly pre-processed by passing through several processes such as segmentation and augmentation,then it is passed to the proposed model. Our model combines the privilege of deep models in automatically extracting features with the higher classification accuracy of traditional machine learning classifiers.The proposed model consists of two main layers; a shallow tuning pre-trained model and a traditional machine learning classifier on top of it. Here, ten different pretrained models with six different machine learning are used in this study. Moreover, the fully connected network (FCN) of pretrained models is used as a baseline classifier for comparison. The evaluation process shows that the hybrid between MobileNet-224 as feature extractor with logistic regression as classifier has a higher rank-1 accuracy with 97.03%. Besides, the proposed hybrid model outperformed the baseline FCN with 25.78% on average.

scholarly journals Foresight evaluation: lessons from project management

foresight ◽  
2014 ◽  
Vol 16 (1) ◽  
pp. 75-91 ◽  
Author(s):  
Ekaterina A. Makarova ◽  
Anna Sokolova
Keyword(s):  
Project Management ◽  
Design Methodology ◽  
Quantitative Methods ◽  
Evaluation Model ◽  
Methodological Approach ◽  
Evaluation Process ◽  
Project Evaluation ◽  
Evaluation Framework ◽  
Content Type ◽  
Evaluation Procedures

Purpose – The aim of this paper is to identify ways for improvement of the foresight evaluation framework on the basis of analysis and systematisation of accumulated experience in the field of project management. Design/methodology/approach – The paper is based on a detailed literature review devoted to an evaluation of foresight and traditional projects. The approaches to project evaluation in the field of project management were investigated, and the main steps of traditional project evaluation process were determined. The most commonly applied steps of foresight evaluation were identified by the analysis of recent foresight evaluation projects. The comparison of evaluation frameworks for foresight projects and traditional projects allows to provide recommendations for foresight evaluation framework improvement. Findings – The paper identifies several lessons for foresight evaluation from project management. The elements which can enrich foresight evaluation framework are the following: the development of an evaluation model; the extensive use of quantitative methods; the elaboration of evaluation scales; the inclusion of economic indicators into evaluation; and the provision of more openness and transparency for evaluation results. Originality/value – Given the importance of foresight evaluation procedures and the lack of a commonly applied methodological approach, the value of this paper consists in identifying a foresight evaluation framework and enriching it with elements of project management.

scholarly journals Evaluating projects in multifaceted and marginalised communities: The need for mixed approaches

2019 ◽  
Vol 19 (1) ◽  
pp. 22-38 ◽  
Author(s):  
Liz Curran ◽  
Pamela Taylor-Barnett
Keyword(s):  
Young People ◽  
Service Delivery ◽  
Evaluation Process ◽  
Participatory Evaluation ◽  
Evaluation Framework ◽  
Legal Services ◽  
Community Agencies ◽  
Critical Elements ◽  
Complex Settings ◽  
Justice Practice

This article examines the evaluation process and approach undertaken for a recent 3-year Integrated Justice Practice project. Three key approaches underpinned the evaluation framework or program logic: participatory evaluation, action research, and continuous reflective practice. The project involved an evaluation of community agencies working in complex settings, within a human service delivery context. The mix of processes encouraged these agencies to own the evaluation through providing clarity and grounded information about what works, how, and what does not work and why, so as to improve both service delivery and community understanding, and to affect policy and funding settings. The discussion is situated within several theories of ‘participatory evaluation’ – meaning that the views of service receivers and providers were included both in the research and in its design. These perspectives were essential because input from young people about how legal services support them, and from providers about the policies services adopt is rare. The services and their partners reported that the evaluation process had been ‘transformative’, with each identifying changes in practice. It’s also edifying for the evaluators, revealing that cultural competency, trust, respect and safety are critical elements when engaging with young people with unresolved legal issues, including family violence.

scholarly journals Negotiating Professional News Judgment and “Clicks”

2013 ◽  
Vol 34 (2) ◽  
pp. 65-76 ◽  
Author(s):  
Michael Karlsson ◽  
Christer Clerwall
Keyword(s):  
Digital Media ◽  
Public Service ◽  
Evaluation Process ◽  
The Other ◽  
Traditional Authority ◽  
News Values ◽  
Commercial Media ◽  
The One

Abstract Digital media allow for instant tracking of audience behaviour, thus enabling a potential negotiation between journalists’ traditional authority and professional news values, on the one hand, and the audience’s power in terms of ignoring or paying attention to the journalistic outcome, on the other. The present study investigates whether clicks change news values and have an impact on news routines in tabloid, broadsheet and public service newsrooms. The findings indicate that audience metrics bring a new dimension to the news evaluation process regardless of publishing tradition, but that the commercial media seem to keep a closer tab on traffic. In general, journalists strive for a “good mix” between customization to achieve audience satisfaction and a desire for editorial independence.

Critical Evaluation Capital (CEC): A New Tool for Applying Critical Race Theory to the Evaluand

2021 ◽  
pp. 109821402110256
Author(s):  
Alice E. Ginsberg
Keyword(s):  
Critical Race Theory ◽  
Critical Evaluation ◽  
Evaluation Process ◽  
Symbolic Capital ◽  
Evaluation Framework ◽  
Critical Race ◽  
Risk Capital ◽  
Race Theory ◽  
Cultural Wealth ◽  
The Impact

This article presents a new tool called Critical Evaluation Capital (CEC) designed to address issues of equity and social justice in program evaluation. CEC is grounded in the tenants of critical race theory and inspired by Yosso’s work on community cultural wealth which raises critical issues of positionality and access. CEC is a system for identifying, quantifying, and disrupting the impact of different kinds of power and privilege (named here as capital) that influence the evaluation process and may distort its findings and/or alter its impact. CEC is not meant to be an entirely new evaluation framework or approach, but rather it is designed to be used as a “tool” in conjunction with other contemporary evaluation methodologies, specifically those that reposition the role of the evaluation from an “objective” outsider to an engaged stakeholder. I introduce and describe herein seven foundational categories of CEC, including framing capital, identity capital, connectivity capital, inquiry capital, risk capital, symbolic capital, and dissemination capital, along with a series of accompanying critical questions to guide reflective practice for each capital. I also describe how CEC can be applied across the evaluand—both proactively and retrospectively. I conclude with some key opportunities and challenges CEC presents for evaluators and other key stakeholder groups in the evaluand.

Sign in / Sign up

Export Citation Format

Share Document