Analyses for elucidating current question answering technology

2001 ◽  
Vol 7 (4) ◽  
pp. 325-342 ◽  
Author(s):  
MARC LIGHT ◽  
GIDEON S. MANN ◽  
ELLEN RILOFF ◽  
ERIC BRECK

In this paper, we take a detailed look at the performance of components of an idealized question answering system on two different tasks: the TREC Question Answering task and a set of reading comprehension exams. We carry out three types of analysis: inherent properties of the data, feature analysis, and performance bounds. Based on these analyses we explain some of the performance results of the current generation of Q/A systems and make predictions on future work. In particular, we present four findings: (1) Q/A system performance is correlated with answer repetition; (2) relative overlap scores are more effective than absolute overlap scores; (3) equivalence classes on scoring functions can be used to quantify performance bounds; and (4) perfect answer typing still leaves a great deal of ambiguity for a Q/A system because sentences often contain several items of the same type.

Author(s):  
Eileen B. Entin ◽  
Elliot E. Entin

Assessing the impact of providing a decision aid on decision time, workload, and performance is critical for optimizing overall human-system performance. This paper first examines the effects of providing a decision aid on decision time and workload and then looks at the effects of decision time and decision-aid accuracy on performance. Results show that the availability of a decision aid exacts a penalty in decision time but provides a significant decrease in cognitive workload. The availability of a decision aid significantly increases operators' performance, but does not raise it to the performance level that a high accuracy decision aid would achieve. Contrary to expectation, a longer decision time has a negative effect on performance, especially with a low accuracy decision aid. The results indicate the importance of providing operators with training in use of a decision aid so they develop an accurate mental model of how it works and how to optimize the integration of its judgments with their own.


2017 ◽  
Vol 16 (2) ◽  
pp. 61-76 ◽  
Author(s):  
Anaïs Thibault Landry ◽  
Marylène Gagné ◽  
Jacques Forest ◽  
Sylvie Guerrero ◽  
Michel Séguin ◽  
...  

Abstract. To this day, researchers are debating the adequacy of using financial incentives to bolster performance in work settings. Our goal was to contribute to current understanding by considering the moderating role of distributive justice in the relation between financial incentives, motivation, and performance. Based on self-determination theory, we hypothesized that when bonuses are fairly distributed, using financial incentives makes employees feel more competent and autonomous, which in turn fosters greater autonomous motivation and lower controlled motivation, and better work performance. Results from path analyses in three samples supported our hypotheses, suggesting that the effect of financial incentives is contextual, and that compensation plans using financial incentives and bonuses can be effective when properly managed.


Sensors ◽  
2021 ◽  
Vol 21 (15) ◽  
pp. 5242
Author(s):  
Jolene Ziyuan Lim ◽  
Alexiaa Sim ◽  
Pui Wah Kong

The aim of this review is to investigate the common wearable devices currently used in field hockey competitions, and to understand the hockey-specific parameters these devices measure. A systematic search was conducted by using three electronic databases and search terms that included field hockey, wearables, accelerometers, inertial sensors, global positioning system (GPS), heart rate monitors, load, performance analysis, player activity profiles, and competitions from the earliest record. The review included 39 studies that used wearable devices during competitions. GPS units were found to be the most common wearable in elite field hockey competitions, followed by heart rate monitors. Wearables in field hockey are mostly used to measure player activity profiles and physiological demands. Inconsistencies in sampling rates and performance bands make comparisons between studies challenging. Nonetheless, this review demonstrated that wearable devices are being used for various applications in field hockey. Researchers, engineers, coaches, and sport scientists can consider using GPS units of higher sampling rates, as well as including additional variables such as skin temperatures and injury associations, to provide a more thorough evaluation of players’ physical and physiological performances. Future work should include goalkeepers and non-elite players who are less studied in the current literature.


2021 ◽  
Vol 13 (7) ◽  
pp. 3866
Author(s):  
Joana Costa ◽  
Ana Rita Neves ◽  
João Reis

Open innovation is proved to be determinant in the rationalization of sustainable innovation ecosystems. Firms, universities, governments, user communities and the overall environment are called to contribute to this dynamic process. This study aims to contribute to a better understanding of the impact of open innovation on firms’ performance and to empirically assess whether university-industry collaborations are complementary or substitutes for this activity. Primary data were collected from a survey encompassing 908 firms, and then combined with performance indicators from SABI (Spanish and Portuguese business information). Econometric estimations were run to evaluate the role of open innovation and university-industry collaboration in the firm innovative propensity and performance. Results highlight the importance of diversity in collaborations with the academia and inbound open innovation strategy as enhancers of firm performance. The two activities reinforce each other. By testing the impact of open innovation practices on company performance, the need for heterogeneity in terms of contact type and university is also demonstrated. Findings cast light on the need to reformulate existing policy packages, reinforcing the ties with academia as well as the promotion of open innovation strategies. The connection to the innovation ecosystem needs to be further encouraged as well as the promotion of persistent connections with the knowledge sources in an open and multilateral framework.


Electronics ◽  
2020 ◽  
Vol 9 (2) ◽  
pp. 346 ◽  
Author(s):  
Lili Shen ◽  
Ning Wu ◽  
Gaizhen Yan

By using through-silicon-vias (TSV), three dimension integration technology can stack large memory on the top of cores as a last-level on-chip cache (LLC) to reduce off-chip memory access and enhance system performance. However, the integration of more on-chip caches increases chip power density, which might lead to temperature-related issues in power consumption, reliability, cooling cost, and performance. An effective thermal management scheme is required to ensure the performance and reliability of the system. In this study, a fuzzy-based thermal management scheme (FBTM) is proposed that simultaneously considers cores and stacked caches. The proposed method combines a dynamic cache reconfiguration scheme with a fuzzy-based control policy in a temperature-aware manner. The dynamic cache reconfiguration scheme determines the size of the cache for the processor core according to the application that reaches a substantial amount of power consumption savings. The fuzzy-based control policy is used to change the frequency level of the processor core based on dynamic cache reconfiguration, a process which can further improve the system performance. Experiments show that, compared with other thermal management schemes, the proposed FBTM can achieve, on average, 3 degrees of reduction in temperature and a 41% reduction of leakage energy.


2005 ◽  
Vol 20 (16) ◽  
pp. 3811-3814
Author(s):  
◽  
PAUL LUJAN

A new silicon detector was designed by the CDF collaboration for Run IIb of the Tevatron at Fermilab. The main building block of the new detector is a "supermodule" or "stave", an innovative, compact and lightweight structure of several readout hybrids and sensors with a bus cable running directly underneath the sensors to carry power, data, and control signals to and from the hybrids. The hybrids use a new, radiation-hard readout chip, the SVX4 chip. A number of SVX4 chips, readout hybrids, sensors, and supermodules were produced and tested in preproduction. The performance (including radiation-hardness) and yield of these components met or exceeded all design goals. The detector design goals, solutions, and performance results are presented.


2021 ◽  
Vol 22 (1) ◽  
Author(s):  
Chengshu Xie ◽  
Shaurya Jauhari ◽  
Antonio Mora

Abstract Background Gene Set Analysis (GSA) is arguably the method of choice for the functional interpretation of omics results. The following paper explores the popularity and the performance of all the GSA methodologies and software published during the 20 years since its inception. "Popularity" is estimated according to each paper's citation counts, while "performance" is based on a comprehensive evaluation of the validation strategies used by papers in the field, as well as the consolidated results from the existing benchmark studies. Results Regarding popularity, data is collected into an online open database ("GSARefDB") which allows browsing bibliographic and method-descriptive information from 503 GSA paper references; regarding performance, we introduce a repository of jupyter workflows and shiny apps for automated benchmarking of GSA methods (“GSA-BenchmarKING”). After comparing popularity versus performance, results show discrepancies between the most popular and the best performing GSA methods. Conclusions The above-mentioned results call our attention towards the nature of the tool selection procedures followed by researchers and raise doubts regarding the quality of the functional interpretation of biological datasets in current biomedical studies. Suggestions for the future of the functional interpretation field are made, including strategies for education and discussion of GSA tools, better validation and benchmarking practices, reproducibility, and functional re-analysis of previously reported data.


1975 ◽  
Vol 12 (02) ◽  
pp. 146-162
Author(s):  
J. A. Beverley ◽  
R. L. Koch ◽  
E. C. Stewart ◽  
J. Weiks

This paper describes the ac-rectified dc propulsion system designed for the two ferry vessels, MV Spokane and MV Walla Walla, and reports the results of an analog study conducted as a design tool. Similar data are presented showing the results obtained by recording electrical system performance during builder's trials.


Sign in / Sign up

Export Citation Format

Share Document