A Perspective on Computer Assisted Assessment Techniques for Short Free-Text Answers

Author(s):  
Shourya Roy ◽  
Y. Narahari ◽  
Om D. Deshmukh
Author(s):  
Diana Pérez-Marín ◽  
Ismael Pascual-Nieto ◽  
Pilar Rodríguez

This chapter introduces the reader in the fields of automatic assessment of free-text students’ answers, student modeling and adaptive educational hypermedia. Traditionally, these fields have been studied separately missing the benefits of their synergic combination (i.e., free-text scoring systems which do not keep any student model, and adaptive educational hypermedia systems which do not use any natural language processing technique). In particular, a procedure to automatically generate students’ conceptual models from their answers to a free-text adaptive computer assisted assessment system will be fully described, together with its implementation in the will tools. Furthermore, the authors will explore how useful this new possibility of hybrid learning is both for teachers and students in two case studies carried out during the 2006-2007 and 2007-2008 academic years, in which traditional lessons were combined with the use of the Will Tools both in technical and non-technical domains.


Author(s):  
M. Douglass ◽  
G.D. Clifford ◽  
A. Reisner ◽  
G.B. Moody ◽  
R.G. Mark
Keyword(s):  

1970 ◽  
Vol 09 (03) ◽  
pp. 171-176
Author(s):  
L. J. Schneiderman ◽  
M. Baylor

The Facilitated Access File, described herein, has proved to be an acceptable, relatively simple, yet feasible strategy for general medical record information retrieval at a university hospital clinic. Physicians record physical examination data in free-text mode, then through a rapid exercise of judgment, create an index to these data which is computer-stored. Such an index file provides future investigators facilitated access back to the original handwritten data and permits a variety of statistical studies. The system has been in use for over a year and has proved to be of value in clinical research and student teaching.


Author(s):  
Navjeet Kaur ◽  
Kiran Jyoti

Assessment is an important activity in any educational process to evaluate the learner’s knowledge about the concepts learnt.. Evaluation through objective testing is common in all evaluation system, where Multiple Choice Questions, Fill in the Blanks, Matching etc. are used for evaluation. The method of objective testing is not sufficient to completely verify all the concepts learnt by the learner. Thus computer assisted assessment of short text answers is developed. Here we present a technique which also considers grammatical errors during automated evaluation of oneline sentence. In this paper we have define a set of evaluation criteria that covers all the relevant aspects of an essay assessment system and discussion on how this technique find syntactical errors during evaluation of student response.


2008 ◽  
Vol 8 (6) ◽  
pp. 544-547 ◽  
Author(s):  
Daniel R. Fassett ◽  
Ronald I. Apfelbaum ◽  
John A. Hipp

Object Fusion assessment after cervical arthrodesis can be subjective. Measures such as bridging bone quantification or extent of (limited) motion on dynamic studies are common but difficult to interpret and fraught with biases. We compared manual measurement and computer-assisted techniques in assessing fusion after anterior cervical discectomy and fusion (ACDF). Methods One hundred patients who underwent ACDF (512 intervertebral levels) were randomly selected for this radiographic review (follow-up 3–36 months). Two assessment techniques were performed by different observers, with each blinded to the results of the other. The manual spinous process displacement measurement technique was used to calculate motion between the spinous processes under magnification on a digital imaging workstation. Computer-assisted measurements of intervertebral angular motion were made using Quantitative Motion Analysis (QMA) software. Fusion criteria were arbitrarily set at 1 mm of motion for the manual technique and 1.5° of angular motion for the QMA technique. Results The manual measurement technique revealed fusion in 61.7% (316 of 512) of the interspaces assessed, and QMA revealed fusion in 64.3% (329 of 512). These two assessment techniques agreed in 87.5% of cases, with a correlation coefficient of 0.68 between the two data sets. In cases in which the two techniques did not agree, QMA revealed fusion and the manual measurement revealed nonfusion in 64% of the disagreements; 98% of the disagreements occurred when motion was < 2 mm or 2°. Conclusions Although osseous fusion after arthrodesis remains difficult to assess, new computer-assisted techniques may remove the subjectivity generally associated with assessing fusion.


2009 ◽  
Vol 24 (4) ◽  
pp. 353-374 ◽  
Author(s):  
Diana Pérez-Marín ◽  
Ismael Pascual-Nieto ◽  
Pilar Rodríguez

AbstractThe automatic assessment of students’ free-text answers has recently received much attention, due to the necessity of exploring and taking advantage of new and more complex computer-based assessment methods. In this paper, a review of the state-of-art of the field is presented, focusing on the techniques that underpin these systems and their evaluation metrics. Although there is still a long way to go so as to reach the ideal system, the fact that the existing systems are already being used commercially and as a second opinion in exams such as GMAT proves the uptake of this field.


2020 ◽  
Vol 20 (1) ◽  
Author(s):  
Chantal Arditi ◽  
Diana Walther ◽  
Ingrid Gilles ◽  
Saphir Lesage ◽  
Anne-Claude Griesser ◽  
...  

Abstract Background Patient experience surveys are increasingly conducted in cancer care as they provide important results to consider in future development of cancer care and health policymaking. These surveys usually include closed-ended questions (patient-reported experience measures (PREMs)) and space for free-text comments, but published results are mostly based on PREMs. We aimed to identify the underlying themes of patients’ experiences as shared in their own words in the Swiss Cancer Patient Experiences (SCAPE) survey and compare these themes with those assessed with PREMs to investigate how the textual analysis of free-text comments contributes to the understanding of patients’ experiences of care. Methods SCAPE is a multicenter cross-sectional survey that was conducted between October 2018 and March 2019 in French-speaking parts of Switzerland. Patients were invited to rate their care in 65 closed-ended questions (PREMs) and to add free-text comments regarding their cancer-related experiences at the end of the survey. We conducted computer-assisted textual analysis using the IRaMuTeQ software on the comments provided by 31% (n = 844) of SCAPE survey respondents (n = 2755). Results We identified five main thematic classes, two of which consisting of a detailed description of ‘cancer care pathways’. The remaining three classes were related to ‘medical care’, ‘gratitude and praise’, and the way patients lived with cancer (‘cancer and me’). Further analysis of this last class showed that patients’ comments related to the following themes: ‘initial shock’, ‘loneliness’, ‘understanding and acceptance’, ‘cancer repercussions’, and ‘information and communication’. While closed-ended questions related mainly to factual aspects of experiences of care, free-text comments related primarily to the personal and emotional experiences and consequences of having cancer and receiving care. Conclusions A computer-assisted textual analysis of free-text in our patient survey allowed a time-efficient classification of free-text data that provided insights on the personal experience of living with cancer and additional information on patient experiences that had not been collected with the closed-ended questions, underlining the importance of offering space for comments. Such results can be useful to inform questionnaire development, provide feedback to professional teams, and guide patient-centered initiatives to improve the quality and safety of cancer care.


2018 ◽  
Vol 879 ◽  
pp. 276-283
Author(s):  
Monamorn Precharattana

Recent advances in computer technology have led to the creation and development of computer-assisted instruction (CAI), which are rapidly assuming a prominent role in many fields of education. The development process includes analyzing lesson and users, designing computing lesson and assessment techniques, constructing computing lesson and assessment tools, and evaluating the lesson through users feedback. In this work, we aim to (i) Develop computer-assisted instruction of immune system organs and immune system diseases, and (ii) Examine efficiency of the developed CAI. A total of 142 secondary school students was involved in the study. Pretest-Posttest and Satisfaction questionnaire for the students towards the CAI were used as research instruments. The quantitative data was analyzed by t-test, and the qualitative data was analyzed by content analysis. The paired-sample t-test indicated a significant enhancement of students’ understanding after the using of developed instruction at .05 significant level. Moreover, the students were very satisfied with the developed CAI.


Sign in / Sign up

Export Citation Format

Share Document