scholarly journals Feedback Design Considerations for Intelligent Team Tutoring Systems

Author(s):  
Jamiahus Walton ◽  
Alec Ostrander ◽  
Kaitlyn Ouverson ◽  
Stephen B. Gilbert ◽  
Michael Dorneich ◽  
...  

Challenges arise when developing a computer-based Intelligent Team Tutoring System (ITTS) that attempts to deliver feedback to teams as effectively as a human tutor. The purpose of this current work is to outline elements of feedback that should be considered when designing feedback for an ITTS. The authors present the results of a study that consisted of 32 participants grouped into 16 teams of two. Each team conducted a surveillance task where they received individual or team feedback. Feedback content was written using either the bald (direct feedback; no need for interpretation) or off-record (general feedback; interpretation needed) etiquette strategy. The results showed that feedback delivered using the bald etiquette strategy positively correlated with improved performance. The results also showed that team level feedback positively correlated with more accurate self-assessment among participants. This suggests that in an ITTS, direct feedback can lead to better performance, and that feedback provided at the team level can help to align self-interpretation of performance with actual task performance.

1980 ◽  
Vol 24 (1) ◽  
pp. 54-58 ◽  
Author(s):  
Yee-Yeen Chu ◽  
William H. Crooks

Automated Remote Manipulation is a prime example of a new type of man-machine interaction in which the human operator must supervise and control a complex and often adaptive man-computer system. Computerized control offers the possibilities of improved performance speed and reduced operator work loads with teleoperator systems. Computers can be used at various levels of control, ranging from control augmentation, where the computer performs difficult coordinate transformations which simplify operator control requirements, through complete autonomy in which the computer performs all of the required activities with no intervention by the operator. However, with the introduction of computer-based control techniques, the communication between the operator and the teleoperator becomes an important determinant of work system performance. Rather than controlling directly every action of the manipulator, the operator of a computer-controlled manipulator plans the tasks, commands goal-directed actions, monitors task performance, and intervenes when appropriate. This paper describes an analytical and experimental study conducted by Perceptronics to investigate the effectiveness of command language structures and the methods for providing feedback information through the use of sensors and displays. The study showed that computer aiding can significantly decrease task performance time for a number of teleoperator tasks. The results also indicated that if high-level computer aiding schemes are to be effective, the design of interface and feedback display must be carefully performed to achieve simple and natural man-machine communication.


Author(s):  
Mark K. Singley ◽  
Peter G. Fairweather ◽  
Steven Swerling

Author(s):  
Jeremy D. Faulk ◽  
Cameron C. McKee ◽  
Heather Bazille ◽  
Michael Brigham ◽  
Jasmine Daniel ◽  
...  

Active seating designs may enable users to move more frequently, thereby decreasing physiological risks associated with a sedentary lifestyle. In this preliminary study, two active seating designs (QOR360, Ariel; QOR360, Newton) were compared to a static chair (Herman Miller, Aeron) to understand how active vs. static seating may affect task performance, movement, posture, and perceived discomfort. This within-subjects experiment involved n = 11 student participants who sat upon each of the three chairs for 20 minutes while performing a series of computer-based tasks. Participants showed increased trunk movement while also reporting higher levels of perceived discomfort in the two active chair conditions. There was no significant difference in either posture or fine motor task performance between the active and static conditions. Future research may benefit from additional physiological measurements along with a wider variety of tasks that require seated users to make postural adjustments.


Author(s):  
Denise Villanyi ◽  
Romain Martin ◽  
Philipp Sonnleitner ◽  
Christina Siry ◽  
Antoine Fischbach

Although student self-assessment is positively related to achievement, skepticism about the accuracy of students’ self-assessments remains. A few studies have shown that even elementary school students are able to provide accurate self-assessments when certain conditions are met. We developed an innovative tablet-computer-based tool for capturing self-assessments of mathematics and reading comprehension. This tool integrates the conditions required for accurate self-assessment: (1) a non-competitive setting, (2) items formulated on the task level, and (3) limited reading and no verbalization required. The innovation consists of using illustrations and a language-reduced rating scale. The correlations between students’ self-assessment scores and their standardized test scores were moderate to large. Independent of their proficiency level, students’ confidence in completing a task decreased as task difficulty increased, but these findings were more consistent in mathematics than in reading comprehension. We conclude that third- and fourth-graders have the ability to provide accurate self-assessments of their competencies, particularly in mathematics, when provided with an adequate self-assessment tool.


Author(s):  
Jessica M. Ray ◽  
John S. Barnett

As training researchers and developers, we strive to understand and produce effective and efficient training. Research suggests the most effective form of instruction is individualized human tutoring. Yet this is rarely the most efficient form of instruction monetarily or in instructor time. Technological advances and a vision of effective, yet more efficient, computer based tutors has led to the development of sophisticated new training technologies such as Intelligent Tutoring Systems (ITSs). These systems have yet to reach their full forecast potential. In this paper we theorize that issues key to successful advancement of ITSs are human factors issues. Primary of these issues is determining how technology mediation impacts not only cognition, but also other key learning issues such as affect, emotions, motivation, and trust.


Author(s):  
Harald Ewolds ◽  
Laura Broeker ◽  
Rita F. de Oliveira ◽  
Markus Raab ◽  
Stefan Künzell

Abstract This study examined the effect of instructions and feedback on the integration of two tasks. Task-integration of covarying tasks are thought to help dual-task performance. With complete task integration of covarying dual tasks, a dual task becomes more like a single task and dual-task costs should be reduced as it is no longer conceptualized as a dual task. In the current study we tried to manipulate the extent to which tasks are integrated. We covaried a tracking task with an auditory go/no-go task and tried to manipulate the extent of task-integration by using two different sets of instructions and feedback. A group receiving task-integration promoting instructions and feedback (N = 18) and a group receiving task-separation instructions and feedback (N = 20) trained on a continuous tracking task. The tracking task covaried with the auditory go/no-go reaction time task because high-pitch sounds always occurred 250 ms before turns, which has been demonstrated to foster task integration. The tracking task further contained a repeating segment to investigate implicit learning. Results showed that instructions, feedback, or participants’ conceptualization of performing a single task versus a dual task did not significantly affect task integration. However, the covariation manipulation improved performance in both the tracking and the go/no-go task, exceeding performance in non-covarying and single tasks. We concluded that task integration between covarying motor tasks is a robust phenomenon that is not influenced by instructions or feedback.


Blood ◽  
2009 ◽  
Vol 114 (22) ◽  
pp. 2576-2576 ◽  
Author(s):  
Richard J. Labotka ◽  
Robert E. Molokie ◽  
A. Kyle Mack ◽  
Alexis A Thompson ◽  
Young Ok Kim ◽  
...  

Abstract Abstract 2576 Poster Board II-553 Pain remains the most frustrating and debilitating symptom of sickle cell disease (SCD). Yet, because pain is a perception of a sensation, objective assessment of pain remains elusive. In order to achieve adequate pain control, it is imperative that the patient be able to effectively communicate with the physician regarding the extent, severity and quality of the pain, as well as the response of the pain to the therapeutic intervention. Moreover, SCD pain may have two components, nociceptive (due to organ/tissue injury) and neuropathic (due to somatosensory system lesion or disease), with differing pathophysiologies, and differing responses to pain medications. PAINReportIt® is a multi-dimensional computerized, self-assessment pain reporting tool based on the McGill Pain Questionnaire (MPQ). The MPQ has been validated for adolescents and adults. However, the PAINReportIt®, which was developed originally for the evaluation of cancer pain, has not previously been used in adolescents, nor in the study of adolescents' SCD pain. The purpose of this study was to examine the frequency with which pain experienced in various body areas by adolescents and young adults had characteristics consistent with nociceptive and neuropathic pain. Methods. Inclusion criteria included an SCD diagnosis (SS, SC or S-beta thal) and age at least 14 years. Patients attending two pediatric/adolescent comprehensive sickle cell clinics were invited to participate. Consenting subjects were first instructed and then allowed to complete the PAINReportIt® tool, in which they marked their painful sites on a graphic body outline, selected pain quality descriptors from word lists provided by the computer, and for each site they matched each site to the pain quality descriptors that represented the site. The descriptors included sensory descriptors that are known to be characteristic of either neuropathic pain or nociceptive pain. Results. PAINReportIt® tools were completed by 49 SCD subjects, whose ages ranged from 14 to 27 years (mean, 18 +/− 2.6 years). For analysis, the body was divided into nine segments, and the computer analyzed the marked painful body outline sites and identified the body segments involved. Descriptive statistics were used to determine the frequency for which each body segment included a painful site, and the frequencies for which that site was characterized as having neuropathic or nociceptive pain qualities, or both. These results are summarized in the Table below. As the Table shows, virtually all body segments were frequently involved with pain, the upper back and legs being the most frequently reported, and the lower back the least (Column 1). For body segments reported as painful, few were reported as having only nociceptive (Column 2) or neuropathic (Column 3) pain qualities. The majority of painful sites were described by subjects as having mixed pain qualities (Column 4). As Column 5 shows, from 76% to 100% of all painful sites were characterized as having a neuropathic pain component. When the number of descriptors associated with each site was reviewed (data not shown), the right leg was matched to the largest number of neuropathic descriptors (Aching, Burning, Cold, Drilling, Flickering, Numb, Penetrating, Radiating, Shooting, Spreading, Tight, Tingling). The upper back was matched to the largest number of nociceptive descriptors (Beating, Cramping, Crushing, Gnawing, Hurting, Piercing, Pounding, Pressing, Pulsing, Sharp, Sore, Splitting, Squeezing, Tender, Throbbing). Conclusions. When utilizing a computer-based self-reporting pain tool, SCD patients overwhelmingly describe a neuropathic component to their pain as well as a nociceptive component. The high frequency of neuropathic pain has been underappreciated, and this may contribute to the difficulty in managing sickle cell pain, since this pain component is not well controlled by opioid analgesics. Disclosures: No relevant conflicts of interest to declare.


Sign in / Sign up

Export Citation Format

Share Document