scholarly journals Skill Confidence Ratings in a MOOC: Examining the Link between Skill Confidence and Learner Development

2019 ◽  
Author(s):  
Karen von Schmieden ◽  
Thomas Staubitz ◽  
Lena Mayer ◽  
Christoph Meinel
Keyword(s):  
Confidence Ratings

The nature of metacognitive inefficiency in perceptual decision making

2020 ◽  
Author(s):  
Medha Shekhar ◽  
Dobromir Rahnev
Keyword(s):  
Decision Making ◽  
Mechanistic Model ◽  
Perceptual Decision Making ◽  
Large Dataset ◽  
Substantial Body ◽  
Confidence Levels ◽  
Continuous Scale ◽  
Competing Models ◽  
Metacognitive Ability ◽  
Confidence Ratings

Humans have the metacognitive ability to judge the accuracy of their own decisions via confidence ratings. A substantial body of research has demonstrated that human metacognition is fallible but it remains unclear how metacognitive inefficiency should be incorporated into a mechanistic model of confidence generation. Here we show that, contrary to what is typically assumed, metacognitive inefficiency depends on the level of confidence. We found that, across five different datasets and four different measures of metacognition, metacognitive ability decreased with higher confidence ratings. To understand the nature of this effect, we collected a large dataset of 20 subjects completing 2,800 trials each and providing confidence ratings on a continuous scale. The results demonstrated a robustly nonlinear zROC curve with downward curvature, despite a decades-old assumption of linearity. This pattern of results was reproduced by a new mechanistic model of confidence generation, which assumes the existence of lognormally-distributed metacognitive noise. The model outperformed competing models either lacking metacognitive noise altogether or featuring Gaussian metacognitive noise. Further, the model could generate a measure of metacognitive ability which was independent of confidence levels. These findings establish an empirically-validated model of confidence generation, have significant implications about measures of metacognitive ability, and begin to reveal the underlying nature of metacognitive inefficiency.

scholarly journals PROBING THE CONSTRUCT VALIDITY OF LLAMA_D AS A MEASURE OF IMPLICIT LEARNING APTITUDE

2021 ◽  
pp. 1-14
Author(s):  
Yuichi Suzuki
Keyword(s):  
Reaction Time ◽  
Construct Validity ◽  
Implicit Learning ◽  
Incidental Learning ◽  
The Other ◽  
Aptitude Test ◽  
Oral Fluency ◽  
The Relationship ◽  
Potential Test ◽  
Confidence Ratings

Abstract A subtest of the LLAMA test battery (LLAMA_D) has been proposed as a potential test of implicit learning aptitude. To improve its construct validity, in the present study, the original LLAMA_D (a) instructions for incidental learning were modified, and (b) confidence ratings of test responses and (c) reaction time (RT) measurements were added. This revised LLAMA_D was administered along with the other LLAMA subtests (LLAMA-B, -E, and -F). Unconscious knowledge that may (not) result from the exposure was assessed through the relationship between the accuracy/RT and confidence ratings. The results suggest that LLAMA_D accuracy largely reflects conscious retrieval of previously heard sound sequences. However, an index derived from the LLAMA_D RT measure (coefficient of variance) was associated with an aspect of oral fluency, which is presumably dependent on proceduralization. Several recommendations are proposed to redesign and extend LLAMA_D as a potential aptitude test for proceduralization.

scholarly journals Effects of ketamine on brain function during metacognition of episodic memory

2021 ◽  
Vol 2021 (1) ◽  
Author(s):  
Mirko Lehmann ◽  
Claudia Neumann ◽  
Sven Wasserthal ◽  
Johannes Schultz ◽  
Achilles Delis ◽  
...  
Keyword(s):  
Episodic Memory ◽  
Parietal Lobe ◽  
Memory Task ◽  
Reaction Times ◽  
Neural Correlates ◽  
Double Blind ◽  
Lingual Gyrus ◽  
States Of Consciousness ◽  
Fmri Study ◽  
Confidence Ratings

Abstract Only little research has been conducted on the pharmacological underpinnings of metacognition. Here, we tested the modulatory effects of a single intravenous dose (100 ng/ml) of the N-methyl-D-aspartate-glutamate-receptor antagonist ketamine, a compound known to induce altered states of consciousness, on metacognition and its neural correlates. Fifty-three young, healthy adults completed two study phases of an episodic memory task involving both encoding and retrieval in a double-blind, placebo-controlled fMRI study. Trial-by-trial confidence ratings were collected during retrieval. Effects on the subjective state of consciousness were assessed using the 5D-ASC questionnaire. Confirming that the drug elicited a psychedelic state, there were effects of ketamine on all 5D-ASC scales. Acute ketamine administration during retrieval had deleterious effects on metacognitive sensitivity (meta-d′) and led to larger metacognitive bias, with retrieval performance (d′) and reaction times remaining unaffected. However, there was no ketamine effect on metacognitive efficiency (meta-d′/d′). Measures of the BOLD signal revealed that ketamine compared to placebo elicited higher activation of posterior cortical brain areas, including superior and inferior parietal lobe, calcarine gyrus, and lingual gyrus, albeit not specific to metacognitive confidence ratings. Ketamine administered during encoding did not significantly affect performance or brain activation. Overall, our findings suggest that ketamine impacts metacognition, leading to significantly larger metacognitive bias and deterioration of metacognitive sensitivity as well as unspecific activation increases in posterior hot zone areas of the neural correlates of consciousness.

Accuracy of confidence ratings associated with general knowledge and eyewitness memory.

1993 ◽  
Vol 78 (1) ◽  
pp. 144-147 ◽  
Author(s):  
Timothy J. Perfect ◽  
Emma L. Watson ◽  
Graham F. Wagstaff
Keyword(s):  
Eyewitness Memory ◽  
General Knowledge ◽  
Confidence Ratings

Awareness and confidence ratings in motion perception without geniculo-striate projection

1998 ◽  
Vol 96 (1-2) ◽  
pp. 71-77 ◽  
Author(s):  
Arash Sahraie ◽  
L Weiskrantz ◽  
J.L Barbur
Keyword(s):  
Motion Perception ◽  
Confidence Ratings

scholarly journals Atypical action updating in a dynamic environment associated with adolescent obsessive-compulsive disorder

2021 ◽  
Author(s):  
Aleya A Aziz Marzuki ◽  
Matilde Vaghi ◽  
Anna Conway-Morris ◽  
Muzaffer Kaser ◽  
Akeem Sule ◽  
...  
Keyword(s):  
Obsessive Compulsive Disorder ◽  
Young Patients ◽  
Dynamic Environment ◽  
Prediction Errors ◽  
Obsessive Compulsive ◽  
Compulsive Disorder ◽  
Error Related Negativity ◽  
The Face ◽  
Cognitive Information ◽  
Confidence Ratings

Background Computational research had determined that adults with obsessive-compulsive disorder (OCD) display heightened action updating in response to noise in the environment and neglect meta-cognitive information (such as confidence) when making decisions. These features are proposed to underlie patients compulsions despite knowledge they are irrational. Nonetheless, it is unclear whether this extends to adolescents with OCD as research in this population is lacking. Thus, this study aimed to investigate the interplay between action and confidence in adolescents with OCD. Methods Twenty-seven adolescents with OCD and 46 controls completed a predictive-inference task, designed to probe how subjects actions and confidence ratings fluctuate in response to unexpected outcomes. We investigated how subjects update actions in response to prediction errors (indexing mismatches between expectations and outcomes) and used parameters from a Bayesian model to predict how confidence and action evolve over time. Confidence-action association strength was assessed using a regression model. We also investigated the effects of serotonergic medication. Results Adolescents with OCD showed significantly increased learning rates, particularly following small prediction errors. Results were driven primarily by unmedicated patients. Confidence ratings appeared equivalent between groups, although model-based analysis revealed that patients confidence was less affected by prediction errors compared to controls. Patients and controls did not differ in the extent to which they updated actions and confidence in tandem. Conclusions Adolescents with OCD showed enhanced action adjustments, especially in the face of small prediction errors, consistent with previous research establishing just-right compulsions, enhanced error-related negativity, and greater decision-uncertainty in paediatric-OCD. These tendencies were ameliorated in patients receiving serotonergic medication, emphasising the importance of early intervention in preventing disorder-related cognitive deficits. Confidence ratings were equivalent between young patients and controls, mirroring findings in adults OCD research.

Sign in / Sign up

Export Citation Format

Share Document