Towards an assessment instrument for suffering in patients with psychiatric conditions: assessing cognitive validity

BackgroundUnbearable suffering is a key criterion in legally granting patients' euthanasia requests in Belgium yet a generally accepted definition of unbearable suffering remains elusive. The ability to understand and assess unbearable suffering is essential, particularly in patients with psychiatric conditions, as the underlying causes of these conditions are not always apparent. To enable research into when and why suffering experiences incite patients with psychiatric conditions to request euthanasia, and to help explore preventive and curative perspectives, the development of an assessment instrument is needed.AimsTo improve the cognitive validity of a large initial item pool used to assess the nature and extent of suffering in patients with psychiatric conditions.MethodCognitive validity was established via two rounds of cognitive interviews with patients with psychiatric conditions with (n = 9) and without (n = 5) euthanasia requests.ResultsDuring the first round of cognitive interviews, a variety of issues relating to content, form and language were reported and aspects that were missing were identified. During the second round, the items that had been amended were perceived as sufficiently easily to understand, sensitive to delicate nuances, comprehensive and easy to answer accurately. Neither research topic nor method were perceived as emotionally strenuous, but instead as positive, relevant, comforting and valuable.ConclusionsThis research resulted in an item pool that covers the concept of suffering more adequately and comprehensively. Further research endeavours should examine potential differences in suffering experiences over time and in patients with psychiatric conditions with and without euthanasia requests. The appreciation patients demonstrated regarding their ability to speak extensively and openly about their suffering and wish to die further supports the need to allow patients to speak freely and honestly during consultations.Declaration of interestsNone.

Download Full-text

Initial development of the Dance Imagery Questionnaire for Children (DIQ-C): establishing content validity

Journal of Imagery Research in Sport and Physical Activity ◽

10.1515/jirspa-2020-0017 ◽

2020 ◽

Vol 15 (1) ◽

Author(s):

Irene Muir ◽

Krista Munroe-Chandler

Keyword(s):

Content Validity ◽

Cognitive Interviews ◽

Item Pool ◽

Initial Development ◽

Expert Rating ◽

Content Relevance ◽

Phase Study ◽

Initial Item ◽

Item Content ◽

Dance Imagery

AbstractGiven the differences between young dancers’ and adult dancers’ use of imagery, a valid and reliable questionnaire specific to young dancers was necessary. The current study is the first phase of a multi-phase study in the development of the Dance Imagery Questionnaire for Children (DIQ-C). Specifically, the purpose of this study was to establish content validity of the DIQ-C. This was achieved through the following three stages: (1) definition, item, and scale development, (2) assessment of item clarity and appropriateness via cognitive interviews, and (3) assessment of item-content relevance via an expert rating panel. Guided by previous qualitative research with young dancers, 46 items representing seven subscales (i.e., imagery types) were developed. The initial item pool was then implemented during cognitive interviews with 16 dancers (15 females; Mage=10.63, SD=1.82), which led to the removal of 13 items and the modification of 21 items. Consequently, the revised 33-item pool was then administered to an expert panel of four imagery researchers and four dance instructors to measure item-content relevance. This resulted in the removal of eight items, the revision of four items, and the merging of two subscales. Overall, the current study provides content validity evidence for a 25-item pool (representing five subscales) to be used in further development of the DIQ-C (i.e., identifying and establishing factor structure).

Download Full-text

Social Failure Modes in Technology and the Ethics of AI

The Oxford Handbook of Ethics of AI ◽

10.1093/oxfordhb/9780190067397.013.28 ◽

2020 ◽

pp. 441-461

Author(s):

Jason Millar

Keyword(s):

Engineering Design ◽

Failure Modes ◽

Design Practice ◽

Detailed Understanding ◽

Ethical Implications ◽

The Social ◽

Underlying Causes ◽

Physical Defects ◽

Definition Of

This chapter argues that, just as technological artefacts can break as a result of mechanical, electrical, or other physical defects not fully accounted for in their design, they can also break as a result of social defects not fully accounted for in their design. These failures resulting from social defects can be called social failures. The chapter then proposes a definition of social failure as well as a taxonomy of social failure modes—the underlying causes that lead to social failures. An explicit and detailed understanding of social failure modes, if properly applied in engineering design practice, could result in a fuller evaluation of the social and ethical implications of technology, either during the upstream design and engineering phases of a product, or after its release. Ideally, studying social failure modes will improve people’s ability to anticipate and reduce the rate or severity of undesirable social failures prior to releasing technology into the wild.

Download Full-text

Development and Pilot Validation of an Instrument Assessing Sensorimotor Skills for Percutaneous Gastral Puncture

Visceral Medicine ◽

10.1159/000511350 ◽

2020 ◽

pp. 1-7

Author(s):

Monika Engelke ◽

Karl Ernst Grund ◽

Dieter Schilling ◽

Ulrike Beilenhoff ◽

Ferdinand Stebner ◽

...

Keyword(s):

Content Validity ◽

Technical Skills ◽

Assessment Instrument ◽

Simulator Training ◽

Expert Assessment ◽

Educational Training ◽

Endoscopic Gastrostomy ◽

Initial Item ◽

Quasi Experimental ◽

Sensorimotor Skills

Introduction: The acquisition of sensorimotor skills, so-called “technical skills”, plays an essential part in the professional and continuing educational training of medical and nursing staff. Facilities turn to simulator training to promote the safe and accurate performance of endoscopic examinations. Thus, this study aimed to develop and pilot-test a corresponding assessment instrument to monitor necessary sensorimotor or “technical” skills of the examiner for a safe percutaneous endoscopic gastrostomy (AS-PEG). Materials and Methods: Instrument development and pilot validation involved four stages: identification of potential items and initial draft of the AS-PEG; expert panel with 11 experts (content validity index [CVI] calculated); empirical validation using a quasi-experimental intervention on simulators; revision of the pilot AS-PEG taking expert assessment, and empirical testing into consideration. Results: The initial instrument yielded 13 categories and 44 items describing the PEG procedure. Experts rated 30 out of 44 items (68%) extremely or very important for the safety of the puncture of the stomach. Initial item-CVIs ranged from 0.00 to 1.00; scale-CVI was 0.61. Twenty-four trainees (7 physicians, 17 nurses) participated in the pilot simulation study. On average, 8:25 min were required for PEG placement (min–max 5:59–13:38 min, SD = 1:43). The revised AS-PEG version was reduced to 14 items with a range of the item CVI from 0.8 to 1.0, and a scale-CVI of 0.90. Conclusion: The AS-PEG instrument facilitates the evaluation of sensorimotor skills during percutaneous gastric puncture procedures within the context of PEG placement, across professions and without relating to the number of procedures previously performed. The instrument is economical and shows satisfying content validity.

Download Full-text

Item Pool Development for the School-Aged Life Impact Burn Recovery Evaluation (SA- LIBRE5-12) Profile Computerized Adaptive Test (CAT): An Observer-Reported Outcome Assessment Measuring the Impact of Burn Injuries in School-Aged Children

Journal of Burn Care & Research ◽

10.1093/jbcr/irab247 ◽

2021 ◽

Author(s):

Silvanys L Rodríguez-Mercedes ◽

Khushbu F Patel ◽

Camerin A Rencken ◽

Gabrielle G Grant ◽

Kate Surette ◽

...

Keyword(s):

Conceptual Framework ◽

Critical Time ◽

Cognitive Interviews ◽

Item Pool ◽

Computerized Adaptive Test ◽

School Aged Children ◽

Adaptive Test ◽

Life Impact ◽

The Impact ◽

Item Pools

Abstract Introduction The transition from early childhood to teen years (5-12) is a critical time of development, which can be made particularly challenging by a burn injury. Assessing post-burn recovery during these years is important for improving pediatric survivors’ development and health outcomes. Few validated burn-specific measures exist for this age group. The purpose of this study was to generate item pools that will be used to create a future computerized adaptive test (CAT) assessing post-burn recovery in school-aged children. Methods Item pool development was guided by the previously developed School-Aged Life Impact Burn Recovery Evaluation (SA-LIBRE5-12) Conceptual Framework. The item pool development process involved a systematic literature review, extraction of candidate items from existing legacy measures, iterative item review during expert consensus meetings, and parent cognitive interviews. Results The iterative item review with experts consisted of six rounds. A total of 10 parent cognitive interviews were conducted. The three broad themes of concern were items that needed 1) clarification, needed context or were vague, 2) age dependence and relevance, and 3) word choice. The cognitive interviews indicated that survey instructions, recall period, item stem, and response choices were interpretable by respondents. Final item pool based on parental feedback consist of 57, 81, and 60 items in Physical, Psychological, and Family and Social Functioning respectively. Conclusion Developed item pools (n=198) in three domains are consistent with the existing conceptual framework. The next step involves field-testing the item pool and calibration using item response theory to develop and validate the SA-LIBRE5-12 CAT Profile.

Download Full-text

Pelatihan Pengembangan Instrumen Penilaian Numerasi untuk Peningkatan Kompetensi Guru Matematika SMP

Sarwahita ◽

10.21009/sarwahita.191.6 ◽

2022 ◽

Vol 19 (01) ◽

pp. 54-64

Author(s):

Meiliasari ◽

Wardani Rahayu ◽

Ratna Maryam

Keyword(s):

Mathematics Teachers ◽

Junior High School ◽

Assessment Instrument ◽

Competency Assessment ◽

Assessment Instruments ◽

High School Mathematics ◽

Cognitive Level ◽

Training Activity ◽

Numeracy Skills ◽

Definition Of

Asesmen Kompetensi Minimum (AKM) or Minimum Competency Assessment has different objectives and formats compared to Ujian Nasional (National Exam), therefore teachers need to upgrade their knowledge of assessment instruments that measure students’ numeracy skills. This training aims to develop teachers' professionalism and competence in developing numeracy assessment instruments. The training was carried out online through a Zoom Meeting with participants of 29 junior high school mathematics teachers in Bogor Regency, West Java. The training was delivered in 2 sessions by 2 mathematics education lecturers from Universitas Negeri Jakarta. The first session with topics of AKM discussed the material domain, cognitive level, and the form of the questions on the AKM questions. The second session was with topics of numeracy skills discussed the benefits and the definition of numeracy skills. At the end of the training, participants were assigned to make a numeracy assessment instrument within 1 week. Participants and presenters join WhatsApp groups as a forum for discussion in the process of doing assignments. This training activity produces an output in the form of a numeracy assessment instrument that is developed based on the AKM question format. Participants are motivated and have ideas to develop numeracy assessment instruments.

Download Full-text

Doubly Damned: Dealing with Power and Praxis in Development Anthropology

Human Organization ◽

10.17730/humo.52.4.5565v40l51p12106 ◽

1993 ◽

Vol 52 (4) ◽

pp. 380-397 ◽

Cited By ~ 10

Author(s):

David Gow

Keyword(s):

Direct Action ◽

Policy Formulation ◽

Local Context ◽

Local Participation ◽

Realistic Approach ◽

Development Professionals ◽

Underlying Causes ◽

Definition Of ◽

Policy Arena ◽

Development Anthropology

Development anthropologists are doubly damned-criticized by both academics and development professionals on romantic, moral, and intellectual grounds, and basically regarded as second-class citizens within the "development community." As a result, they have studiously avoided defining the principal objectives of development. Likewise, they have shied away from developing theories that direct action to the underlying causes of "underdevelopment." And given their traditional focus on the local context, development anthropologists have often been hard pressed to deal effectively with external factors, particularly power, whether political, institutional, or economic. An analysis of three rural development projects shows how anthropologists dealt with power. A key element was their effectiveness in the policy arena, based partly on their "anthropological authority," but also on their relative autonomy. Equally important is a broader definition of local participation that includes a realistic approach to empowerment. For development anthropology to shed its stigma of damnation, it is necessary for it to increase its concentration on critique and analysis, leading to better policy formulation, and the opportunity to implement policy as theory in practice.

Download Full-text

An out-of-hospital perspective on hyperventilation syndrome

International Paramedic Practice ◽

10.12968/ippr.2019.9.2.41 ◽

2019 ◽

Vol 9 (2) ◽

pp. 41-46 ◽

Cited By ~ 1

Author(s):

Rebecca Raphael ◽

Enrico Dippenaar

Keyword(s):

Provocation Test ◽

The Body ◽

Hospital Environment ◽

Scope Of Practice ◽

Diagnostic Tools ◽

Hyperventilation Syndrome ◽

Hospital Perspective ◽

Appropriate Treatment ◽

Underlying Causes ◽

Definition Of

Hyperventilation and tachypnoea both involve breathing at an increased rate. There are a variety of causes of hyperventilation and conditions associated with it, including acute and chronic hyperventilation syndrome (HVS). The characteristics of HVS are not well defined. It results from a reduction in carbon dioxide and altered pH in the body from overbreathing. Symptoms vary between individuals but usually include altered sensations in the extremities, nausea and headache. Diagnosing patients with this condition can be difficult; diagnostic tools include the hyperventilation provocation test, voluntary overbreathing, the Nijmegen questionnaire and the exclusion of physiological causes in the acute situation. There are various prehospital patient presentations and differentiating between potential underlying causes is vital to appropriate treatment and patient safety. Treatments vary in nature, depending on the desired effect and the clinician's scope of practice. Some aim to reduce the frequency and intensity of attacks while others combat the attack when it strikes. This review briefly discusses some treatments available to a clinician with a basic skill level. There is a lack of evidence in this area, and research with a focus on the out-of-hospital environment is recommended. Because of controversy over existing research regarding the definition of HVS, a review of all sources was conducted to produce a definition. This suggests that HVS is a collection of physical and biochemical reactions from an unnecessarily increased respiratory rate that occurs because of an unknown or benign aetiology which can be triggered by anxiety in the absence of other external factors.

Download Full-text

Assessing Personality States: What to Consider when Constructing Personality State Measures

European Journal of Personality ◽

10.1002/per.2266 ◽

2020 ◽

Vol 34 (6) ◽

pp. 1037-1059 ◽

Cited By ~ 1

Author(s):

Kai T. Horstmann ◽

Matthias Ziegler

Keyword(s):

Best Practices ◽

Daily Diary ◽

Test Construction ◽

Item Pool ◽

Validity And Reliability ◽

Personality Psychology ◽

Sampling Studies ◽

General Guideline ◽

State Measure ◽

Initial Item

Repeated assessments of personality states in daily diary or experience sampling studies have become a more and more common tool in the psychologist's toolbox. However, and contrary to the widely available literature on personality traits, no best practices for the development of personality state measures exist, and personality state measures have been developed in many different ways. To address this, we first define what a personality state is and discuss important components. On the basis of this, we define what a personality state measure is and suggest a general guideline for the development of such measures. Following the ABC of test construction can then guide the strategy for obtaining validity and reliability evidence: (A) What is the construct being measured? (B) What is the intended purpose of the measure? And (C) What is the targeted population of persons and situations? We then conclude with an example by developing an initial item pool for the assessment of conscientiousness personality states. © 2020 The Authors. European Journal of Personality published by John Wiley & Sons Ltd on behalf of European Association of Personality Psychology

Download Full-text

Development and Validation of the Organizational Stressor Indicator for Sport Performers (OSI-SP)

Journal of Sport and Exercise Psychology ◽

10.1123/jsep.35.2.180 ◽

2013 ◽

Vol 35 (2) ◽

pp. 180-196 ◽

Cited By ~ 35

Author(s):

Rachel Arnold ◽

David Fletcher ◽

Kevin Daniels

Keyword(s):

Concurrent Validity ◽

Structure Study ◽

Item Pool ◽

Factor Analyses ◽

Confirmatory Factor Analyses ◽

Organizational Stressors ◽

Confirmatory Factor ◽

Exploratory Factor Analyses ◽

Initial Item ◽

Development And Validation

The series of related studies reported here describe the development and validation of the Organizational Stressor Indicator for Sport Performers (OSI-SP). In Study 1, an expert and usability panel examined the content validity and applicability of an initial item pool. The resultant 96 items were analyzed with exploratory factor analyses in Study 2, with the factorial structure comprising 5 factors (viz., Goals and Development, Logistics and Operations, Team and Culture, Coaching, Selection) and 33 items. Using confirmatory factor analyses, Studies 3 and 4 found support for the 5-factor structure. Study 4 also provided evidence for the OSI-SP’s concurrent validity and invariance across different groups. The OSI-SP is proposed as a valid and reliable measure of the organizational stressors encountered by sport performers.

Download Full-text

Introducing the Qualitative Pretest Interview (QPI) for questionnaire development

10.31235/osf.io/3mgqd ◽

2020 ◽

Author(s):

Christina Buschle ◽

Herwig Reiter ◽

Arne Bethmann

Keyword(s):

Survey Research ◽

Social Research ◽

Survey Methods ◽

Communication Strategies ◽

Cognitive Interview ◽

Questionnaire Development ◽

Cognitive Interviews ◽

Thinking Aloud ◽

Qualitative Survey ◽

Underlying Causes

Cognitive interviews have become one of the most important pretest methods in the development and evaluation of questionnaires. Different techniques such as thinking aloud or various probing approaches analyse the comprehensibility and interpretation of questions, uncover difficulties of respondents in answering questionnaires as well as underlying causes. A desideratum of this approach is the methodological framing for which we make a proposal in this article. Direct research interaction in pretest situations can be regarded as an act of understanding others in the sense of qualitative-interpretive social research. On this basis, we discuss the advantage of methodically integrated communication strategies of two established qualitative survey methods - the problem-centred interview and the discursive interview - for the development of a distinct pretest interview approach. It adopts the techniques of the cognitive interview and expands them by the essentially social character of processes of clarifying comprehension. We introduce the term Qualitative Pretest Interview (QPI) in order to avoid the possible narrowing of the understanding of pretest procedures to the problem of ambiguous cognitions. Finally, we reflect on the potential of this approach for standardized survey research.

Download Full-text