scholarly journals A Qualitative Review of the Psychometric Properties and Feasibility of Electronic Headache Diaries for Children and Adults: Where We Are and Where We Need to Go

2013 ◽  
Vol 18 (3) ◽  
pp. 142-152 ◽  
Author(s):  
Jennifer N Stinson ◽  
Anna Huguet ◽  
Patrick McGrath ◽  
Brittany Rosenbloom ◽  
Charlene Soobiah ◽  
...  

BACKGROUND: While paper headache pain diaries have been used to determine the effectiveness of headache treatments in clinical trials, recent advances in information and communication technologies have resulted in the burgeoning use of electronic diaries (e-diaries) for headache pain.OBJECTIVE: To qualitatively review headache e-diaries, assess their measurement properties, examine measurement components and compare these components with recommended reporting guidelines.METHODS: The databases Medline, the Cumulative Index to Nursing and Allied Health Literature, Embase, PsychInfo, the Education Resources Information Centre and ISI Web of Science were searched for self-report headache e-diaries for children and adults. A total of 21 publications that involved e-diaries were found; five articles reported on the development of an e-diary and 16 used an e-diary as an outcome measure in randomized controlled trials or observational studies. The diary measures’ components, features and psychometric properties, as well as the quality of evidence of their psychometric properties, were evaluated.RESULTS: Five headache e-diaries met the a priori criteria and were included in the final analysis. None of these e-diaries had well-developed evidence of reliability and validity. Three e-diaries showed evidence of feasibility. E-diaries with ad hoc measures developed by the study investigators were most common, with little to no supportive evidence of reliability and/or validity. Compliance with the reporting guidelines was variable, with only one-half of the e-diaries measuring the recommended primary outcome of headache frequency.CONCLUSIONS: Specific recommendations regarding the development (including essential components) and testing of headache e-diaries are discussed. Further research is needed to strengthen the measurement of headache pain in clinical trials using headache e-diaries.

Author(s):  
Marco Fabbri ◽  
Alessia Beracci ◽  
Monica Martoni ◽  
Debora Meneo ◽  
Lorenzo Tonetti ◽  
...  

Sleep quality is an important clinical construct since it is increasingly common for people to complain about poor sleep quality and its impact on daytime functioning. Moreover, poor sleep quality can be an important symptom of many sleep and medical disorders. However, objective measures of sleep quality, such as polysomnography, are not readily available to most clinicians in their daily routine, and are expensive, time-consuming, and impractical for epidemiological and research studies., Several self-report questionnaires have, however, been developed. The present review aims to address their psychometric properties, construct validity, and factorial structure while presenting, comparing, and discussing the measurement properties of these sleep quality questionnaires. A systematic literature search, from 2008 to 2020, was performed using the electronic databases PubMed and Scopus, with predefined search terms. In total, 49 articles were analyzed from the 5734 articles found. The psychometric properties and factor structure of the following are reported: Pittsburgh Sleep Quality Index (PSQI), Athens Insomnia Scale (AIS), Insomnia Severity Index (ISI), Mini-Sleep Questionnaire (MSQ), Jenkins Sleep Scale (JSS), Leeds Sleep Evaluation Questionnaire (LSEQ), SLEEP-50 Questionnaire, and Epworth Sleepiness Scale (ESS). As the most frequently used subjective measurement of sleep quality, the PSQI reported good internal reliability and validity; however, different factorial structures were found in a variety of samples, casting doubt on the usefulness of total score in detecting poor and good sleepers. The sleep disorder scales (AIS, ISI, MSQ, JSS, LSEQ and SLEEP-50) reported good psychometric properties; nevertheless, AIS and ISI reported a variety of factorial models whereas LSEQ and SLEEP-50 appeared to be less useful for epidemiological and research settings due to the length of the questionnaires and their scoring. The MSQ and JSS seemed to be inexpensive and easy to administer, complete, and score, but further validation studies are needed. Finally, the ESS had good internal consistency and construct validity, while the main challenges were in its factorial structure, known-group difference and estimation of reliable cut-offs. Overall, the self-report questionnaires assessing sleep quality from different perspectives have good psychometric properties, with high internal consistency and test-retest reliability, as well as convergent/divergent validity with sleep, psychological, and socio-demographic variables. However, a clear definition of the factor model underlying the tools is recommended and reliable cut-off values should be indicated in order for clinicians to discriminate poor and good sleepers.


2019 ◽  
Author(s):  
Toni Saari ◽  
Anne Koivisto ◽  
Taina Hintsa ◽  
Tuomo Hänninen ◽  
Ilona Hallikainen

Neuropsychiatric symptoms (NPSs) cause a significant burden to individuals with memory disorders and their families. Insights into the clinical associations, neurobiology, and treatment of NPSs are largely dependent on informant questionnaires, such as the commonly used Neuropsychiatric Inventory (NPI). Like any scale, the utility of the NPI relies on its psychometric properties, but unlike many scales, the NPI faces unique challenges related to its skip-question and scoring formats.We examined and reviewed the psychometric properties of the NPI in a framework including psychometric properties pertinent for construct validation, and health-related outcome measurement in general. We found that aspects such as test-retest and inter-rater reliability are major strengths of the NPI in addition to its flexible and relatively quick administration. These properties are desired in clinical trials. However, it seems that the reported properties cover only some of the generally examined psychometric properties, representing perhaps necessary but not sufficient reliability and validity evidence for the NPI. There appear to be significant gaps in psychometric data, at least partially owing to small sample sizes in the studies that preclude more comprehensive analyses. Regarding construct validity, only one study examined structural validity with the NPI subquestions. Measurement error was not assessed in the reviewed studies. For future validation, we recommend using data from all subquestions, collecting larger samples, paying specific attention to construct validity and formulating hypotheses a priori. As the NPI is an outcome measure of interest in clinical trials, examining measurement error could be of practical importance.


2012 ◽  
Vol 2012 ◽  
pp. 1-15 ◽  
Author(s):  
Kathleen W. Wyrwich ◽  
Ariane K. Kawata ◽  
Christine Thompson ◽  
Stefan Holmstrom ◽  
Malcolm Stoker ◽  
...  

Introduction. A five-item Self-Assessment of Treatment (SAT) was developed to assess improvement and satisfaction with treatment associated with the application of a novel high concentration 8% capsaicin topical patch in clinical trials in patients with postherpetic neuralgia (PHN). This study evaluated the item performance and psychometric properties of the SAT. Methods. The SAT, Brief Pain Inventory, SF-36v2, Short-Form McGill Pain Questionnaire, and Patient and Clinician Global Impression of Change (PGIC; CGIC) scores were measured in two 12-week Phase 3 clinical trials. Factor analysis assessed the underlying factor structure, followed by examination of the reliability and validity of the multi-item domain. Results. Pooled data from 698 patients completing SAT after 12 weeks of treatment were analyzed. A one-factor model combining three of the five items emerged as the optimal solution. Internal consistency reliability of this treatment efficacy factor was high (Cronbach's alpha = 0.89). Construct validity was demonstrated by moderate to high correlations with change in other study endpoints. SAT mean scores consistently discriminated between patient change groups defined by PGIC and CGIC. Conclusions. The measurement properties of the three-item version of SAT are valid and reliable for assessment of treatment with a high concentration capsaicin patch among patients with PHN.


2014 ◽  
Vol 2014 ◽  
pp. 1-11 ◽  
Author(s):  
Renée Speyer ◽  
Reinie Cordier ◽  
Berit Kertscher ◽  
Bas J Heijnen

Introduction. Questionnaires on Functional Health Status (FHS) are part of the assessment of oropharyngeal dysphagia.Objective. To conduct a systematic review of the literature on the psychometric properties of English-language FHS questionnaires in adults with oropharyngeal dysphagia.Methods. A systematic search was performed using the electronic databases Pubmed and Embase. The psychometric properties of the questionnaires were determined based on the COSMIN taxonomy of measurement properties and definitions for health-related patient-reported outcomes and the COSMIN checklist using preset psychometric criteria.Results. Three questionnaires were included: the Eating Assessment Tool (EAT-10), the Swallowing Outcome after Laryngectomy (SOAL), and the Self-report Symptom Inventory. The Sydney Swallow Questionnaire (SSQ) proved to be identical to the Modified Self-report Symptom Inventory. All FHS questionnaires obtained poor overall methodological quality scores for most measurement properties.Conclusions. The retrieved FHS questionnaires need psychometric reevaluation; if the overall methodological quality shows satisfactory improvement on most measurement properties, the use of the questionnaires in daily clinic and research can be justified. However, in case of insufficient validity and/or reliability scores, new FHS questionnaires need to be developed using and reporting on preestablished psychometric criteria as recommended in literature.


Paakat ◽  
2021 ◽  
Vol 11 (20) ◽  
pp. 1-26
Author(s):  
Román Alberto Quijano García ◽  
◽  
Deneb Elí Magaña Medina

The objective of this research is to discuss the psychometric elements of reliability and validity on a measurement model that determines the perception on information and communication technologies for knowledge management in organizations. The scale is based on 6 questions and 2 structured factors in a Likert-type scale, with 5 answer options. It was applied to 337 small and medium companies with diverse specialties within the building field in the state of Campeche. The results of the exploratory and confirmatory factor analysis show an adequate fit and the reliability values are also satisfactory (χ2 = 24.97, p = .002, SRMR = .01, AGFI = .93, TLI = .97, CFI =. 98, RMSEA .07 IC90 [.04-.11]; α = .88), thus confirming the empirical strength of the model. It is concluded that the scale is valid and reliable for use in the context studied.


2020 ◽  
Vol 18 (1) ◽  
Author(s):  
Gørill Haugan ◽  
Jorunn Drageset ◽  
Beate André ◽  
Kamile Kukulu ◽  
James Mugisha ◽  
...  

Abstract Background Well-adapted and validated quality-of-life measurement models for the nursing home population are scarce. Therefore, the aim of this study was to test the psychometrical properties of the OPQoL-brief questionnaire among cognitively intact nursing home residents. The research question addressed evidence related to the dimensionality, reliability and construct validity, all of which considered interrelated measurement properties. Methods Cross-sectional data were collected during 2017–2018, in 27 nursing homes representing four different Norwegian municipalities, located in Western and Mid-Norway. The total sample comprised 188 of 204 (92% response rate) long-term nursing home residents who met the inclusion criteria: (1) municipality authority’s decision of long-term nursing home care; (2) residential time 3 months or longer; (3) informed consent competency recognized by responsible doctor and nurse; and (4) capable of being interviewed. Results Principal component analysis and confirmative factor analyses indicated a unidimensional solution. Five of the original 13 items showed low reliability and validity; excluding these items revealed a good model fit for the one-dimensional 8-items measurement model, showing good internal consistency and validity for these 8 items. Conclusion Five out of the 13 original items were not high-quality indicators of quality-of-life showing low reliability and validity in this nursing home population. Significant factor loadings, goodness-of-fit indices and significant correlations in the expected directions with the selected constructs (anxiety, depression, self-transcendence, meaning-in-life, nurse-patient interaction, and joy-of-life) supported the psychometric properties of the OPQoL-brief questionnaire. Exploring the essence of quality-of-life when residing in a nursing home is highly warranted, followed by development and validation of new tools assessing quality-of-life in this population. Such knowledge and well-adapted scales for the nursing home population are beneficial and important for the further development of care quality in nursing homes, and consequently for quality-of-life and wellbeing in this population.


2021 ◽  
Author(s):  
Pravin Israel ◽  
Johannes Henrik Langeveld

Background: Interpersonal problems are consistently identified with psychopathology that often has its onset in adolescence. Most of the commonly used instruments in child and adolescent psychiatry target non-interpersonal problems. The Inventory of Interpersonal Problems (IIP) is a widely studied and utilized instrument in the adult mental health field. Aims: This study aimed to examine the psychometric properties of the IIP (circumplex version) used with a clinical adolescent population. Method: Sixty-two adolescents (13-17 years) who received treatment in a child and adolescent mental health clinic (CAMHS) were included in the study. To establish reliability and validity, we conducted confirmatory factor analyses, internal consistency, and validity analyses. Results: Confirmatory analyses did not show optimal model fit. However, other indices like CFI and TLI were promising. The reliability of the eight scales was in the same range as previous studies and acceptable. There were expected significant correlations between IIP-C scales and the broadband scales of Youth Self-report (YSR). Conclusion: The pioneer nature and its clinical focus are strengths however, there is for more research. The promising results are encouraging, and future research could also explore how best to bring the instrument into the digital age.


2017 ◽  
Vol 120 (5) ◽  
pp. 966-990 ◽  
Author(s):  
Francesca Chiesi ◽  
Maria Anna Donati ◽  
Angelo Panno ◽  
Mauro Giacomantonio ◽  
Caterina Primi

Given the mixed conclusions on the psychometric properties of the Mindful Attention Awareness Scale (MAAS) and the variety of subsets of items identified as abbreviated forms, the current study aimed to (a) further investigate the performance of single items and different combinations of items of the MAAS from within an Item Response Theory framework, (b) to expand upon existing knowledge about the coverage of the construct of the scale and its shortened versions. A sample of 914 participants (67.6% women; mean age 23.28, SD = 4.77) completed the MAAS. To fulfill the second aim of the study, of the total sample, two subsamples ( N = 156 and N = 158, respectively) were administered a battery of self-report questionnaires. Analyses attested that four items of the MAAS have weak psychometric properties and that the reliability of the scale remains unchanged when these items are excluded. The relationships with several constructs (consciousness, present-time attitude, emotional intelligence, alexithymia, emotion regulation strategies, behavioral inhibition and activation, affect, anxiety, and depression) provided evidence that the scale adequately reflects the operationalization of the construct, although some facets of the construct are only partially covered. The current findings confirm that the MAAS might be slightly shortened without reducing its reliability and validity, but drastically abbreviated forms, such as the proposed five-item version, fail to maintain adequate psychometric properties.


2020 ◽  
Vol 4 (1) ◽  
Author(s):  
Dennis A. Revicki ◽  
Stanley E. Althof ◽  
Leonard R. Derogatis ◽  
Sheryl A. Kingsberg ◽  
Hilary Wilson ◽  
...  

Abstract Background The Elements of Desire Questionnaire (EDQ) is a patient-reported outcome (PRO) measure developed to evaluate sexual desire and was included in two identically designed phase 3 clinical trials (RECONNECT) as an exploratory endpoint. The EDQ was developed based on a literature review, qualitative research with patients with hypoactive sexual desire disorder (HSDD), and input from clinical experts. This instrument is intended to be used to collect efficacy data in clinical trials evaluating potential treatments for HSDD. The objective of this study was to evaluate the measurement properties of both the monthly and daily recall versions of the EDQ during the RECONNECT trials. Methods Participants completed the EDQ daily version for 7 consecutive days prior to selected monthly clinic visits. The monthly recall version was completed at each monthly clinic visit. The analysis population consisted of all subjects with Female Sexual Function Index (FSFI) data at baseline and ≥ 1 follow-up visit. Results At baseline, 1144 and 676 subjects completed the monthly and daily recall EDQs, respectively. The EDQ scores had good internal consistency and test-retest reliability. Monthly and daily recall EDQ scores were correlated with FSFI-desire domain scores at baseline and month 3. Scores from the monthly and daily recall versions were also correlated. After 6 months, there was a significantly greater improvement for bremelanotide versus placebo in both the monthly and daily recall versions (both P < 0.0001). Conclusions The results demonstrated that EDQ exhibited good reliability, validity, and sensitivity to change. Consistent with other validated PRO measures of sexual desire, the EDQ provides additional insights into sexual desire. Trial registration NCT02338960 and NCT02333071 (RECONNECT studies).


Sign in / Sign up

Export Citation Format

Share Document