scholarly journals Evaluation of the Content Validity and Cross-Cultural Validity of the Study Participant Feedback Questionnaire (SPFQ)

2020 ◽  
Vol 54 (6) ◽  
pp. 1522-1533
Author(s):  
Alison Greene ◽  
Mary Elmer ◽  
Sean Ludlam ◽  
Kathyjo Shay ◽  
Sarah Bentley ◽  
...  

Abstract Objectives The Study Participant Feedback Questionnaire (SPFQ) is a patient-completed tool designed to assess patient experiences and satisfaction with aspects associated with being involved in a clinical trial. Originally developed in oncology and among English-speaking participants, the aim of the current study was to evaluate the content and cross-cultural validity of the SPFQ in other indications and non-English-speaking countries. Methods Semi-structured qualitative telephone interviews were conducted with 80 participants across eight non-English-speaking countries (in Europe, South America and Asia) who had received an investigational medicinal product as part of a clinical trial in the past three years. Interviews comprised concept elicitation to identify concepts of importance to participants’ trial experiences, and cognitive debriefing to assess understanding and perceived importance of SPFQ instructions, items and response options. Results Concept elicitation findings supported the content validity of the SPFQ. During cognitive debriefing, SPFQ instructions and the majority of items were well understood by participants. Participants generally considered the SPFQ items important to their clinical trial experience, albeit a handful of items assessed concepts that had not been experienced by trial participants or were redundant with other SPFQ items. The instructions, response options and recall period of the SPFQ were generally well understood. No country-level differences in understanding or importance were apparent. Conclusion Study findings provide evidence for the content and cross-cultural validity of the SPFQ and support implementation of the SPFQ as a means of obtaining participant feedback across global development programmes in a variety of indications.

Blood ◽  
2019 ◽  
Vol 134 (Supplement_1) ◽  
pp. 4777-4777
Author(s):  
Helena Chung ◽  
Daniel Eek ◽  
Calvin Krogh ◽  
Matthew Blowfield ◽  
Oren Meyers ◽  
...  

Introduction: The FACIT-Fatigue is a 13-item patient-reported outcome instrument (PRO) that was designed to assess fatigue-related symptoms and impacts on daily functioning. This study assessed the content validity of the FACIT-Fatigue in patients with CLL to help determine if it is fit-for-purpose in this population. Methods: Forty adults with first-line (1L) or relapsed or refractory (R/R) CLL took part in an interview study comprising concept elicitation and cognitive debriefing. All participants had experienced CLL-related symptoms (fatigue, weight loss, fever or night sweats) in the past week. For concept elicitation, interviewers used a standardized semi-structured interview guide with open-ended and prompted questions to explore patients' experiences of the signs, symptoms and impacts of CLL and its treatments. Patients were asked to provide a disturbance rating of these concepts on a 0-10 scale of severity. All interviewed patients completed the FACIT-Fatigue. Item scores can range from 0 ("not at all") to 4 ("very much"), and the total score from 0 to 52; lower scores indicate greater fatigue. The recall period for each item is the past 7 days. The general population mean score is 43 (Cella et al. 2002; Montan et al. 2018). During cognitive debriefing, the clarity of the FACIT-Fatigue items, their relevance to the patients, and the comprehensiveness of the response options were assessed. Interviews were carried out by telephone and lasted about 60-75 minutes. De-identified audio-recorded interviews were transcribed, coded and analyzed using qualitative data analysis software. Results: Median age of participants was 58 years (range: 28-73 years), and gender distribution was equal. During concept elicitation, fatigue was identified as the most prominent and impactful concept. It was the only concept mentioned by 100% of patients, and almost all (1L: 95%; R/R: 85%) mentioned it spontaneously without prompting. Fatigue had a high mean disturbance rating (1L: 7.1; R/R: 6.9). Seven fatigue-related sub-components were identified from the way that patients described their fatigue, covering symptoms (tiredness/need for sleep, lack of energy, weakness, cognitive fatigue) and impacts (decreased ability to maintain social/familial/professional role, decreased physical functioning, frustration). Mean (standard deviation) FACIT-Fatigue score was 28.9 (13.6) for patients with 1L CLL and 29.3 (11.5) for those with R/R CLL, indicating greater fatigue than the general population and providing further evidence that fatigue is a core component of CLL. The items that scored highest were: "I feel fatigued" (item 1; mean score: 2.4) and "I feel tired" (item 4; mean score: 2.4). The items that scored lowest were: "I am too tired to eat" (item 10; mean score: 0.4) and "I need help doing my usual activities" (item 11; mean score: 1.0). During cognitive debriefing, 100% of patients confirmed that the FACIT-Fatigue was reflective of their experiences with fatigue resulting from CLL. All patients found the response options provided by the FACIT-Fatigue to be sufficient. Patients confirmed that most of the FACIT-Fatigue terminology was clear. An exception was the item "I feel listless/washed out" (item 3), which was not consistently understood: most patients linked it to an absence of both physical and mental energy, but some interpreted it just as a lack of physical energy. Overall, patients considered the FACIT-Fatigue items to be relevant and distinct from each other, and found that the impact items captured both the mental and physical impacts of fatigue. One item, "I am too tired to eat", was not considered to be highly pertinent because, although respondents could imagine that some patients with CLL might be too tired to eat, they themselves could only recall being too tired to prepare a meal, not being too tired to eat. However, respondents felt that the item was still relevant and that it did not detract from the applicability or clarity of the FACIT-Fatigue. Conceptual relevance of the FACIT-Fatigue was supported by mapping of its items to the 7 fatigue-related sub-components identified during concept elicitation (Table). Conclusions: Results from concept elicitation and cognitive debriefing interviews demonstrated content validity of the FACIT-Fatigue in patients with CLL with 1L or R/R disease, thus providing evidence that it is fit-for-purpose in this population. Disclosures Chung: AstraZeneca: Employment, Equity Ownership. Eek:AstraZeneca: Employment, Equity Ownership. Eyre:Janssen: Honoraria; Gilead: Consultancy, Honoraria, Other: commercial research support; Abbvie: Honoraria; Roche: Honoraria.


2021 ◽  
Vol 5 (1) ◽  
Author(s):  
Helen Doll ◽  
Ufuk Coşkun ◽  
Chris Hartford ◽  
Ioannis Tomazos

Abstract Background This study was conducted to evaluate content validity of the IntraVenous and SubCutaneous Treatment Administration Satisfaction Questionnaires (TASQ-IV and TASQ-SC), for use in a clinical trial population of participants with paroxysmal nocturnal hemoglobinuria (PNH) undergoing eculizumab treatment. Methods Participants underwent semi-structured combined brief introduction to disease history and full cognitive debriefing interviews to establish symptoms and key impacts of PNH and to explore the clarity and relevance of both sets of instructions (TASQ-IV and TASQ-SC). The clarity, relevance, response options, and recall period of the TASQ-IV items were also explored. Results Ten participants with PNH were recruited. Fatigue was the most commonly reported symptom (n = 7); the most commonly reported impact of PNH was on physical activity (n = 4). Nine participants indicated understanding and relevance of the TASQ-IV instructions; three participants suggested changes. Of the 20 TASQ-IV items, ≥ 15 were considered understandable, relevant and to have suitable response options (n ≥ 8). The TASQ-SC instructions were understood by all participants; seven participants indicated relevance. While a few participants suggested minor changes for the items, these reflected the one-off completion of the measure in an interview setting and were thus not considered sufficient to justify modification of the measure for clinical trial completion. Conclusions Most participants understood the TASQ-IV and TASQ-SC instructions (n = 9 and 10, respectively) and the TASQ-IV items were considered clear, relevant and to have suitable response options, demonstrating face and content validity of the instruments for the clinical trial setting.


2005 ◽  
Vol 26 (1) ◽  
pp. 11-19 ◽  
Author(s):  
Vincent Egan ◽  
Aurelio José Figueredo ◽  
Pedro Wolf ◽  
Kara McBride ◽  
Jon Sefcek ◽  
...  

Abstract. We assessed whether violent or macabre interests (“sensational interests”) were related to mating effort and a higher-order personality construct reflecting the combined features of higher Extraversion, lower Psychoticism, and lower Neuroticism in 1321 participants from English-speaking (Tucson, Arizona, and Glasgow, Scotland) and Spanish-speaking (Hermosillo, Mexico, and Talca, Chile) communities. Participants from Spanish-speaking communities generally had more sensational interests. Mating effort was positively related to sensational interests, though the relationship was slightly weaker in Spanish-speaking communities. Personality effects were modest and entirely moderated by language; personality was negatively related to sensational interests in English-speaking communities, but positively associated to sensational interests in Spanish-speaking communities. These findings suggest that the relationship between mating effort and sensational interests is universal and reflects general intrasexual competition, whereas the relationship between personality and sensational interests is more culture-specific.


2019 ◽  
Vol 2019 ◽  
pp. 1-5
Author(s):  
Rujira Jaikaew ◽  
Nuntanee Satiansukpong

Introduction. The Movement Assessment Battery for Children-Second Edition (MABC2) is a standardized test for detecting children with movement difficulty. It was established and is used widely in Western countries. Studying cross-cultural validity and reliability was necessary before using the MABC2 with Thai children. Purposes. To study cross-cultural validity, content validity, and interrater reliability of the MABC2. Method. The MABC2-Age Band 2 (AB2: children aged 7-10 years) was translated into Thai from the source version of the MABC2 by using the following steps: forward translation, backward translation, panel discussion, and testing of the prefinal version of the Thai-MABC2-AB2. Five occupational therapists checked the content validity of the test. Twenty-nine children, aged 7-10 years, were examined by two testers in order to establish interrater reliability. Results. This cross-cultural study demonstrated validity in the Thai context. Content validity was good with an item-objective congruence (IOC) range from 0.73 to 0.95. The intraclass correlation coefficient (ICC) of interrater reliability ranged from 0.71 to 1.00. Conclusion. The Thai-MABC2-AB2 is a good fit for use in a clinical and Thai cultural setting. Interrater reliability was moderate to good, which meant results between testers were consistent.


Author(s):  
Matthew B. Rivara ◽  
Todd Edwards ◽  
Donald Patrick ◽  
Lisa Anderson ◽  
Jonathan Himmelfarb ◽  
...  

Background and objectivesThe population of patients with kidney failure in the United States using home dialysis modalities is growing rapidly. Unlike for in-center hemodialysis, there is no patient-reported experience measure for assessment of patient experience of care for peritoneal dialysis or home hemodialysis. We sought to develop and establish content validity of a patient-reported experience measure for patients undergoing home dialysis using a mixed methods multiple stakeholder approach.Design, setting, participants, & measurementsWe conducted a structured literature review, followed by concept elicitation focus groups and interviews among 65 participants, including 21 patients on home dialysis, 33 home dialysis nurses, three patient care partners, and eight nephrologists. We generated a list of candidate items for possible measure inclusion and conducted a national prioritization exercise among 91 patients on home dialysis and 39 providers using a web-based platform. We drafted the Home Dialysis Care Experience instrument and conducted cognitive debriefing interviews to evaluate item interpretability, order, and structure. We iteratively refined the measure on the basis of interview findings.ResultsThe literature review and concept elicitation phases supported 15 domains of home dialysis care experience in six areas: communication and education of patients, concern and helpfulness of the care team, proficiency of the care team, patient-centered care, care coordination, and amenities and environment. Focus groups results showed that domains of highest importance for measure inclusion were patient education and communication, care coordination, and personalization of care. Prioritization exercise results confirmed focus group findings. Cognitive debriefing indicated that the final measure was easily understood and supported content validity.ConclusionsThe Home Dialysis Care Experience instrument is a 26-item patient-reported experience measure for use in peritoneal dialysis and home hemodialysis. The Home Dialysis Care Experience instrument represents the first rigorously developed and content-valid English-language instrument for assessment of patient-reported experience of care in home dialysis.


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Brooke M. Currie ◽  
Evan W. Davies ◽  
Amélie Beaudet ◽  
Larissa Stassek ◽  
Leah Kleinman ◽  
...  

Abstract Background Sarcoidosis-associated pulmonary hypertension (SAPH) is a prevalent and serious complication of sarcoidosis. No SAPH-specific self-report instruments for assessing SAPH symptoms and their impact on patients are available to date. This study sought to determine whether the Pulmonary Arterial Hypertension-Symptoms and Impact (PAH-SYMPACT™) questionnaire is suitable for use in patients with SAPH. Methods Patients diagnosed with SAPH participated in qualitative one-on-one telephone interviews to better understand SAPH symptoms and their impacts on patients’ lives and to determine the appropriateness of the PAH-SYMPACT™ for use in patients with SAPH. The interviews comprised concept elicitation, completion of the PAH-SYMPACT™, and cognitive debriefing. Interview transcripts were analyzed by content analysis. Results Eleven patients with SAPH were interviewed between August 2019 and June 2020. In the concept elicitation, all 11 participants endorsed shortness of breath and nine participants (82%) rated it as their “most bothersome or severe” symptom. Impacts endorsed by all 11 participants were difficulty walking uphill or up stairs and difficulty in performing daily activities. Cognitive debriefing indicated that the PAH-SYMPACT™ items were relevant and understandable to most participants and reflected their experiences of SAPH. Participants indicated that no key symptoms or impacts of SAPH were missing. They also reported that the PAH-SYMPACT™ instructions and response options were clear, and that it would be feasible to complete the 11 symptom items and one oxygen use item as part of their daily schedule. Conclusions This study suggests the PAH-SYMPACT™ is suitable for assessing symptoms and their impact in patients with SAPH. However, larger longitudinal studies are needed to confirm that it is fit for use in this patient population and that it can be used to reliably detect temporal changes in patients’ symptom status. Trial registration Not applicable.


2016 ◽  
Vol 32 (2) ◽  
pp. 111-118 ◽  
Author(s):  
Marianna Szabó ◽  
Veronika Mészáros ◽  
Judit Sallay ◽  
Gyöngyi Ajtay ◽  
Viktor Boross ◽  
...  

Abstract. The aim of the present study was to examine the construct and cross-cultural validity of the Beck Hopelessness Scale (BHS; Beck, Weissman, Lester, & Trexler, 1974 ). Beck et al. applied exploratory Principal Components Analysis and argued that the scale measured three specific components (affective, motivational, and cognitive). Subsequent studies identified one, two, three, or more factors, highlighting a lack of clarity regarding the scale’s construct validity. In a large clinical sample, we tested the original three-factor model and explored alternative models using both confirmatory and exploratory factor analytical techniques appropriate for analyzing binary data. In doing so, we investigated whether method variance needs to be taken into account in understanding the structure of the BHS. Our findings supported a bifactor model that explicitly included method effects. We concluded that the BHS measures a single underlying construct of hopelessness, and that an incorporation of method effects consolidates previous findings where positively and negatively worded items loaded on separate factors. Our study further contributes to establishing the cross-cultural validity of this instrument by showing that BHS scores differentiate between depressed, anxious, and nonclinical groups in a Hungarian population.


2013 ◽  
Author(s):  
Satoko Kimpara ◽  
Evangelina E. Regner ◽  
Bryan T. Forrester

Sign in / Sign up

Export Citation Format

Share Document