Development of the Oncology Opportunity Cost Assessment Tool: Item Generation and Content Validity Testing

2021 ◽  
Author(s):  
Nathan R. Handley ◽  
Adam F. Binder ◽  
Arianna Heyer ◽  
Rachel E. Granberg ◽  
Garrison Davis ◽  
...  

PURPOSE: The purpose of this study was to develop the Oncology Opportunity Cost Assessment Tool (OOCAT), a survey instrument to evaluate the opportunity costs patients experience when seeking medical oncology care. METHODS: Development of the OOCAT involved extensive patient engagement through both focus groups and interviews. First, the study team developed a list of opportunity cost concepts, which included patients' logistical and financial considerations related to seeking care. We conducted focus groups with patients to expand upon this list of concepts, and then developed a set of questions that incorporated all the concepts generated during the focus groups. To refine these questions, we next performed cognitive interviews with another set of patients to ensure content validity and clarity of instrument items, refining the OOCAT iteratively on the basis of feedback. RESULTS: We engaged 23 participants (17 patients and six caregivers) across four focus groups and 17 participants in cognitive interviews. Focus group participants generated 112 concepts, which resulted in an initial OOCAT with 16 questions. Cognitive interviews resulted in modification of 12 questions and addition of two questions (related to coordination of transportation and impact on home responsibilities). The final OOCAT consisted of 18 items examining time requirements for appointments, financial implications of traveling to appointments for the patient and the caregiver, and logistical and quality-of-life challenges associated with traveling for appointments. CONCLUSION: We developed the OOCAT, an instrument designed to evaluate patient-level opportunity costs of seeking medical oncology care. Further studies to validate the OOCAT are underway.

2021 ◽  
Vol 39 (15_suppl) ◽  
pp. e13502-e13502
Author(s):  
Nathan Handley ◽  
Adam F Binder ◽  
Alexandra Gentsch ◽  
Rachel Granberg ◽  
Arianna Heyer ◽  
...  

e13502 Background: While awareness of direct patient-level costs of cancer care are growing, less is known about the patient-level opportunity cost of care. Opportunity costs of care may include time spent seeking care, lost wages, lost leisure time, and other indirect costs associated with seeking care. Despite acknowledgment of the importance of considering patient opportunity costs in care treatment decisions, assessment of opportunity costs experienced by individual patients or caregivers is not routinely performed by healthcare providers in general, or oncology providers in particular. The purpose of this work was to develop an instrument, the Oncology Opportunity Cost Assessment Tool (OOCAT), to evaluate patient opportunity cost of seeking oncology care. Methods: Survey development was an iterative process with multiple rounds of stakeholder engagement. First the research team developed a list of potential opportunity cost themes informed by their own experiences. Next, we met with an established patient advisory group within the cancer center to expand this list of themes. We then conducted focus groups with patients and caregivers to explore in further depth their logistical and financial considerations related to seeking care. Findings were used to further expand the list of opportunity cost themes, with this list reviewed in real time with the focus group participants to ensure perspectives were appropriately captured. We then generated a set of survey items to represent each of the themes listed. We generated two items to represent each unique theme. The first item of the instrument sought to quantify the opportunity cost of the theme (e.g. time spent parking); the second component ascertained the patient-perceived importance of the theme using a 7-point Likert scale. Upon drafting of the initial OOCAT, we performed cognitive interviews with a random sampling of patients in order to ensure content validity and clarity of instrument items. Results: We completed 4 virtual focus groups with a total of 23 participants (17 patients and 6 caregivers) followed by cognitive interviews with 13 patients. The resulting OOCAT consists of 17 items that examine time requirements, financial implications, and logistical and quality of life challenges for both patients and caregivers associated seeking oncology care. Conclusions: The OOCAT is a 17-item instrument designed to quantify patient-level opportunity costs of seeking oncology care. Further studies work is needed to validate the OOCAT survey and assess the impact of incorporating quantified assessment of opportunity cost into decision regarding when and where to seek oncology care.


2020 ◽  
Vol 79 (Suppl 1) ◽  
pp. 1916-1916
Author(s):  
S. Mannix ◽  
A. Beyer ◽  
V. Strand ◽  
L. Hanrahan ◽  
C. Abél ◽  
...  

Background:Fatigue is one of the most common symptoms reported by patients with systemic lupus erythematosus (SLE)—it is responsible for considerable loss of work time and greatly impaired quality of life. The Functional Assessment of Chronic Illness Therapy-Fatigue (FACIT-F) has been used to assess fatigue in SLE clinical trials1; however, assessment of the content validity of the FACIT-F in adults with SLE suggested that closer evaluation may be warranted.2Objectives:This qualitative study aimed to understand SLE patients’ experience of fatigue and assess the content validity of the FACIT-F.Methods:The evaluation was informed by literature and guided by a project steering committee (PSC; patient advocate, clinical expert, outcomes measure expert). The institutional review board-approved study involved focus groups (Round 1) and cognitive interviews (Round 2) with adults with moderate-to-severely active SLE. All participants provided written informed consent. Round 1 included three focus groups to understand the disease and fatigue-related concepts that were most important to patients; participants also provided high-level feedback on the FACIT-F. Round 2 included 13 one-on-one cognitive interviews on the relevance of content, clarity, and comprehensiveness of the FACIT-F. Interviews were audio-recorded and transcribed and a content analysis was completed. The PSC reviewed results and contributed to decision-making. Specific focus was on determining patient understanding of the FACIT-F, comprehensiveness, and any gaps in concept coverage to evaluate fatigue in the context of a clinical trial.Results:Twenty-eight patients with moderate-to-severely active SLE participated; they were mostly female (n=27), had a mean age of 45.5 ± 12.1 years (range: 18–75), and 23 (82%) had moderate and five (18%) severely active SLE. All participants were receiving SLE treatment, and most (n=23, 82%) reported fatigue among their top three most important SLE-related symptoms. Fatigue was described as having a profound impact on daily life, including ability to perform chores and work-related activities, maintain personal hygiene, exercise, and participate in hobbies. Study participants reported the FACIT-F covered concepts most relevant to their fatigue experience. Participants were able to understand the FACIT-F instructions, items, and response options and felt the recall period of seven days was appropriate.Conclusion:Fatigue was one of the most important symptoms, having a significant impact on adults with moderate-to-severely active SLE, limiting their ability to perform necessary or desired activities. The FACIT-F was found to be an appropriate measure for the assessment of fatigue in this sample.3Evidence of the content validity of the FACIT-F in adults with SLE was confirmed for use to support endpoints in the Cenerimod Assessing S1P1Receptor Modulation in SLE (CARE) clinical trial.References:[1]Izadi Z, Gandrup J, Katz PP, Yazdany J. Patient-reported outcome measures for use in clinical trials of SLE: a review. Lupus Sci Med. 2018;5(1):e000279.[2]Kosinski M, Gajria K, Fernandes A, Cella D. Qualitative validation of the FACIT-Fatigue scale in systemic lupus erythematosus. Lupus. 2013;22(5):422-430.[3]Mannix S, Beyer A, Strand V, Hanrahan L, Abel C, Flamion B, Hareendran A. Assessment of Fatigue in Adults with Moderate to Severe Systemic Lupus Erythematosus (SLE): A Qualitative Study to Explore What Patients Feel Should Be Measured in Clinical Trials [abstract]. Arthritis Rheumatol. 2019; 71 (suppl 10).Acknowledgments:We thank Dr. David Cella, developer of the FACIT-F, for his time discussing the measure, interim findings, and PSC feedback; the site staff for patient recruitment; Andrea Schulz and Rodolfo Matos, who conducted interviews.Disclosure of Interests:Sally Mannix Employee of: Evidera, Andrea Beyer Employee of: Idorsia Pharmaceuticals, Vibeke Strand Consultant of: AbbVie, Amgen, Biogen, Celltrion, Consortium of Rheumatology Researchers of North America, Crescendo Bioscience, Eli Lilly, Genentech/Roche, GlaxoSmithKline, Hospira, Janssen, Merck, Novartis, Pfizer, Regeneron Pharmaceuticals, Inc., Sanofi, UCB, Leslie Hanrahan: None declared, Cristina Abél Employee of: Evidera, Bruno Flamion Shareholder of: Idorsia Pharmaceuticals, Employee of: Idorsia Pharmaceuticals, Asha Hareendran Employee of: Evidera


2018 ◽  
pp. 1-9
Author(s):  
Chika R. Nwachukwu ◽  
Omobola Mudasiru ◽  
Lynn Million ◽  
Shruti Sheth ◽  
Hope Qamoos ◽  
...  

Purpose Despite recognition of both the growing cancer burden in low- and middle-income countries and the disproportionately high mortality rates in these settings, delivery of high-quality cancer care remains a challenge. The disparities in cancer care outcomes for many geographic regions result from barriers that are likely complex and understudied. This study describes the development and use of a streamlined needs assessment questionnaire (NAQ) to understand the barriers to providing quality cancer care, identifies areas for improvement, and formulates recommendations for implementation. Methods Using a comprehensive NAQ, in-depth interviews were conducted with 17 hospital staff involved in cancer care at two teaching hospitals in Nigeria. Data were analyzed using content analysis and organized into a framework with preset codes and emergent codes, where applicable. Results Data from the interviews were organized into six broad themes: staff, stuff, system, space, lack of palliative care, and provider bias, with key barriers within themes including: financial, infrastructural, lack of awareness, limited human capacity resources, lack of palliative care, and provider perspective on patient-related barriers to cancer care. Specific solutions based on ability to reasonably implement were subcategorized into short-, medium-, and long-term goals. Conclusion This study provides a framework for a streamlined initial needs assessment and a unique discussion on the barriers to high-quality oncology care that are prevalent in resource-constrained settings. We report the feasibility of collecting and organizing data using a streamlined NAQ and provide a thorough and in-depth understanding of the challenges in this setting. Knowledge gained from the assessments will inform steps to improve oncology cancer in these settings.


BMJ Open ◽  
2021 ◽  
Vol 11 (4) ◽  
pp. e045550
Author(s):  
Zhigang Zhang ◽  
Guoqiang Wang ◽  
Yuchen Wu ◽  
Jin Guo ◽  
Nannan Ding ◽  
...  

PurposeTo translate and adapt the Chelsea Critical Care Physical Assessment Tool (CPAx) into Chinese version (‘CPAx-Chi’), test the reliability and validity of CPAx-Chi, and verify the cut-off point for the diagnosis of intensive care unit-acquired weakness (ICU-AW).Study designCross-sectional observational study.MethodsForward and back translation, cross-cultural adaptation and pretesting of CPAx into CPAx-Chi were based on the Brislin model. Participants were recruited from the general ICU of five third-grade class-A hospitals in western China. Two hundred critically ill adult patients (median age: 53 years; 64% men) with duration of ICU stay ≥48 hours and Glasgow Coma Scale ≥11 were included in this study. Two researchers simultaneously and independently assessed eligible patients using the Medical Research Council Muscle Score (MRC-Score) and CPAx-Chi.ResultsThe content validity index of items was 0.889. The content validity index of scale was 0.955. Taking the MRC-Score scale as standard, the criterion validity of CPAx-Chi was r=0.758 (p<0.001) for researcher A, and r=0.65 (p<0.001) for researcher B. Cronbach’s α was 0.939. The inter-rater reliability was 0.902 (p<0.001). The area under the receiver operating characteristic curves of CPAx-Chi for diagnosing ICU-AW based on MRC-Score ≤48 were 0.899 (95% CI 0.862 to 1.025) and 0.874 (95% CI 0.824 to 0.925) for researcher B. The best cut-off point for CPAx-Chi for the diagnosis of ICU-AW was 31.5. The sensitivity was 87% and specificity was 77% for researcher A, whereas it was 0.621, 31.5, 75% and 87% for researcher B, respectively. The consistency was high when taking CPAx-Chi ≤31 and MRC-Score ≤48 as the cut-off points for the diagnosis of ICU-AW. Cohen’s kappa=0.845 (p=0.02) in researcher A and 0.839 (p=0.04) for researcher B.ConclusionsCPAx-Chi demonstrated content validity, criterion-related validity and reliability. CPAx-Chi showed the best accuracy in assessment of patients at risk of ICU-AW with good sensitivity and specificity at a recommended cut-off of 31.


Author(s):  
Irene Muir ◽  
Krista Munroe-Chandler

AbstractGiven the differences between young dancers’ and adult dancers’ use of imagery, a valid and reliable questionnaire specific to young dancers was necessary. The current study is the first phase of a multi-phase study in the development of the Dance Imagery Questionnaire for Children (DIQ-C). Specifically, the purpose of this study was to establish content validity of the DIQ-C. This was achieved through the following three stages: (1) definition, item, and scale development, (2) assessment of item clarity and appropriateness via cognitive interviews, and (3) assessment of item-content relevance via an expert rating panel. Guided by previous qualitative research with young dancers, 46 items representing seven subscales (i.e., imagery types) were developed. The initial item pool was then implemented during cognitive interviews with 16 dancers (15 females; Mage=10.63, SD=1.82), which led to the removal of 13 items and the modification of 21 items. Consequently, the revised 33-item pool was then administered to an expert panel of four imagery researchers and four dance instructors to measure item-content relevance. This resulted in the removal of eight items, the revision of four items, and the merging of two subscales. Overall, the current study provides content validity evidence for a 25-item pool (representing five subscales) to be used in further development of the DIQ-C (i.e., identifying and establishing factor structure).


Author(s):  
Garden Tabacchi ◽  
Giuseppe Battaglia ◽  
Giuseppe Messina ◽  
Antonio Paoli ◽  
Antonio Palma ◽  
...  

Background: The importance of assessing “food literacy” since youth has been highlighted and, to this purpose, valid and consistent instruments are needed. This study aimed to assess the validity and internal consistency of the preschool-FLAT (Food Literacy Assessment Tool). Methods. 505 children from 21 kindergartens, recruited within the Training-to-Health Project in Palermo (Italy), underwent oral sessions and activities on food-related aspects. Their knowledge/skills were recorded in the preschool-FLAT. The following scale measures were assessed: Content validity; internal consistency (Chronbach’s alpha coefficients); construct validity (Structural Equation Modeling—SEM); discriminant validity (intervention subgroup of 100 children vs. control group of 27 children). Results. Acceptable content validity of a 16-items scale and overall adequate internal consistency were revealed: Content validity index (CVI) 0.94, content validity ratio (CVR) 0.88, Chronbach’s alpha 0.76. The SEM revealed a 4-factor model fitting the data well (comparative fit index 0.939, root mean square error of approximation 0.033). Discriminant validity was good (intervention group scoring higher than control, p < 0.001, unpaired Student’s t-test). Conclusion. The preschool-FLAT revealed good psychometric properties, adequate validity and internal consistency. This is the only instrument in the literature specifically targeted to 3–6 years old children that could be effectively used to assess food literacy.


2020 ◽  
Vol 32 (10) ◽  
pp. 701-707
Author(s):  
Mehtap Akgün ◽  
Selma Turan Kavradim ◽  
İlkay Boz ◽  
Zeynep Özer

Abstract Objectives To develop and examine the psychometric properties of the Caring Behaviors Assessment Tool Nursing Version-Short Form (CBAN-SF) based on the Theory of Human Caring to assess the nurses’ perceptions about caring behaviors. Design This study is based on the Consensus-based Standards for the Selection of Health Measurement Instruments checklist. Setting The study was conducted at the medical-surgical services of Akdeniz University Hospital between October 2019 and January 2020. Participants This study was conducted with 216 nurses working in the surgery and internal clinics. Main Outcome Measures Psychometric properties of the Turkish version of the CBAN-SF with 27 items. Results It was found that the Content Validity Index (CVI) for the items of the draft scale was between 0.972 and 1.00 and the instrument’s CVI had an average score of 0.994. The CBAN-SF had good fit indexes (chi-square goodness of fit / degrees of freedom = 2.914, root mean square error of approximation = 0.075, comparative fit index = 0.984, non-normed fit index = 0.983, normed fit index = 0.972 and standardized root mean square residuals = 0.054) in structural validity. For internal consistency, the Cronbach’s alpha, Spearman–Brown and the Guttman split-half coefficients were all 0.974. The Cronbach’s alpha coefficient for the seven subfactors of the scale ranged between 0.793 and 0.904 and had acceptable internal consistency. The item-total score correlation of the scale was 0.648–0.829, and the factor loadings were 0.455–0.769. Conclusion The structural validity, internal consistency and content validity of the CBAN-SF supported to be a reliable and valid tool for assessment of caring behaviors by nurses.


2015 ◽  
Vol 23 (3) ◽  
pp. 485-498
Author(s):  
Martha R. Sleutel ◽  
Celestina Barbosa-Leiker ◽  
Marian Wilson

Background and Purpose: Evidence-based practice (EBP) is essential to optimal health care outcomes. Interventions to improve use of evidence depend on accurate assessments from reliable, valid, and user-friendly tools. This study reports psychometric analyses from a modified version of a widely used EBP questionnaire, the information literacy for nursing practice (ILNP). Methods: After content validity assessments by nurse researchers, a convenience sam ple of 2,439 nurses completed the revised 23-item questionnaire. We examined internal consistency and used factor analyses to assess the factor structure. Results: A modified 4-factor model demonstrated adequate fit to the data. Cronbach’s alpha was .80–.92 for the subscales. Conclusions: The shortened ILNP (renamed Healthcare EBP Assessment Tool or HEAT) demonstrated adequate content validity, construct validity, and reliability.


2020 ◽  
Vol 4 (Supplement_1) ◽  
pp. 108-108
Author(s):  
Rumiko Tsuchiya-Ito ◽  
Björn Slaug ◽  
Tomonori Sano ◽  
Miki Tajima ◽  
Sakiko Itoh ◽  
...  

Abstract Scientifically validated tools to assess housing accessibility for older adults in Japan have been lacking. To address this, a rigorous procedure of adapting an existing housing assessment tool—the Housing Enabler, developed in Sweden—for valid use in Japan was conducted. The original tool was translated into the Japanese language, using established translation procedures. In the process, researchers checked the appropriateness of technical terms and adjusted specifications to be in accordance with Japanese standards. An expert panel approach was used to validate the content of the Japanese Housing Enabler. Thirteen certified occupational therapists, architects and care-managers (average experience=14.5 years) participated as experts in the content validity study. They rated each item with regard to relevance for assessing housing accessibility in Japan, on a scale from 1(=Not relevant) to 4(= Highly relevant). They suggested adjustments and additions that they found to be relevant to capture particularities of Japanese housing and building design. After individual ratings, the experts gathered for consensus discussions on suggested revisions of the item list. As a result, the number of items was substantially increased (from 161 to 283). A content validity index (CVI) was calculated for each item (i.e., the proportion of experts rating the relevance as at least 3). Using a recommended threshold of CVI ≥0.78, more than 90% of the items were considered relevant, thus supporting the content validity. However, the large amount of items might jeopardize the feasibility of the instrument. Further studies are needed to evaluate feasibility, criterion-related validity and aspects of reliability.


2021 ◽  
Vol 15 (12) ◽  
pp. 3505-3508
Author(s):  
Noor Ul Ain Fatima ◽  
Qurat-Ul- Ain ◽  
Fareeha Kausar ◽  
Mian Ali Raza ◽  
Misbah Waris ◽  
...  

Objective: To translate and validate the ABC-Scale in Urdu language to predict risk of fall in older population. Study design: Cross-cultural Translation and validation Place and Duration: Study was conducted in older adult community of Sialkot from March 2020 to December 2020. Methodology: Translation of ABC in Urdu was conducted by using Beaton et al guidelines. Two bilingual translators translated the original version into Urdu language step wise, correction process was followed. Then two backward translations were done by language expert. After all this process, the translated version was reviewed by the professionals and the final version was applied on 15 individuals. Its reliability and validity was tested on 60 older adults. Results: For test re test reliability, intra class correlation coefficient ICC was measured with a value of 0.984 Which shows good test re-test reliability. The internal consistency and reliability of ABC was calculated by Cronbach’s alpha for total score with a value of 0.985. Content validity was good with values of CVI ranging from 0.767 to 0.955. To test the discriminative validity, independent t test was used to show the difference between the healthy and unhealthy adults. Factor analysis of UABC showed total variance 81.277 and cumulative variance was also 81.277. To calculate construct validity of U-ABC Pearson’s correlation coefficient was used and measured as 0.558. Conclusion: It was concluded that Urdu version of UABC is a valid assessment tool for older adults with fear of fall. It has good content validity, construct validity and reliability. Keywords: activities specific balance scale, validation, Urdu translation, reliability, tool translation


Sign in / Sign up

Export Citation Format

Share Document