scholarly journals Development of symptom-focused outcome measures for advanced and indolent systemic mastocytosis: the AdvSM-SAF and ISM-SAF©

2021 ◽  
Vol 16 (1) ◽  
Author(s):  
Fiona Taylor ◽  
Cem Akin ◽  
Roger E. Lamoureux ◽  
Brad Padilla ◽  
Tanya Green ◽  
...  

Abstract Background Advanced systemic mastocytosis (AdvSM), indolent systemic mastocytosis (ISM), and smoldering systemic mastocytosis (SSM) are rare diseases characterized by neoplastic mast cell infiltration of more than one organ. A content-valid patient-reported outcome (PRO) questionnaire that assesses relevant signs and symptoms that are important and understandable to individuals with a condition is critical for assessing new treatment benefit as well as supporting product labeling claims. Notably, no such PRO questionnaire has been developed in accordance with regulatory and scientific guidelines for use in AdvSM, ISM, and SSM patient populations. To fill that gap, this study documents the development and content validity of instruments evaluating signs and symptoms of systemic mastocytosis. Methods A review of peer-reviewed literature, advice meetings with clinical therapeutic area experts, patient concept elicitation interviews, concept selection and questionnaire construction meetings, and patient cognitive debriefing interviews were conducted, and regulatory feedback was incorporated. Results For AdvSM, 26 sign- and symptom-level concepts were identified in literature, 39 by clinicians, and 33 by patients. For ISM/SSM, 38 sign- and symptom-level concepts were identified in the literature, 39 by clinicians, and 57 by patients. Two patient-reported instruments, the Advanced Systemic Mastocytosis Symptom Assessment Form (AdvSM-SAF) and Indolent Systemic Mastocytosis Symptom Assessment Form (ISM-SAF)(©Blueprint Medicines Corporation), were developed based on consolidated findings. Cognitive debriefing interviews with AdvSM and ISM patients showed the AdvSM-SAF and ISM-SAF were understood and interpreted as intended by the majority of patients. Conclusion The AdvSM-SAF and ISM-SAF are content-valid tools measuring symptoms from AdvSM and ISM patients’ perspective.

2021 ◽  
Vol 16 (1) ◽  
Author(s):  
Chad Gwaltney ◽  
Jonathan Stokes ◽  
Anthony Aiudi ◽  
Iyar Mazar ◽  
Sarah Ollis ◽  
...  

Abstract Background Barth Syndrome (BTHS) is a rare genetic disorder that presents as a complex of debilitating symptoms and reduced life expectancy. Well-developed, BTHS-specific assessments measuring primary signs and symptoms of BTHS are not currently available, making it difficult to evaluate treatment effects in BTHS clinical studies. The objective of this research was to develop symptom-focused patient-reported outcome (PRO) measures for use in clinical studies with adolescents and adults with BTHS. Methods Concept elicitation interviews (CEIs) with pediatric (n = 18, age < 16 years) and adult (n = 15, age ≥ 16 years) individuals with BTHS and/or their caregivers were conducted to identify signs and symptoms relevant to BTHS and important to individuals with the condition. Based on CEI results, questionnaire construction activities were conducted to create unique adolescent and adult versions of the Barth Syndrome-Symptom Assessment (BTHS-SA). The questionnaires were evaluated in cognitive debriefing interviews (CDIs) with adolescents (n = 12; age 12- < 16 years) and adults (n = 12; age ≥ 16 years) with BTHS to assess relevance and readability of the tools. Results During the CEIs, a total of 48 and 40 signs and symptoms were reported by the pediatric and adult groups, respectively; 31 were reported by both age groups. Fatigue/tiredness and muscle weakness were the symptoms most frequently reported by both pediatric and adult patients with BTHS as important to improve with an effective treatment. The CEI results informed construction of a nine-item version of the BTHS-SA for adolescents and an eight-item version for adults. Developed for daily administration, each version asks respondents to rate symptom severity “at its worst” over the 24 h prior to administration. CDIs with both adolescents and adults with BTHS demonstrated that each BTHS-SA version was reflective of the disease experience and that respondents could interpret the questionnaire as intended and provide responses that accurately reflected their symptom experience. Conclusions The BTHS-SA adolescent and adult versions are content-valid PRO measures that can be used to evaluate severity of disease-specific symptoms in future clinical trials. Given the lack of available and well-developed assessments in this underserved therapeutic area, these tools fulfill a need for clinical researchers developing treatments for individuals with BTHS.


2021 ◽  
Vol 16 (1) ◽  
Author(s):  
Calvin N. Ho ◽  
Sean O’Quinn ◽  
Julie Bailey ◽  
Oren Meyers ◽  
Ashley F. Slagle ◽  
...  

Abstract Background A patient reported outcome (PRO) instrument with evidence of validity and reliability for assessing symptoms of eosinophilic gastritis (EG) and eosinophilic gastroenteritis (EGE) is needed to measure treatment benefit in clinical trials. The aim of this research is to develop an EG/EGE symptom PRO instrument for patients aged 12 and above. Methods The Symptom Assessment for Gastrointestinal Eosinophilic Diseases (SAGED) was developed through a literature review, discussions with expert clinicians, and concept elicitation and cognitive debriefing interviews with patients. Patients (n = 28) were recruited based on confirmed diagnosis and self-reported symptoms. The final instrument was translated and linguistically validated with additional cognitive debriefing interviews (n = 105). Results SAGED is a 24-h recall questionnaire consisting of eight items evaluating the core symptoms of EG and EGE (abdominal pain, nausea, bloating, early satiety, loss of appetite, vomiting, and diarrhea). Seven of the eight items are evaluated on an 11-point numerical rating scale ranging from ‘none’ to ‘worst imaginable’. Cognitive debriefing interviews showed that adults and adolescents understand the content and are able to select a response that reflects their experience. The linguistic validation process produced 21 translations that are understandable to patients and conceptually equivalent to the source version. Conclusions SAGED is suitable for measuring symptom improvement in adult and adolescent patients with EG and/or EGE. The content validity of SAGED has been established through best practices in qualitative research for PRO instrument development. The psychometric properties of SAGED will be evaluated in a future study.


2021 ◽  
Vol 16 (1) ◽  
Author(s):  
Brad Padilla ◽  
Alan L. Shields ◽  
Fiona Taylor ◽  
Xiaoran Li ◽  
Jeffrey Mcdonald ◽  
...  

Abstract Background Indolent systemic mastocytosis (ISM) is a rare, clonal mast cell neoplasm characterized by severe, unpredictable symptoms. The Indolent Systemic Mastocytosis Symptom Assessment Form (ISM-SAF) items compose a Total Symptom Score (TSS), Gastrointestinal Symptom Score (GSS), and Skin Symptom Score (SSS) to assess symptom severity. This study evaluated the psychometric performance of ISM-SAF among ISM patients. Methods In PIONEER, a Phase 2 trial evaluating safety and efficacy of selective kinase inhibitor avapritinib in patients with ISM, the 12-item ISM-SAF was administered daily. Psychometric evaluation of score reliability, validity, and clinical interpretation was conducted using the trial data. Results Thirty-eight patients contributed to analyses (78.9% female; mean age = 49). Baseline internal consistency reliability (α) for bi-weekly TSS, GSS, and SSS was 0.86, 0.83, and 0.82, respectively. Test–retest reliability among patients exhibiting no change in Patient Global Impression of Symptom Severity (PGIS) between Baseline and Day 15 exceeded 0.74 universally. Construct validity and known-groups analysis showed moderate to strong ISM-SAF score correlation (r = 0.382–0.881) to supportive patient-reported questionnaires (e.g., PGIS and Mastocytosis Quality of Life Questionnaire) symptom and skin scores, and ability to distinguish among clinically unique groups. Correlations of ISM-SAF and other assessment change scores reflect evidence of score sensitivity. Clinically important difference and response estimates were 7–10 and 19, respectively. Discussion ISM-SAF produced reliable, construct-valid, sensitive scores when administered in PIONEER to patients in the target population. Results of this study support the use of the ISM-SAF as a reliable and valid measure to evaluate disease symptomology in ISM patients. Trial registration ClinicalTrials.gov, NCT03731260. Registered 10 October 2018, https://clinicaltrials.gov/ct2/show/study/NCT03731260.


2019 ◽  
Vol 22 ◽  
pp. S867-S868
Author(s):  
A. Shields ◽  
F. Taylor ◽  
R. Lamoureux ◽  
B. Padilla ◽  
K. Severson ◽  
...  

2020 ◽  
Vol 15 (9) ◽  
pp. 1299-1309 ◽  
Author(s):  
Jenna M. Evans ◽  
Alysha Glazer ◽  
Rebecca Lum ◽  
Esti Heale ◽  
Marnie MacKinnon ◽  
...  

Background and objectivesThe Edmonton Symptom Assessment System Revised: Renal is a patient-reported outcome measure used to assess physical and psychosocial symptom burden in patients treated with maintenance dialysis. Studies of patient-reported outcome measures suggest the need for deeper understanding of how to optimize their implementation and use. This study examines patient and provider perspectives of the implementation process and the influence of the Edmonton Symptom Assessment System Revised: Renal on symptom management, patient-provider communication, and interdisciplinary communication.Design, setting, participants, & measurements Eight in-facility hemodialysis programs in Ontario, Canada, assessed patients using the Edmonton Symptom Assessment System Revised: Renal every 4–6 weeks for 1 year. Screening and completion rates were tracked, and pre- and postimplementation surveys and midimplementation interviews were conducted with patients and providers. A chart audit was conducted 12 months postimplementation.ResultsIn total, 1459 patients completed the Edmonton Symptom Assessment System Revised: Renal; 58% of eligible patients completed the preimplementation survey (n=718), and 56% of patients who completed the Edmonton Symptom Assessment System Revised: Renal at least once completed the postimplementation survey (n=569). Provider survey response rates were 71% (n=514) and 54% (n=319), respectively. Nine patients/caregivers from three sites and 48 providers from all sites participated in interviews. A total of 1207 charts were audited. Seven of eight sites had mean screening rates over 80%, suggesting that routine use of the Edmonton Symptom Assessment System Revised: Renal in clinical practice is feasible. However, the multiple data sources painted an inconsistent picture of the value and effect of the Edmonton Symptom Assessment System Revised: Renal. The Edmonton Symptom Assessment System Revised: Renal standardized symptom screening processes across providers and sites; improved patient and provider symptom awareness, particularly for psychosocial symptoms; and empowered patients to raise issues with providers. Yet, there was little, if any, statistically significant improvement in the metrics used to assess symptom management, patient-provider communication, and interdisciplinary communication.ConclusionsThe Edmonton Symptom Assessment System Revised: Renal patient-reported outcome measure may be useful to standardize symptom screening, enhance awareness of psychosocial symptoms among patients and providers, and empower patients rather than to reduce symptom burden.


2018 ◽  
Vol 36 (30_suppl) ◽  
pp. 186-186
Author(s):  
Brandon Bosch ◽  
Scott Hartman ◽  
Lauren Caldarello ◽  
Diane Denny, DBA

186 Background: As a national network of hospitals that specialize in the treatment of patients fighting complex or advanced-stage cancer, the network was an early adopter of using patient reported outcome (PRO) data as part of its routine patient assessment and treatment. Since 2012 an externally validated tool has been used to capture patients’ perceived symptom burden for real-time clinical intervention, from the point of first visit throughout the course of treatment, at intervals of 21 days or greater. Research has demonstrated the use of PRO data as a valuable component of a patient’s treatment plan, promoting improved quality and length of life. Methods: The use of this data across the network was expanded such that results once only accessible on paper and via electronically stored images, has now been fully integrated into the electronic health record (EHR). A multidisciplinary project team formulated the specifications for a successful integration of PRO data into the EHR. Results: The project achieved its goal and went beyond data integration to include implementation of a solution to facilitate documentation of intervention against patients’ symptoms. Provider workflow efficiency is greatly enhanced via single system access and visual notification, with critical values flagged, to focus providers’ attention on severe symptoms. Incorporation of a unified EHR flowsheet provides a paperless, one-stop symptom assessment approach and streamlined mechanism for intervention documentation. The documentation module leverages structured data fields and linkage of PRO data with interventions, such as specialist referrals or medication orders, to support enhanced patient care and quality improvement. Conclusions: The ability to easily view an array of patient reported concerns and document interventions against severe or significantly worsening symptoms provides clinicians an enhanced ability to address quality of life related needs. PRO data is now stored electronically in the enterprise warehouse, thus enabling aggregation with data from which to perform population analysis and eventually, pursue opportunities for predictive modeling.


Blood ◽  
2021 ◽  
Vol 138 (Supplement 1) ◽  
pp. 4144-4144
Author(s):  
Shayna Egan ◽  
Erin Zagadailov ◽  
Adrian Jewett ◽  
Junlong Li ◽  
Feng Tai ◽  
...  

Abstract Introduction: Pyruvate kinase (PK) deficiency is a rare hereditary disorder characterized by chronic hemolytic anemia and long-term complications such as iron overload, osteoporosis, and pulmonary hypertension. There are no patient-reported outcome (PRO) instruments that are specific for this condition. The PK Deficiency Diary (PKDD), a disease-specific PRO, was designed as an evening diary to assess signs and symptoms for patients with PK deficiency. The seven-item instrument assesses tiredness, jaundice, bone pain, shortness of breath, and energy levels. Six of the seven items employ a numeric rating scale (NRS) ranging from 0-10 and one item uses a 5-point verbal descriptor scale. The instrument underwent psychometric validation using blinded data from the eighty patients participating in the ACTIVATE trial, a randomized, multicenter, double-blind, phase 3 trial of mitapivat, an allosteric activator of PK, in non-regularly transfused adults with PK deficiency (NCT03548220). Methods: Completion rates and baseline response distributions were characterized using descriptive statistics. Inter-item correlations were estimated and item response theory (IRT) modeling was applied. A scoring system was established with item weighting informed by IRT modeling. The resultant baseline scores were used to assess reliability (internal consistency and test-retest) and validity (convergent and known-groups). Change scores for group comparisons were evaluated via anchor-based methods using the Patient Global Impression of Severity (PGIS) changes from baseline to weeks 12 and 24. The PGIS had a 5-point verbal descriptor scale (Not at all, A little, Moderately, A lot, and Very much). Results: Baseline PKDD data were available for 77 patients (96% completion rate). Response distributions skewed right with sparse endorsements at the higher levels, especially for the NRS-rated items. To facilitate IRT modeling, responses were recoded to a 0-4 scale. The IRT model for the baseline item responses resulted in adequate fit [Root Mean Squared Error of Approximation (RMSEA) 0.09, 95% CI = (&lt;0.01, 0.132)]. Daily sum scores were first calculated and then converted to T-scores (mean of 50 and standard deviation of 10) employing a scoring conversion (Table). The conversion of sum scores to T-scores is based on the expected a-priori scores (Z) from the IRT model. A higher score represents more severe symptomatology and higher disease burden. Internal consistency was assessed with McDonald's coefficient, ω = 0.86, indicating a high level of reliability. Test-retest reliability via a two-way mixed effects Intra-Class Correlation Coefficient (ICC) was also high (0.94). Convergent validity was established when correlating PKDD scores with the FACT-An (|r| = 0.73), the SF-12 PCS (|r| = 0.54), and the SF-12 MCS (|r| = 0.30). Known-groups validity was moderate with mean scores ordering approximately as expected across baseline PGIS ratings and a linear trend (η 2 = 0.27). Changes in scores from baseline to weeks 12 and 24 were assessed by stratifying PKDD scores by changes in PGIS (no change as the reference group). By comparing patients who reported a 2-point worsening in severity to those who reported no change on the PGIS, estimates of a change in PKDD scores at weeks 12 and 24 ranged from 3.0 to 13.9 points. Per anchor-based methods, a change of approximately 5 to 8 points could be considered a meaningful change in PKDD score. Conclusions: The PKDD is now the first validated disease-specific PRO to assess signs and symptoms in patients with PK deficiency. The PKDD showed high internal consistency, test-retest reliability, and convergent validity. Further research investigating meaningful change scores would be beneficial. Due to the rare nature of PK deficiency, the ACTIVATE study enrolled a small number of patients overall, which was a limitation in the anchor-based determination of meaningful change. Thus, the recommended estimates of meaningful change, although interpretable for the current study, are not definitive and could benefit from further investigation. Figure 1 Figure 1. Disclosures Zagadailov: Agios Pharmaceuticals: Current Employment, Current equity holder in publicly-traded company. Li: Agios Pharmaceuticals: Current Employment, Current equity holder in publicly-traded company. Tai: Agios Pharmaceuticals: Current Employment, Current equity holder in publicly-traded company. Boscoe: Agios Pharmaceuticals: Current Employment, Current equity holder in publicly-traded company.


Sign in / Sign up

Export Citation Format

Share Document