Collection of Common Knee Patient-reported Outcome Instruments by Automated Mobile Phone Text Messaging in Pediatric Sports Medicine

2020 ◽  
Vol 40 (2) ◽  
pp. e91-e95 ◽  
Author(s):  
Xochitl Mellor ◽  
Matthew J. Buczek ◽  
Alexander J. Adams ◽  
J. Todd R. Lawrence ◽  
Theodore J. Ganley ◽  
...  
2019 ◽  
Vol 7 (3_suppl) ◽  
pp. 2325967119S0004
Author(s):  
Xochitl Mellor ◽  
Matthew J. Buczek ◽  
J. Todd Lawrence ◽  
Theodore J. Ganley ◽  
Alexander J. Adams ◽  
...  

Background: Patient-reported outcome (PRO) instruments measure a patient’s health status in a variety of domains, including physical, mental and social well-being. The delivery of such instruments has become an integral part of healthcare, commonly employed to assess treatment efficacy and outcomes in sports medicine. With the proliferation of mobile phones, administration of PROs across patient-friendly platforms (e.g. apps, text messaging) may increase completion rates, particularly among younger patients. The purpose of this study was to validate the collection of common knee PROs with text messaging in sports medicine, by correlating text messaging responses with traditional paper delivery in adolescents and young adults. Methods: Patients presenting to a hospital-based pediatric orthopaedic sports medicine clinic with a knee injury were enrolled in this prospective investigation. Patients were excluded if they were undergoing a same-day office procedure, underwent surgery within the previous 90 days, and/or had no access to a mobile phone. Paper versions of the Pediatric International Knee Documentation Committee (Pedi-IKDC) Subjective Knee Evaluation Form and the Pediatric Functional Activity Brief Scale (Pedi-Fab Scale) questionnaires were completed during the patients’ initial clinic visit. Over the next 72 hours, the patients subsequently completed the mobile phone portion of the study outside of the clinic (Figure 1), which included text message delivery of the Pedi-IKDC and Pedi-Fab Scale, assigned in a random order. Correlations between paper and text message delivery of the two PROs were assessed. Secondary analyses were conducted to examine overall completion time and associations between patient demographics and text compliance. Results: Of the 91 patients (Age M=16.0 ±2.0 years; 48% female) initially enrolled in the study, 55 (60.4%) completed the text Pedi-Fab Scale, 48 (52.7%) completed the text Pedi-IKDC, and 39 (42.9%) completed both PROs. Among the evaluable sample, the intraclass correlation coefficient (ICC) between the paper and mobile phone delivery of the Pedi-Fabs was 0.95 (95% CI, 0.91-0.97). The ICC between the paper and mobile phone delivery of the Pedi-IKDC was 0.96 (95% CI, 0.93-0.98). Average Pedi-Fab scores on paper (M=12.7) and mobile phone (M=12.3) were not significantly different (p=0.52). Similarly, average Pedi-IKDC scores on paper (M=68.8) and mobile phone (M=67.7) were not significantly different (p=0.41). A Bland-Altman plot and linear regression revealed there was no proportional bias between the mean and difference for the Pedi-Fab scores (p=0.55) and Pedi-IKDC scores (p=0.56). The average completion time for the text delivered Pedi-Fab and Pedi-IKDC were 102±224 minutes and 159±155 minutes, respectively. For Pedi-Fab, there were no patient demographics that were significantly associated with text completion. However, high school students (p=0.025), female sex (p=0.036), and race (p=0.002), were significantly associated with the text completion of Pedi-IKDC. In addition, order of the delivery of the questionnaires and paper scores were not associated with text completion for either survey. Conclusion: Text message delivery using mobile phones permits valid assessment of Pedi-IKDC and Pedi-Fabs scores in this prospective observational study. Questionnaire delivery by automated text messaging allows asynchronous response and may increase compliance among high school students while also reducing the labor cost of collecting PROs.


2019 ◽  
Vol 7 (3_suppl) ◽  
pp. 2325967119S0003
Author(s):  
Meagan J. Sabatino ◽  
Catherine V. Gans ◽  
Aaron J. Zynda ◽  
Chan-Hee Jo ◽  
Jane Chung ◽  
...  

Background: In orthopedics, patient reported outcome measures (PROMs) have become popularized due to an increase in patient-centered research and pay for performance reimbursement models. Most pediatric PROMs have been utilized and validated in paper format. However, the use of a computer-based system may improve patient and physician efficiency, decrease cost, ensure completion, provide instantaneous information, and minimize inconvenience. The purpose of the study is to validate the use, evaluate patient satisfaction, and review differences of electronic compared to paper PROMs in a pediatric sports medicine practice. Methods: New patients between 12 – 19 years of age with a knee-related primary complaint were identified prior to their appointment. Patients were then randomized into two groups to complete standard clinical PROMs; including the Pedi-IKDC, HSS Pedi-FABS, Tegner Activity Scale, Visual Analogue Scale (VAS) and PedsQL-Teen. Group 1 completed paper forms followed by electronic, while Group 2 received the electronic format followed by paper, with a 10-minute break between formats in each group. Following the completion of PROMs, subjects completed a satisfaction survey. A Pearson’s correlation was used to calculate the association between the measures and a paired t-test to compare means between electronic and paper forms. Reliability analysis was conducted using an ICC calculation. Results: 87 subjects were enrolled with one excluded due to incomplete PROMs, for a total of 86. 54 subjects were female and 32 were male with an average age of 14.3 years (range 12-18). A high degree of reliability was found when comparing the paper and electronic versions of the Pedi-IKDC, HSS Pedi-FABS, PedsQL 13-18 and the Tegner activity scale (Figure 1). Differences were noted between the VAS scores, with paper scores being significantly higher than electronic (5.3 vs 4.6, p<0.001). Excluding the 10-minute break, it took subjects an average of 21.3 minutes to complete the PROMs. Although not significant, electronic PROMs took less time than paper on average (10.0 min vs 11.2 min, p=0.096). All subjects endorsed that PROMs captured on paper were the same as electronic with 69.8% of subjects preferring the electronic PROMs. 67.4% of subjects reported they felt the electronic format was faster, with only 5.8% of patients reporting the electronic forms were hard or confusing. 93.0% stated they would complete forms at home prior to appointments if it were an option and 91.8% were not concerned about the safety/privacy of electronic forms. Conclusion/Significance: PROMs captured electronically were reliable and valid when compared to paper, with differences noted only on the VAS. Electronic PROMs may be quicker, will not require manual scoring, and are preferred by patients. Electronic PROMs will improve the clinician’s ability to collect complete and validated data while reducing the burden on the clinical staff and patients. [Figure: see text]


10.2196/15856 ◽  
2019 ◽  
Vol 21 (9) ◽  
pp. e15856 ◽  
Author(s):  
Niels Henrik I Hjollund

Background Since 2004, we have collected patient-reported outcome (PRO) data from several Danish patient populations for use at the group and patient levels. Objective The aim of this paper is to highlight trends during the last 15 years with respect to patient inclusion, the methods for collection of PRO data, the processing of the data, and the actual applications and use of the PRO measurements. Methods All PRO data have been collected using the AmbuFlex/WestChronic PRO system, which was developed by the author in 2004 and has been continuously updated since. The analysis of trends was based on a generic model applicable for any kind of clinical health data, according to which any application of clinical data may be divided into four processes: patient identification, data collection, data aggregation, and the actual data use. Data for analysis were generated by a specific application in the system and transferred for analysis to the R package. Results During the 15-year period, 78,980 patients within 28 different groups of chronic and malignant illnesses have answered 260,433 questionnaires containing a total of 13,538,760 responses. Several marked changes have taken place: (1) the creation of cohorts for clinical epidemiological research purposes has shifted towards cohorts defined by clinical use of PRO data at the patient level; (2) the development of AmbuFlex, where PRO data are used as the entire basis for outpatient follow-up instead of fixed appointments, has undergone exponential growth and the system is currently in use in 47 International Statistical Classification of Diseases and Related Health Problems groups, covering 16,000 patients and 94 departments throughout Denmark; (3) response rates (up to 92%) and low attrition rates have been reached in group level projects, and there are even higher response rates in AmbuFlex where the patients are individually referred; (4) The answering method has shifted, as while in 2005 a total of 66.5% of questionnaires were paper based, this is the case for only 4.3% in 2019; and (5) the approach methods for questionnaires and reminders have changed dramatically from letter, emails, and short message service text messaging to a national, secure electronic mail system through which 93.2% of the communication to patients took place in 2019. The combination of secure email and web-based answering has resulted in a low turnaround time in which half of responses are now received within 5 days. Conclusions The demand for clinical use of PRO measurements has increased, driven by a wish among patients as well as clinicians to use PRO to promote better symptom assessment, more patient-centered care, and more efficient use of resources. Important technological changes have occurred, creating new opportunities, and making PRO collection and use cheaper and more feasible. Several legal changes may constitute a barrier for further development as well as a barrier for better utilization of patients’ questionnaire data. The current legal restrictions on the joint use of health data imposed by the European Union’s General Data Protection Regulation makes no distinction between use and misuse, and steps should be taken to alleviate these restrictions on the joint use of PRO data.


2019 ◽  
Vol 7 (3_suppl) ◽  
pp. 2325967119S0010
Author(s):  
Emily A. Sweeney ◽  
Morgan N. Potter ◽  
Alexia G. Gagliardi ◽  
David R. Howell ◽  
Aaron Provance

Background: Both primary care sports medicine physicians and orthopedic surgeons, in conjunction with advanced practice providers, often manage young patients with fractures. To our knowledge, no investigations have evaluated patient outcomes based on the type of provider they see for fracture management. This study examined fracture management, patient outcomes, and patient satisfaction in pediatric and adolescent patients with fibula, tibia, radius and ulna fractures. Specifically, we sought to determine if there were differences between patients seen by a primary care sports medicine physician or orthopedic surgeon/physician assistant (PA) on measures of time to clearance from the injury, patient-reported functional outcomes, and patient satisfaction. Methods: A retrospective chart review was performed for 4-18 year-old patients who were treated by a sports medicine provider (primary care or orthopedic surgeon/PA) for a fracture of the radius, ulna, tibia or fibula over the course of three months. We contacted patients approximately 10 months post-injury. Patients or their parents completed a patient satisfaction survey (Short Assessment of Patient Satisfaction [SPAS]) and an injury location-specific patient reported functional outcome tool: the Foot and Ankle Ability Measure (FAAM) was used for patients with fibular or tibia fractures; the Disabilities of the Arm, Shoulder, and Hand (DASH) Scale was used for patients with radius or ulna fractures. The SPAS is scored from 0-28 with higher scores indicating higher satisfaction. The DASH is scored from 0-110, while the FAAM is scored from 0-140. For the DASH and FAAM, 0 indicates the least disability. Results: 83 of 139 (60%) of patients who were contacted completed the study. 58 (70%) of patients were treated by pediatric primary care sports medicine physicians and 25 (30%) were treated by a pediatric sports medicine orthopedic surgeon or the surgeon’s PA. Both patient groups (Table 1) were of similar age (10.3±3.1 vs. 8.9±3.9 years; p= 0.09), proportion of females (47% vs. 36%; p= 0.47), proportion of upper extremity injuries (67% vs. 80%; p= 0.30), and number of x-rays obtained (3.2±3.5 vs. 3.5±1.8; p= 0.60). The median time from injury to clinically-confirmed healing was similar between the two groups (47 vs 60.5 days; p=0.54), as was the overall patient satisfaction (Table 2) on the SPAS (median score = 26 [range = 19-28] vs 24 [range 9-28]; p = 0.11). In addition, the patient reported outcomes did not differ significantly between the two groups for the DASH (median score=0 [range= 0-11] vs. 0 [range= 0-43], p= 0.47), or the FAAM (median score= 0 [range= 0-47] vs. 0 [range= 0-0], p= 0.36). A greater proportion of patients that were treated by sports medicine primary care physicians reported they would prefer to see a sports medicine primary care physician for future care relative to the pediatric sports medicine surgeon group (Table 3; 74% vs. 20%; p< 0.001). In contrast, those seen by a sports medicine surgeon or PA indicated they would prefer to see a pediatric PA or pediatric nurse practitioner in the future relative to the pediatric sports medicine primary care group (28% vs. 2%; p= 0.001). Conclusion/Significance: Pediatric primary care sports medicine physicians and pediatric sports medicine orthopedic surgeons, with their PAs, have similar outcomes when caring for young patients with fractures of the radius/ulna and tibia/fibula. Patients report equal satisfaction with their care. Patients will likely have favorable outcomes when they are cared for by any of these providers. Tables and Figures: [Table: see text]


Author(s):  
Sérgio Rocha Piedade ◽  
Mark R. Hutchinson ◽  
Daniel Miranda Ferreira ◽  
Mario Ferretti ◽  
Nicola Maffulli

AbstractThe validation of a 4-domain PROM tailored to orthopedic sports medicine was performed through item generation, item scaling, validity and reliability testing, statistical analysis, as well as item reduction. Conbrach's alpha was used to verify item homogeneity, i. e. their accuracy or consistency. This PROM showed acceptable statistical accuracy and clinical applicability for a variety of surgical treatments, regardless of the anatomical injury sites. Moreover, this PROM considers the athletes’ primary physical demands in an non-injured baseline condition, their motivation to continue sports practice and participation, and the influence of sports practice on their quality of life. This 4-domain PROM tailored for orthopedic sports medicine appears to be a valid tool to assess athletes and high-performing practitioners with sports injuries, recording their perception of injury, expectations of treatment; evaluation of postoperative care and treatment received, and perceived outcomes compared to their pre-injury status of physical demands in sports activity. The tool is unique, allowing direct comparisons between athletes’ perception of pre-injury baseline, injury, treatment, and outcome. It will be a welcome adjunct to the sports medicine professional’s tool box when assessing athlete’s status and outcome after injury and intervention.


2020 ◽  
Vol 28 (1) ◽  
pp. e41-e46
Author(s):  
Elizabeth J. Scott ◽  
Christopher A. Anthony ◽  
Patrick Rooney ◽  
T. Sean Lynch ◽  
Michael C. Willey ◽  
...  

2019 ◽  
Vol 7 (3_suppl) ◽  
pp. 2325967119S0010
Author(s):  
Jamila N. Aberdeen ◽  
Rebecca K. Frank Burnett ◽  
Heather F. Stewart ◽  
Elliot Greenberg

Background: Patient reported outcome measures (PROs) allow medical providers to assess functional limitations, track progress, and evaluate outcomes. Although progress has been made developing and validating PROs, much of this work has been done within the adult population, and only a limited number of pediatric specific PROs exist. The use of PROs within pediatric orthopedics remains unstudied. The purposes of this study are to evaluate the current use of PROs within pediatric sports medicine and determine how the information from PROs is used for treatment decisions. Methods: An online email survey was sent to members of the Pediatric Research in Sports Medicine Society (PRiSM) using REDCap™. The survey was developed and pilot tested by 4 physical therapists and 3 orthopedic surgeons. The final survey consisted of 24 multiple choice questions, designed to garner information relative to provider use of PROs. Some questions allowed free text for answers not previously-defined. The survey took 3-5 minutes to complete and was open for an 8 week period. Although PRiSM is a multi-disciplinary society, only data from primary medical providers (PMPs -orthopedic surgeons, sports medicine primary care physicians, nurse practitioners, physician assistants) was utilized. Descriptive statistics and frequency tallies were used to analyze the data. Results: Seventy-two surveys were used for analysis; a response rate of 45% given total membership. The sample distribution can be seen in Table 1. The use of PROs was reported by 57% (n=41) of PMPs. PROs administration occurred at post-operative encounters (83%, n=34), new patient visits (73%, n=30), pre-op visits 44% (n=18), when there is a change in status/new injury 27% (n=11), and every visit 12% (n=5). The majority of information from PROs was used for research (85%, n=35), assess response to treatment (51%), inform clinical prognosis (37%) and guide clinical decisions (32%). There were no PMPs that reported distributing PROs to satisfy insurance requirements. PRO use was reported at the highest frequency for knee (98%, n=40) and shoulder (68%, n=28) injuries. There was variability in specific PRO selection with 80%, 56% and 34% using the Pedi-IKDC, IKDC, and KOOS, respectively. For the shoulder, the DASH and QuickDASH garnered the highest use (32% each) however variability in scale selection persisted with 24% using “other” scales, including activity and fear avoidance scales. PRO use for the hip (41%), ankle (39%), back (20%) and neck (17%) were reported less frequently. (Figure 3 details scale specifics). Nearly half the sample (46%) reported using affective domain or quality of life scales like the Pedi-Fabs (24%) and ACL-RSI (17%) and PROMIS (12%). Interestingly, 43% (n=31/41) of the sample indicated they do not use PROs, with 39% of these respondents citing inadequate time as the primary barrier to use, 23% were unsure of which measure to use and 16% did not find them useful or relevant. Additional barriers are presented in Figure 4. Conclusions: Only 57% of PMPs are using PROs within their practice. The information from PROs is largely used to perform research and demonstrate the effectiveness of treatment. Interestingly, no one used PROs to satisfy insurance requirements. Within all body regions, there is little consistency in scale selection. A large number of respondents indicated that PROs for hip, ankle and spine were “not applicable” to their practice, making generalization of this data difficult. Although it cannot be determined why there was such a low percentage of PRO use for these body regions, the authors feel this may be related to a small volume of patients seen with diagnoses of these regions among our sample or perceptions that no existing scale is useful for this population. It was surprising that over 40% of the sample did not use PROs in their practice. Among those respondents, inadequate time for administration and indecision regarding which measure to use, were indicated as the greatest barriers to use. Clinical Relevance: Healthcare policy within the United States is undergoing a transformation towards a value-based system, under which PROs will be heavily relied upon to demonstrate effectiveness of treatment and help determine reimbursement; this transition has already occurred in adults/the Medicare system. Our results show that although 85% of PMPs use PROs for research purposes, the use of PROs in the clinical setting is low. Given the changing payment model and increased emphasis on patient-centered care, our results highlight the importance of integrating PROs into clinical practice and support the need for ongoing research related to the validation research and scale development as many of the scales have not been evaluated in pediatrics. Tables and Figures: [Table: see text][Figure: see text][Figure: see text][Figure: see text]


Sign in / Sign up

Export Citation Format

Share Document