Truncated rank correlation (TRC) as a robust measure of test-retest reliability in mass spectrometry data

2019 ◽  
Vol 18 (4) ◽  
Author(s):  
Johan Lim ◽  
Donghyeon Yu ◽  
Hsun-chih Kuo ◽  
Hyungwon Choi ◽  
Scott Walmsley
Keyword(s):  
Mass Spectrometry ◽  
Numerical Study ◽  
Rank Correlation ◽  
Mass Spectrometry Data ◽  
Charge Ratio ◽  
Hek293 Cells ◽  
Chromatographic Retention ◽  
Prostate Hyperplasia ◽  
Retest Reliability ◽  
Test Retest Reliability

Abstract In mass spectrometry (MS) experiments, more than thousands of peaks are detected in the space of mass-to-charge ratio and chromatographic retention time, each associated with an abundance measurement. However, a large proportion of the peaks consists of experimental noise and low abundance compounds are typically masked by noise peaks, compromising the quality of the data. In this paper, we propose a new measure of similarity between a pair of MS experiments, called truncated rank correlation (TRC). To provide a robust metric of similarity in noisy high-dimensional data, TRC uses truncated top ranks (or top m-ranks) for calculating correlation. A comprehensive numerical study suggests that TRC outperforms traditional sample correlation and Kendall’s τ. We apply TRC to measuring test-retest reliability of two MS experiments, including biological replicate analysis of the metabolome in HEK293 cells and metabolomic profiling of benign prostate hyperplasia (BPH) patients. An R package trc of the proposed TRC and related functions is available at https://sites.google.com/site/dhyeonyu/software.

Validation of the Korean Version of the Acupuncture Expectancy Scale

2014 ◽  
Vol 32 (1) ◽  
pp. 51-55 ◽  
Author(s):  
Yun-Ji Kim ◽  
In-Seon Lee ◽  
Ho-Sun Kim ◽  
Hyejung Lee ◽  
Hi-Joon Park ◽  
...  
Keyword(s):  
Principal Component Analysis ◽  
Acupuncture Therapy ◽  
Acupuncture Treatment ◽  
Rank Correlation ◽  
Principal Component ◽  
Spearman Rank Correlation ◽  
Retest Reliability ◽  
Spearman Rank ◽  
Test Retest Reliability ◽  
To Receive

Objectives Expectancy has been shown to affect patients’ responses to acupuncture therapy. However, no validated measure of expectancy for acupuncture is available in the Korean language. The Acupuncture Expectancy Scale (AES), a 4-item self-reporting questionnaire, is the validated instrument for measuring expectancies regarding acupuncture therapy. We translated the AES into Korean and examined its test–retest reliability and construct validity. Methods The AES was translated using a forward and backward translation procedure. Internal consistency was assessed in 275 participants with item-total correlations. Construct validity was also assessed by performing principal component analysis and correlating scores on the scale with the participants’ intention to receive acupuncture therapy. Test–retest reliability was assessed in 33 participants by calculating Cronbach's α and Spearman rank correlation coefficients. Results Internal consistency was high (Cronbach's α=0.910). Principal component analysis showed that expectancy of acupuncture treatment accounted for 79.2% of the variance. The AES was positively correlated with participants’ intention to receive acupuncture treatment (r=0.695, p<0.001). Test–retest reliability in 33 of the 275 participants was adequate, with the Spearman rank correlation coefficient ranging from 0.500 to 0.737 (p<0.001). Conclusions The Korean version of the AES is a valid and reliable instrument for measuring patients’ expectancies regarding acupuncture treatment in the Korean population.

scholarly journals Reliability of a Brief Intercept Survey for Trail Use Behaviors

2009 ◽  
Vol 6 (6) ◽  
pp. 775-780 ◽  
Author(s):  
Philip J. Troped ◽  
Heather A. Whitcomb ◽  
Brent Hutto ◽  
Julian A. Reed ◽  
Steven P. Hooker
Keyword(s):  
Rank Correlation ◽  
Correlation Coefficients ◽  
Spearman Rank Correlation ◽  
Current Form ◽  
Retest Reliability ◽  
Spearman Rank ◽  
Trail Use ◽  
Percent Agreement ◽  
Intercept Survey ◽  
Test Retest Reliability

Purpose:This study assessed test-retest reliability of an interviewer-administered trail survey.Methods:An intercept survey was conducted with adults using 2 paved trails in Indiana and South Carolina (N = 295; mean age = 46.9 ± 18 y). The survey included items on frequency and duration of trail use for recreation and transportation, other patterns of trail use, and sociodemographic characteristics. Fifty-five adults completed the survey twice (2−16 d apart; mean = 7.4 ± 2.6 d). Test-retest reliability was assessed with Spearman rank correlation coefficients, Kappa coefficients, and percent agreement.Results:Kappa coefficients and percent agreement for 9 categorical items ranged from 0.65 to 0.96 and from 64.0% to 98.2%, respectively. Among these items, the lowest Kappas were found for perceived safety (0.65) and reported duration of visits for recreational purposes (0.67). Spearman rank correlation coefficients for travel distance to and on the trail and frequency of trail use during the past 7 days and past 4 weeks ranged from 0.62 to 0.93.Conclusion:Though further assessments of this survey with different populations and types of trails may be warranted, its overall high reliability indicates it can be used by researchers and practitioners in its current form.

Test-Retest Reliability of the Relative Work Centrality Measure

2005 ◽  
Vol 97 (2) ◽  
pp. 559-562 ◽  
Author(s):  
Raphael Snir ◽  
Itzhak Harpaz
Keyword(s):  
Rank Correlation ◽  
Correlation Coefficients ◽  
Full Time ◽  
Major Life ◽  
Convenience Sample ◽  
Work Centrality ◽  
Retest Reliability ◽  
Centrality Measure ◽  
International Research Team ◽  
Test Retest Reliability

The Meaning of Work International Research Team in 1987 developed the Relative Work Centrality measure, on which individuals divide 100 points among five major domains (work, leisure, community, religion, and family) in their lives, based on their relative centrality. The present study examined the test-retest reliability of this measure in a convenience sample of 96 Israeli full-time workers over a 4-wk. period. The sample consisted of 41.7% men and 58.3% women, of whom 48.9% were married. The participants had a mean age of 36.0 yr. ( SD = 11.5) and a mean education of 14.9 yr. ( SD = 2.5). The Spearman rank correlation coefficients for work, leisure, community, religion, and family at Time 1 and Time 2 were, respectively, .66, .76, .64, .76, and .82. These values indicate a fairly high test-retest reliability of the Relative Work Centrality measure and support the notion that this measure can also be applied to assess the relative centrality of each of the other four major life domains, in addition to work.

scholarly journals Standing balance assessment using a head-mounted wearable device

2017 ◽  
Author(s):  
Joseph P. Salisbury ◽  
Neha U. Keshav ◽  
Anthony D. Sossong ◽  
Ned T. Sahin
Keyword(s):  
Low Cost ◽  
Rank Correlation ◽  
Standing Balance ◽  
Healthy Population ◽  
Balance Assessment ◽  
Google Glass ◽  
Retest Reliability ◽  
Spearman’S Rank Correlation ◽  
Spearman’S Rank Correlation Coefficient ◽  
Test Retest Reliability

AbstractBackground: The presence of accelerometers in smartphones has enabled low-cost balance assessment. Smartglasses, which contain an accelerometer similar to that of smartphones, could provide a safe and engaging platform for virtual and augmented reality balance rehabilitation; however, the validity of head-mounted measurement of balance using smartglasses has not been investigated.Objective: To perform preliminary validation of a smartglasses-based balance accelerometry measure (BAM) compared with previously validated waist-based BAM.Methods: 42 healthy individuals (26 male, 16 female; mean age ± SD = 23.8 ± 5.2 years) participated in the study. Following the BAM protocol, each subject performed two trials of six balance stances while accelerometer and gyroscope data were recorded from smartglasses (Google Glass). Test-retest reliability and correlation were determined relative to waist-based BAM as used in the NIH Standing Balance Toolbox.Results: Balance measurements obtained using a head-mounted wearable were highly correlated with those obtained through a waist-mounted accelerometer (Spearman’s rank correlation coefficient = 0.85). Test-retest reliability was high (ICC = 0.85, 95% CI 0.81-0.88), and in good agreement with waist balance measurements (ICC = 0.84, 95% CI 0.80-0.88). Taking into account the total NPL magnitude improved inter-device correlation (0.90) while maintaining test-retest reliability (0.87, 95% CI 0.83-0.90). All subjects successfully completed the study, demonstrating the feasibility of using a head-mounted wearable to assess balance in a healthy population.Conclusion: Balance measurements derived from the smartglasses-based accelerometer were consistent with those obtained using a waist-mounted accelerometer. Given this and the potential for smartglasses in vestibular rehabilitation, the continued development and validation of balance assessment measurements obtained via smartglasses is warranted. This research was funded in part by Department of Defense/Defense Health Program (#W81XWH-14-C-0007, SBIR Phase II contract awarded to TIAX, LLC).

scholarly journals Psychometric Properties of Instrumented Postural Sway Measures Recorded in Community Settings in Independent Living Older Adults

2019 ◽  
Author(s):  
Bader Alqahtani ◽  
Patrick J. Sparto ◽  
Susan L. Whitney ◽  
Susan L. Greenspan ◽  
Subashan Perera ◽  
...  
Keyword(s):  
Older Adults ◽  
Independent Living ◽  
Convergent Validity ◽  
Postural Sway ◽  
Rank Correlation ◽  
Standing Balance ◽  
Community Settings ◽  
Balance Performance ◽  
Retest Reliability ◽  
Test Retest Reliability

Abstract Background: In the last few decades, research related to balance in older adults has been conducted in lab-based settings. The lack of portability and high cost that is associated with the current gold standard methods to quantify body balance, limits their application to community settings such as independent living facilities. The purpose of the study was to examine the test-retest reliability and the convergent validity of static standing balance performance using an accelerometer device. Methods: A total of 131 subjects (85% female, mean age 80 ± 8 years) were included for the validity aim, and a sample of 38 subjects were enrolled in the reliability testing (89% female, mean age 76 ± 7 years). Acceleration data in the anterior-posterior and medial-lateral directions was collected for different standing balance conditions. Test-retest reliability was assessed over two testing visits occurring one week apart. Spearman’s rank correlation coefficient was used to test convergent validity at baseline. Results: Balance measurements showed good to excellent reliability in most of measured parameters and were correlated with mobility measurements. Conclusions: Using a portable accelerometer to quantify static standing postural control provides reliable measurements in community settings.

scholarly journals Monitoring Hearing in an Infectious Disease Clinic with mHealth Technologies

2019 ◽  
Vol 30 (06) ◽  
pp. 482-492 ◽  
Author(s):  
Marize Brittz ◽  
Barbara Heinze ◽  
Faheema Mahomed-Asmail ◽  
De Wet Swanepoel ◽  
Anton Stoltz
Keyword(s):  
Infectious Disease ◽  
Hearing Loss ◽  
Rank Correlation ◽  
Pure Tone Audiometry ◽  
Smartphone Applications ◽  
Retest Reliability ◽  
Health Technologies ◽  
Clinic Setting ◽  
Significant Difference ◽  
Test Retest Reliability

AbstractDecentralized detection and monitoring of hearing loss can be supported by new mobile health technologies using automated testing that can be facilitated by minimally trained persons. These may prove particularly useful in an infectious disease (ID) clinic setting where the risk of hearing loss is high.To evaluate the clinical utility of mobile and automated audiometry hearing health technology in an ID clinic setting.Smartphone-automated pure-tone audiometry (PTA) (hearTest™) and speech-in-noise testing (SA English digits-in-noise [DIN] test) were compared with manual audiometry (2, 4, and 8 kHz). Smartphone-automated PTA and the DIN test were repeated to determine the test–retest reliability.Two hundred subjects (73% female and 27% male) were enrolled. Fifty participants were retested with the smartphone applications. Participants ranged from an age of 18 to 55 years with a mean age of 44.4 (8.7 standard deviation).Threshold comparisons were made between smartphone audiometry testing and manual audiometry. Smartphone-automated PTA, manual audiometry, and test–retest measures were compared (Wilcoxon signed ranked test). Spearman rank correlation test was used to determine the relationship between the smartphone applications and manual audiometry, as well as for test–retest reliability.Within all participants, 88.2% of thresholds corresponded within 10 dB or less between smartphone audiometry and manual audiometry. There was a significant difference (p < 0.05) between the right ear at 4 and 8 kHz and in the left ear at 2 and 4 kHz between smartphone and manual audiometry, respectively. No significant difference was noted (p < 0.05) between test and retest measures of smartphone technology.Smartphone audiometry with calibrated headphones provides reliable results in an ID clinic setting and can be used as a baseline and monitoring tool at ID clinics.

scholarly journals Human-Animal Interactions in Dairy Buffalo Farms

Animals ◽  
2019 ◽  
Vol 9 (5) ◽  
pp. 246 ◽  
Author(s):  
Fabio Napolitano ◽  
Francesco Serrapica ◽  
Ada Braghieri ◽  
Felicia Masucci ◽  
Emilio Sabia ◽  
...  
Keyword(s):  
Rank Correlation ◽  
Correlation Coefficients ◽  
Positive Interactions ◽  
Spearman Rank Correlation ◽  
Retest Reliability ◽  
Test Retest Reliability ◽  
High Degree ◽  
The Relationship ◽  
Dairy Buffalo

This study aimed to assess the relationship between stockperson behavior and buffalo behavior. The research was carried out in 27 buffalo farms. The behavior of stockpeople and animals during milking and the avoidance distance at the feeding place were recorded. Recordings were repeated within one month to assess test-retest reliability. A high degree of test-retest reliability was observed for all the variables with Spearman rank correlation coefficients (rs) ranging from 0.578 (p = 0.002, df = 25) for the number of kicks performed during milking to 0.937 (p < 0.001, df = 25) for the percentage of animals moving when approached by ≤ 0.5 m. The number of negative stockperson interactions correlated positively with the number of kicks during milking (rs = 0.421, p < 0.028, df = 25) and the percentage of animals injected with oxytocin (rs = 0.424, p < 0.027), whereas the percentage of negative stockperson interactions correlated positively with the percentage of buffaloes moving when approached at a distance >1 m (rs = 0.415, p < 0.031, df = 25). In a subsample of 14 farms, milk yield was correlated positively with the number of positive interactions (rs = 0.588, p < 0.027, df = 12) and correlated negatively with the number of steps performed by the animals during milking (rs = −0.820, p < 0.001, df = 12). This study showed that the quality of stockpeople interactions may affect buffalo behavior and production.

Development and Validation of Yin-Deficiency Questionnaire

2007 ◽  
Vol 35 (01) ◽  
pp. 11-20 ◽  
Author(s):  
Sangjae Lee ◽  
Jongbae Park ◽  
Hyangsook Lee ◽  
Kwangho Kim
Keyword(s):  
Healthy Volunteers ◽  
Internal Consistency ◽  
Discriminant Validity ◽  
Rank Correlation ◽  
Deficiency Syndrome ◽  
Retest Reliability ◽  
Yin Deficiency ◽  
Spearman’S Rank Correlation ◽  
Test Retest Reliability ◽  
Development And Validation

This study describes development and validation of a questionnaire as an adjunct to Traditional Chinese Medicine diagnosis of Yin-Deficiency Syndrome (Yin-DS). The Yin-Deficiency Questionnaire 1 (Yin-DQ1) consists of 10 items. Seventy-nine healthy volunteers and 44 patients diagnosed with Yin-DS were enrolled for the evaluation of discriminant validity and factorial validity. Another group of 83 healthy volunteers participated for test-retest reliability test. Internal consistency was high in both groups (Cronbach's α = 0.8615). Test-retest reliability (Spearman's rank correlation coefficient) ranged from 0.54 to 0.79 ( p < 0.01). Factor analysis demonstrated that a two factor solution best explained the variance in responses (51.62%). The scores of all items in patients diagnosed with Yin-DS were significantly higher compared with those of healthy volunteers. The data show the internal consistency, test-retest reliability and strong discriminative properties of the Yin-DQ1. Further research determining the optimal cut-off score for Yin-DS and testing its usage as an outcome measure in a clinical trial is needed.

scholarly journals Validity, Reliability and Responsiveness of the Thai Version of Patient-Rated Wrist Evaluation (Th-PRWE) in Distal Radius Fracture Patients

2021 ◽  
Vol 73 (4) ◽  
pp. 275-281
Author(s):  
Panai Laohaprasitiporn ◽  
Yuwarat Monteerarat ◽  
Withawat Jaderojananont ◽  
Roongsak Limthongthang ◽  
Torpon Vathana
Keyword(s):  
Distal Radius Fracture ◽  
Distal Radius ◽  
Internal Consistency ◽  
Plate Fixation ◽  
Intraclass Correlation ◽  
Rank Correlation ◽  
Radius Fracture ◽  
Retest Reliability ◽  
Thai Language ◽  
Test Retest Reliability

Objective: Patient-Rated Wrist Evaluation (PRWE) is a specific tool for the assessment of wrist function and has been validated and translated into many languages. This study aimed to translate the PRWE into the Thai language and to evaluate its validity, reliability, and responsiveness in operatively treated distal radius fracture patients.Materials and Methods: PRWE was translated into the Thai language according to a linguistic validation protocol by a forward–backward translation process. In total, 53 distal radius fracture patients who underwent volar locking plate fixation were included in the present study. However, 8 patients were excluded due to multiple injuries, leaving 45 patients who were prospectively enrolled and evaluated with the Thai version of the PRWE (Th-PRWE) and Disabilities of the Arm, Shoulder, and Hand (DASH) questionnaire within 2 weeks of their surgery. Reliability of the Th-PRWE was assessed by the test–retest reliability and internal consistency. The content, concurrent, and criterion validity of the Th-PRWE were measured. At 3 months after the operation, patients were re-assessed with Th-PRWE and DASH. The standardized response mean (SRM) and effect size (ES) were assessed to identify the responsiveness to a change of the tool.Results: Most of the patients were female (64%) with average age of 55 years old and had sustained distal radius fractures. The intraclass correlation for the test–retest reliability of the Th-PRWE was 0.9. The internal consistency of the Th-PRWE was acceptable (Cronbach’s alpha = 0.93). Th-PRWE had a high content validity (Item-objective congruence index = 0.8) and excellent correlation with DASH (Spearman’s rank correlation = 0.81; p < 0.001). Its responsiveness was also considered excellent (SRM = 1.12, ES = 1.28).Conclusion: Th-PRWE is valid, reliable, and responsive for the evaluation of distal radius fracture patients.

Sign in / Sign up

Export Citation Format

Share Document