scholarly journals Validation of a Low-Cost Electrocardiography (ECG) System for Psychophysiological Research

Sensors ◽  
2021 ◽  
Vol 21 (13) ◽  
pp. 4485
Author(s):  
Ruth Erna Wagner ◽  
Hugo Plácido da Silva ◽  
Klaus Gramann

Background and Objective: The reliability of low-cost mobile systems for recording Electrocardiographic (ECG) data is mostly unknown, posing questions regarding the quality of the recorded data and the validity of the extracted physiological parameters. The present study compared the BITalino toolkit with an established medical-grade ECG system (BrainAmp-ExG). Methods: Participants underwent simultaneous ECG recordings with the two instruments while watching pleasant and unpleasant pictures of the “International Affective Picture System” (IAPS). Common ECG parameters were extracted and compared between the two systems. The Intraclass Correlation Coefficients (ICCs) and the Bland–Altman Limits of Agreement (LoA) method served as criteria for measurement agreement. Results: All but one parameter showed an excellent agreement (>80%) between both devices in the ICC analysis. No criteria for Bland–Altman LoA and bias were found in the literature regarding ECG parameters. Conclusion: The results of the ICC and Bland–Altman methods demonstrate that the BITalino system can be considered as an equivalent recording device for stationary ECG recordings in psychophysiological experiments.

2019 ◽  
Vol 9 (1) ◽  
pp. 1-8 ◽  
Author(s):  
Dwi Haryo Ismunarti ◽  
Muhammad Zainuri ◽  
Denny Nugroho Sugianto ◽  
Suradi Widjaya Saputra

Instrumen penelitian adalah alat ukur yang digunakan secara sistematis untuk mengumpulkan data penelitian. Hasil penelitian yang baik diperoleh jika instrumen yang digunakan valid dan reliabel. Reliabilitas instrumen menunjukkan ketepatan atau sejauh mana hasil pengukuran instrumen dapat direplikasi. Reliabilitas menjadi salah satu parameter penting dalam menentukan kualitas suatu instrumen. Penelitian ini bertujuan untuk memilih statistik uji yang paling tepat terhadap pengujian reliabilitas terhadap instrumen untuk konsentrasi klorofil-a perairan. Data konsentrasi klorofil-a perairan diperoleh dari dua instrumen yaitu : metode spektrofotometri dari 14 stasiun pengamatan di Teluk Semarang Jawa Tengah dan penginderaan jauh. Statistik uji yang paling tepat digunakan adalah Intraclass Correlation Coefficients (ICC). Nilai  ICC adalah rasio antara varians objek terhadap varians total. Hasil penelitian diperoleh nilai ICC = 0,83 artinya 83 % keragaman data disebabkan keragaman objek dalam hal ini stasiun penelitian. Tidak terdapat bias pengukuran konsentrasi klorofil-a dari kedua instrumen, karena reliabilitas kedua instrumen mendekati sempurna. A research instrument is a measuring tool used systematically to collect the data. A good result of the research is obtained if the instrument is reliable. The reliability of the instrument showed accuracy on instrument measurement could be replicated. Reliability is one of the important parameters in determining the quality of the device. This study is aimed at selecting the most appropriate test of statistics in the reliability of the instrument for chlorophyll-a water concentrations. The data of chlorophyll-a waters concentration is gained from two instruments called spectrophotometric method from 14 observation stations in Semarang Bay, Central Java, and remote sensing. The best test statistic is the Intraclass Correlation Coefficients (ICC). The value on ICC is the ratio between the variance of the object at total variance. The results showed that ICC = 0.83, meaning that 83% of a variety of data is due to the diversity of objects in these research stations. There is no bias in measuring the chlorofil-a concentration using the two instruments because the reliability of the two devices is closely perfect.


2016 ◽  
Vol 2016 ◽  
pp. 1-6 ◽  
Author(s):  
Kofi Asiedu ◽  
Samuel Kyei ◽  
Emmanuel Ekow Ampiah

The aim of the study was to determine the level of agreement between Javal’s rule, autorefraction, retinoscopy, and refractive astigmatism and to determine which technique is the most suitable substitute when subjective refraction is not applicable using a clinical sample. A total of 36 subjects, 14 males and 22 females, were involved in this study. The intraclass correlation coefficients between subjective refraction, autorefraction, and retinoscopy were 0.895 and 0.989, respectively, for the spherical equivalent. The Bland-Altman 95% limits of agreement between subjective refraction and autorefraction; subjective refraction and retinoscopy; and autorefraction and retinoscopy were −2.84 to 3.58, −0.88 to 1.12, and −3.01 to 3.53, respectively, for the spherical equivalent. The intraclass correlation coefficients between spectacle total astigmatism and the following techniques were as follows: retinoscopy (0.85); autorefraction (0.92); Javal’s rule (0.82); and Grosvenor et al. version (0.85). The Bland-Altman 95% limits of agreement between subjective refraction and autorefraction; subjective refraction and retinoscopy; subjective refraction and Javal’s rule; and subjective refraction and Grosvenor et al. version were −0.87 to 1.25, −1.49 to 1.99, −0.73 to 1.93, and −0.89 to 1.7, respectively, for the total astigmatism. The study showed that autorefraction and Javal’s rule may provide a starting point for subjective refraction cylinder power determination but only retinoscopy may satisfactorily replace subjective refraction total astigmatism when subjective refraction is not applicable.


2020 ◽  
Vol 4 (Supplement_1) ◽  
pp. 262-262
Author(s):  
Mariko Sakka ◽  
Ayumi Igarashi ◽  
Chie Fukui ◽  
Maiko Noguchi-Watanabe ◽  
Asa Inagaki ◽  
...  

Abstract While quality of life (QOL) is an important endpoint of homecare for persons with dementia (PWD), PWDs often have difficulty in articulating their QOL by themselves. Instead proxy-rating is often used. However, evidence is still scarce regarding to what extent proxy-ratings reflect actual QOL of PWDs. We examined the association between self-report QOL by PWDs and proxy-rated QOL. We conducted a questionnaire survey to PWDs who were 75 years and older, their family, and homecare nurse in charge of the PWD. Two measures were used: 1) a newly developed, 4-item self-report for QOL of PWDs, and 2) a standardized, 6-item proxy-rating dementia QOL scale. In the self-report, the PWD were asked about their daily mood or satisfaction in life in brief, easy-to-understand sentences. The self-reports and proxy-ratings were compared using intraclass correlation coefficients (ICC). Data from 382 PWDs, 248 family caregivers and 124 nurses were used. The mean age of PWD was 85.9 years and 60.5% were female. The proxy-rating by nurses were more strongly associated with self-reports, compared to the association between family proxy rating and self-reports (r = 0.351, p < .001; r = 0.236, p < .001, respectively). Proxy ratings by spouses and biological children were significantly associated with self-report (r = 0.257, p =.004; r =. 204, p = .006, respectively), while rating by children-in-law were not (r = 0.217, p = .160). Proxy-ratings may not be an appropriate substitute for self-report. Homecare nurses may evaluate the QOL of PWD better than their family caregiver.


2020 ◽  
Vol 6 (1) ◽  
pp. 00289-2019
Author(s):  
Rishi J. Khusial ◽  
Persijn J. Honkoop ◽  
Victor van der Meer ◽  
Jiska B. Snoeck-Stroband ◽  
Jacob K. Sont

ObjectiveSeveral newly developed eHealth applications use online questionnaires to monitor asthma control. The Asthma Control Questionnaire (ACQ) and Asthma Quality of Life Questionnaire (AQLQ) are two such commonly used questionnaires. These questionnaires are validated for use on paper. This study aims to validate them by assessing the agreement between online and paper versions of the ACQ and AQLQ.MethodsPatients (aged 18 years and older) from the Self-Management in Asthma Supported by Hospitals, ICT, Nurses and General Practitioners (SMASHING)-trial and Davos@home study were included in this study. Patients completed both the paper and online Dutch versions of the ACQ and AQLQ in a random order within a 2-week interval. Agreement between the different versions was assessed with paired t-tests, intraclass correlation coefficients and Bland–Altman plots.ResultsIn total 44 patients were eligible for analysis. The mean difference between the paper and online versions of the ACQ was 0.04 (p=0.40) and for the AQLQ it was 0.08 (p=0.06). The intraclass correlation coefficient scores were 0.94 for the ACQ and 0.95 for the AQLQ.ConclusionThe online versions of the ACQ and AQLQ show high levels of agreement with the paper versions and can therefore be safely used in eHealth applications to respectively monitor asthma control and quality of life.


PLoS ONE ◽  
2020 ◽  
Vol 15 (12) ◽  
pp. e0244016
Author(s):  
Kris Saudek ◽  
Robert Treat ◽  
Amanda Rogers ◽  
Danita Hahn ◽  
Sara Lauck ◽  
...  

Objective Based on a national survey of program directors we developed a letter of recommendation (LOR) scoring rubric (SR) to assess LORs submitted to a pediatric residency program. The objective was to use the SR to analyze: the consistency of LOR ratings across raters and LOR components that contributed to impression of the LOR and candidate. Methods We graded 30 LORs submitted to a pediatric residency program that were evenly distributed based on final rank by our program. The SR contained 3 sections (letter features, phrases, and applicant abilities) and 2 questions about the quality of the LOR (LORQ) and impression of the candidate (IC) after reading the LOR on a 5-point Likert scale. Inter-rater reliability was calculated with intraclass correlation coefficients (ICC(2,1)). Pearson (r) correlations and stepwise multivariate linear regression modeling predicted LORQ and IC. Mean scores of phrases, features, and applicant abilities were analyzed with ANOVA and Bonferroni correction. Results Phrases (ICC(2,1) = 0.82, p<0.001)) and features (ICC(2,1) = 0.60, p<0.001)) were rated consistently, while applicant abilities were not (ICC(2,1) = 0.28, p<0.001)). For features, LORQ (R2 = 0.75, p<0.001) and IC (R2 = 0.58, p<0.001) were best predicated by: writing about candidates’ abilities, strength of recommendation, and depth of interaction with the applicant. For abilities, LORQ (R2 = 0.47, p<0.001) and IC (R2 = 0.51, p<0.001) were best predicted by: clinical reasoning, leadership, and communication skills (0.2). There were significant differences for phrases and features (p<0.05). Conclusions The SR was consistent across raters and correlates with impression of LORQ and IC. This rubric has potential as a faculty development tool for writing LORS.


2020 ◽  
Vol 29 (8) ◽  
pp. 1218-1221
Author(s):  
Matheus Lima Oliveira ◽  
Isabela Christina Ferreira ◽  
Kariny Realino Ferreira ◽  
Gabriela Silveira-Nunes ◽  
Michelle Almeida Barbosa ◽  
...  

Context: Strength assessment is essential to prescribe exercise in sports and rehabilitation. Low-cost valid equipment may allow continuous monitoring of training. Objective: To examine the validity of a very low-cost hanging scale by comparing differences in the measures of peak force to a laboratory grade load cell during shoulder abduction, flexion, extension, and internal and external rotations. Design: Analytical study. Participants: Thirty-two healthy subjects (18 women, age 26 [10] y, height 172 [8] cm, mass 69 [13] kg, body mass index 23 [4] kg/m2). Main Outcome Measures: The dependent variable was the maximal peak force (in kilogram-force). The independent variable was the instrument (laboratory grade load cell and hanging scale). Results: No differences were observed while comparing the results. The intraclass correlation coefficients1,1 ranged from .96 to .99, showing excellent results. The Cronbach alpha test also returned >.99 for all comparisons. The SEM ranged from 0.02 to 0.04 kgf, with an averaged SD from 0.24 to 0.38 kgf. The correlation was classified as high for all tested movements (r > .99; P < .001), with excellent adjusted coefficients of determination (.96 < r2 < .99). Bland–Altman results showed high levels of agreement with bias ranging from 0.27 to 0.48. Conclusions: Hanging scale provides valid measures of isometric strength with similar output measures as laboratory grade load cell.


Author(s):  
Michael J. Duncan ◽  
Darren Richardson ◽  
Rhys Morris ◽  
Emma Eyre ◽  
Neil D. Clarke

The present study examined the test–retest reliability of the Ghent University dribbling test and short dribble test in a pediatric population. Fifty-four boys aged 9–14 years (mean ± SD = 11 ± 2 years) undertook the Ghent University and dribbling tests on two occasions separated by 2 weeks. Intraclass correlation coefficients, coefficient of variation, and 95% limits of agreement were conducted for each test. Intraclass correlation coefficients and coefficient of variation indicated good to excellent reliability, and relatively small variability for both dribbling tests. The 95% limits of agreement indicated relatively little bias Ghent University dribbling test for both running alone and running with the ball components, and the Bangsbo and Mohr short dribble test. The results of the present study suggest both dribbling tests examined in the present study demonstrate good reliability and low levels of systematic bias.


2003 ◽  
Vol 96 (3_suppl) ◽  
pp. 1071-1085 ◽  
Author(s):  
Yoshinori Nagasawa ◽  
Shinichi Demura ◽  
Masakatsu Nakada

The purpose was to examine trial-to-trial and day-to-day reliability and sensitivity for measurements of the ability to coordinate exertion of force based on target-pursuit, 30 college students were required to match their grip strength to a changing demand value appearing on the display of a personal computer, using two visual images in the form of a bar chart and waveform. The variable was the sum of the differences between demanded and produced grip strength over time. Analysis indicated high intraclass correlation coefficients (ICC) for bar chart and waveform displays (ICC = .87, ICC = .95, respectively). The limits of agreement, designating the interval comprising 95% of the differences between three measurements in a stable individual, were −14.8 to 99.3% for the bar chart and −3.5 to 113.6% for the waveform displays. One-tailed, paired t tests of the day-to-day measurements showed significant ( p < .05) improvement in both the bar chart and waveform displays. ICCs for day-to-day measurements were low-to-moderate for bar chart and waveform displays (ICC = .33 to .71, ICC = .48 to .76, respectively). The limits of agreement between measurements of two trials for day-to-day measurements were −112.2 to 218.6% for the bar chart and −139.2 to 352.8% for the waveform displays. The repeatability coefficients of trial-to-trial and day-to-day measurements for bar chart and waveform displays were 141 and 173%, and 152 and 176%, respectively. The limits of agreement between each test were relatively wide. We believe that these tests, on which the force response is visually guided, can be useful in objectively documenting the ability to coordinate exertion of force.


2011 ◽  
Vol 101 (5) ◽  
pp. 424-429
Author(s):  
Keith Rome ◽  
David George Survepalli ◽  
Maria Lobo ◽  
Nicola Dalbeth ◽  
Fiona McQueen ◽  
...  

Background: Plantar pressure measurements are commonly used to evaluate foot function in chronic musculoskeletal conditions. However, manually identifying anatomical landmarks is a source of measurement error and can produce unreliable data. The aim of this study was to evaluate intratester reliability associated with manual masking of plantar pressure measurements in patients with gout. Methods: Twenty-five patients with chronic gout (mean disease duration, 22 years) were recruited from rheumatology outpatient clinics. Patients were excluded if they were experiencing an acute gout flare at the time of assessment, had lower-limb amputation, or had diabetes mellitus. Manual masking of peak plantar pressures and pressure-time integrals under ten regions of the foot were undertaken on two occasions on the same day using an in-shoe pressure measurement system. Test-retest reliability was assessed by using intraclass correlation coefficients, SEM, 95% limits of agreement, and minimal detectable change. Results: Mean peak pressure intraclass correlation coefficients ranged from 0.92 to 0.97, with SEM of 8% to 14%. The 95% limits of agreement ranged from−150.3 to 133.5 kPa, and the minimal detectable change ranged from 30.8 to 80.6 kPa. For pressure-time integrals, intraclass correlation coefficients were 0.86 to 0.94, and SEM were 5% to 29%, with the greater errors observed under the toes. The 95% limits of agreement ranged from −48.5 to 48.8 kPa/sec, and the minimal detectable change ranged from 6.8 to 21.0 kPa/sec. Conclusions: These findings provide clinicians with information confirming the errors associated with manual masking of plantar pressure measurements in patients with gout. (J Am Podiatr Med Assoc 101(5): 424–429, 2011)


Diagnostics ◽  
2021 ◽  
Vol 11 (11) ◽  
pp. 2134
Author(s):  
Jörg Philipps ◽  
Hannah Mork ◽  
Maria Katz ◽  
Mark Knaup ◽  
Kira Beyer ◽  
...  

Currently, there is no standardized method to evaluate operator reliability in nerve ultrasound. A short prospective protocol using Bland–Altman analysis was developed to assess the level of agreement between operators with different expertise levels. A control rater without experience in nerve ultrasound, three novices after two months of training, an experienced rater with two years of experience, and a reference rater performed blinded ultrasound examinations of the left median and ulnar nerve in 42 nerve sites in healthy volunteers. The precision of Bland–Altman agreement analysis was tested using the Preiss–Fisher procedure. Intraclass correlation coefficients (ICC), coefficients of variation, and Bland–Altman limits of agreement were calculated. The sample size calculation and Preiss–Fisher procedure showed a sufficient precision of Bland–Altman agreement analysis. Limits of agreement of all trained novices ranged from 2.0 to 2.9 mm2 and were within the test’s maximum tolerated difference. Ninety-five percent confidence intervals of limits of agreement revealed a higher precision in the experienced rater’s measurements. Operator reliability in nerve ultrasound of the median and ulnar nerve arm nerves can be evaluated with a short prospective controlled protocol using Bland–Altman statistics, allowing a clear distinction between an untrained rater, trained novices after two months of training, and an experienced rater.


Sign in / Sign up

Export Citation Format

Share Document