scholarly journals Test-Retest Reliability of Ecological Momentary Assessment in Audiology Research

2020 ◽  
Vol 31 (08) ◽  
pp. 599-612
Author(s):  
Yu-Hsiang Wu ◽  
Elizabeth Stangl ◽  
Octav Chipara ◽  
Xuyang Zhang

Abstract Background Ecological momentary assessment (EMA) is a methodology involving repeated surveys to collect in situ data that describe respondents' current or recent experiences and related contexts in their natural environments. Audiology literature investigating the test-retest reliability of EMA is scarce. Purpose This article examines the test-retest reliability of EMA in measuring the characteristics of listening contexts and listening experiences. Research Design An observational study. Study Sample Fifty-one older adults with hearing loss. Data Collection and Analysis The study was part of a larger study that examined the effect of hearing aid technologies. The larger study had four trial conditions and outcome was measured using a smartphone-based EMA system. After completing the four trial conditions, participants repeated one of the conditions to examine the EMA test-retest reliability. The EMA surveys contained questions that assessed listening context characteristics including talker familiarity, talker location, and noise location, as well as listening experiences including speech understanding, listening effort, loudness satisfaction, and hearing aid satisfaction. The data from multiple EMA surveys collected by each participant were aggregated in each of the test and retest conditions. Test-retest correlation on the aggregated data was then calculated for each EMA survey question to determine the reliability of EMA. Results At the group level, listening context characteristics and listening experience did not change between the test and retest conditions. The test-retest correlation varied across the EMA questions, with the highest being the questions that assessed talker location (median r = 1.0), reverberation (r = 0.89), and speech understanding (r = 0.85), and the lowest being the items that quantified noise location (median r = 0.63), talker familiarity (r = 0.46), listening effort (r = 0.61), loudness satisfaction (r = 0.60), and hearing aid satisfaction (r = 0.61). Conclusion Several EMA questions yielded appropriate test-retest reliability results. The lower test-retest correlations for some EMA survey questions were likely due to fewer surveys completed by participants and poorly designed questions. Therefore, the present study stresses the importance of using validated questions in EMA. With sufficient numbers of surveys completed by respondents and with appropriately designed survey questions, EMA could have reasonable test-retest reliability in audiology research.

Author(s):  
Eric Granholm ◽  
Jason L Holden ◽  
Tanya Mikhael ◽  
Peter C Link ◽  
Joel Swendsen ◽  
...  

Abstract Schizophrenia is a major cause of disability worldwide. As new treatments for functioning are tested, the need grows to demonstrate real-world functioning gains. Ecological momentary assessment (EMA) may provide a more ecologically valid measure of functioning. In this study, smartphone-based EMA was used to signal participants with schizophrenia (N = 100) and controls (N = 71) 7 times a day for 7 days to respond to brief questionnaires about social interactions and functioning behaviors. Excellent adherence was found, with both groups completing an average of 85% of surveys and only 3% of participants with schizophrenia excluded for poor adherence. Four-week test–retest reliability was high (r = .83 for total productive behaviors). Relative to controls, participants with schizophrenia reported significantly less total productive activity (d = 1.2), fewer social interactions (d = 0.3), more nonproductive behaviors (d = 1.0; watching TV, resting), and more time at home (d = 0.8). Within the schizophrenia group, participants living independently showed better functioning on EMA relative to participants in supported housing (d = 0.8) and participants engaged in vocational activities showed better functioning than individuals not engaged in vocational activities (d = 0.55). Modest correlations were found between EMA and an in-lab self-report measure of functioning activities performed in the community, but not between EMA and measures of functional capacity or potential. This study demonstrated the feasibility, sensitivity reliability, and validity of EMA methods to assess functioning in schizophrenia. EMA provides a much-needed measure of what individuals with schizophrenia are actually doing in real-world contexts. These results also suggest that there may be important disjunctions between indices of abilities and actual real-world functioning.


2021 ◽  
Vol 25 ◽  
pp. 233121652199028
Author(s):  
Petra von Gablenz ◽  
Ulrik Kowalk ◽  
Jörg Bitzer ◽  
Markus Meis ◽  
Inga Holube

Ecological momentary assessment (EMA) was used in 24 adults with mild-to-moderate hearing loss who were seeking first hearing-aid (HA) fitting or HA renewal. At two stages in the aural rehabilitation process, just before HA fitting and after an average 3-month HA adjustment period, the participants used a smartphone-based EMA system for 3 to 4 days. A questionnaire app allowed for the description of the environmental context as well as assessments of various hearing-related dimensions and of well-being. In total, 2,042 surveys were collected. The main objectives of the analysis were threefold: First, describing the “auditory reality” of future and experienced HA users; second, examining the effects of HA fitting for individual participants, as well as for the subgroup of first-time HA-users; and third, reviewing whether the EMA data collected in the unaided condition predicted who ultimately decided for or against permanent HA use. The participants reported hearing-related disabilities across the full range of daily listening tasks, but communication events took the largest share. The effect of the HA intervention was small in experienced HA users. Generally, much larger changes and larger interindividual differences were observed in first-time compared with experienced HA users in all hearing-related dimensions. Changes were not correlated with hearing loss or with the duration of the HA adjustment period. EMA data collected in the unaided condition did not predict the cancelation of HA fitting. The study showed that EMA is feasible in a general population of HA candidates for establishing individual and multidimensional profiles of real-life hearing experiences.


2012 ◽  
Vol 33 (4) ◽  
pp. 497-507 ◽  
Author(s):  
Gino Galvez ◽  
Mitchel B. Turbin ◽  
Emily J. Thielman ◽  
Joseph A. Istvan ◽  
Judy A. Andrews ◽  
...  

2013 ◽  
Vol 64 (4) ◽  
pp. 235-243 ◽  
Author(s):  
Sven Barnow ◽  
Maren Aldinger ◽  
Ines Ulrich ◽  
Malte Stopsack

Die Anzahl der Studien, die sich mit dem Zusammenhang zwischen Emotionsregulation (ER) und depressiven Störungen befassen, steigt. In diesem Review werden Studien zusammengefasst und metaanalytisch ausgewertet, die den Zusammenhang zwischen ER und Depression mittels Fragebögen bzw. Ecological Momentary Assessment (EMA) erfassen. Dabei zeigt sich ein ER-Profil welches durch die vermehrte Nutzung von Rumination, Suppression und Vermeidung bei gleichzeitig seltenerem Einsatz von Neubewertung und Problemlösen gekennzeichnet ist. Mit mittleren bis großen Effekten, ist der Zusammenhang zwischen Depression und maladaptiven Strategien besser belegt als bei den adaptiven Formen, wo die Effekte eher moderat ausfielen. EMA-Messungen bestätigen dieses Profil. Da EMA-Studien neben der Häufigkeit des Strategieeinsatzes auch die Erfassung anderer ER-Parameter wie Effektivität und Flexibilität ermöglichen, sollten solche Designs in der ER-Forschung zukünftig vermehrt Einsatz finden.


2013 ◽  
Vol 18 (1) ◽  
pp. 3-11 ◽  
Author(s):  
Emmanuel Kuntsche ◽  
Florian Labhart

Ecological Momentary Assessment (EMA) is a way of collecting data in people’s natural environments in real time and has become very popular in social and health sciences. The emergence of personal digital assistants has led to more complex and sophisticated EMA protocols but has also highlighted some important drawbacks. Modern cell phones combine the functionalities of advanced communication systems with those of a handheld computer and offer various additional features to capture and record sound, pictures, locations, and movements. Moreover, most people own a cell phone, are familiar with the different functions, and always carry it with them. This paper describes ways in which cell phones have been used for data collection purposes in the field of social sciences. This includes automated data capture techniques, for example, geolocation for the study of mobility patterns and the use of external sensors for remote health-monitoring research. The paper also describes cell phones as efficient and user-friendly tools for prompt manual data collection, that is, by asking participants to produce or to provide data. This can either be done by means of dedicated applications or by simply using the web browser. We conclude that cell phones offer a variety of advantages and have a great deal of potential for innovative research designs, suggesting they will be among the standard data collection devices for EMA in the coming years.


Sign in / Sign up

Export Citation Format

Share Document