scholarly journals Guidelines for Establishing Reliability when Coding Narrative Data

2017 ◽  
Author(s):  
Moin Syed ◽  
Sarah C. Nelson

The use of quantitative, qualitative, and mixed methods approaches has been foundational to research on emerging adulthood, yet there remain many unresolved methodological issues pertaining to how to handle qualitative data. The purpose of this article is to review best practices for coding and establishing reliability when working with narrative data. In doing so, we highlight how establishing reliability must be seen as an evolving process, rather than simply a focus on the end product. The review is divided into three broad sections. In the first section, we discuss relatively more quantitatively-focused methods of coding and establishing reliability, whereas in the second section we discuss relatively more qualitatively-focused methods. In the final section, we provide recommendations for researchers interested in coding narrative and other types of open-ended data. This article is intended to serve as an essential resource for researchers working on a variety of topics related to emerging adulthood and beyond.

2018 ◽  
Vol 68 (suppl 1) ◽  
pp. bjgp18X697349
Author(s):  
Anna Lalonde ◽  
Emma Teasdale ◽  
Ingrid Muller ◽  
Joanne Chalmers ◽  
Peter Smart ◽  
...  

BackgroundCellulitis is a common painful infection of the skin and underlying tissues that recurs in approximately a third of cases. Patients’ ability to recover from cellulitis or prevent recurrence is likely to be influenced by their understanding of the condition.AimTo explore patients’ perceptions of cellulitis and their information needs.MethodMixed methods study comprising semi-structured, face-to-face interviews and cross-sectional survey, recruiting through primary care, secondary care and advertising. Adults aged 18 or over with a history of cellulitis (first or recurrent) were invited to complete a survey, take part in an interview or both. Qualitative data was analysed thematically.ResultsThirty interviews were conducted between August 2016 and July 2017. Qualitative data revealed low prior awareness of cellulitis, uncertainty around diagnosis, concern/surprise at the severity of cellulitis, and perceived insufficient information provision. People were surprised they had never heard of the condition and that they had not received advice or leaflets giving self-care information. Some sought information from the internet and found this bewildering. Two hundred and forty surveys were completed (response rate 17%). These showed that, while most people received information on the treatment of cellulitis (60.0%, n = 144), they reported receiving no information about causes (60.8%, n = 146) or prevention of recurrence (73.3%, n = 176).ConclusionThere is a need for provision of basic information for people with cellulitis, particularly being informed of the name of their condition, how to manage acute episodes, and how to reduce risk of recurrence.


Author(s):  
Kriss Lange ◽  
Joshua Matthews

Abstract Japanese EFL learners’ difficulty with accurately decoding connected English speech motivated this mixed methods study. The aural decoding capacities of 63 first-year Japanese university students, with low to intermediate level English proficiency, were first measured with a battery of paused transcription tests (PTT). The transcriptions were clusters of three-words that each possessed attributes typical of co-articulated speech. In addition, after each test, a subgroup of 10 participants individually listened to the same PTT and recounted introspective self-observations of their perceived difficulties with the aural decoding tasks in their L1. These quantitative and qualitative data were used to identify four trends in decoding errors which were categorized as follows: limited collocation familiarity, syntactic knowledge constraints, difficulties utilizing co-text, and L1 phonological influence. This study investigates some of the difficulties associated with aural decoding, highlights the challenges of identifying the origins of decoding errors and suggests that more focus is needed on developing decoding skills as well as knowledge of formulaic language in L2 listening education.


2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Chandler Puhy ◽  
Nalini Prakash ◽  
Clarissa Lacson ◽  
Joke Bradt

Purpose Increased student diversity in universities across the USA has increased the need for post-secondary educators to develop multicultural teaching competence (MTC). Most studies of MTC focus on educators teaching grades K-12. The purpose of this study is to determine how faculty members rate themselves in terms of MTC, what multicultural knowledge and skills faculty report and how they integrate these skills into their teaching practice and what barriers exist to developing and implementing MTC. The purpose of this study was to examine the factors that impact undergraduate faculty integration of multicultural awareness and attitudes into their teaching practices to enhance student learning. Design/methodology/approach A convergent mixed methods study used survey and interview data from undergraduate faculty. Select items from the MTC Inventory (MTCI) and social justice scales (SJS) were administered. Interviews (N = 7) were transcribed and analyzed using thematic analysis. Quantitative and qualitative data were compared to examine convergence and divergence. Findings Quantitative results revealed undergraduate faculty’s awareness, knowledge and skills as indicated by percent agreement with items from the MTCI and SJS instruments. Qualitative findings included the following four themes: knowledge building, addressing diversity in the classroom, barriers and challenges, and needs and recommendations. Qualitative data corroborated or explained many of the quantitative results and provided insight into these trends and barriers that impact MTC. Originality/value This is the first study of its kind, to our knowledge, that has used a mixed methods research design to examine factors that impact MTCs and associated barriers among a sample of undergraduate faculty across disciplines in one urban university.


2021 ◽  
pp. 79-95
Author(s):  
A. N. Oleinik

The article discusses the status of quantitative and qualitative data in economic sciences, as well as methods for transforming data into information and knowledge. Particular attention is devoted to content analysis as a set of methods for aggregating, processing and analyzing qualitative data; its forms (qualitative, quantitative and mixed methods) and uses by economists. Content analysis appears to be particularly suitable for non-orthodox economists because of their refusal to consider price as the only source of economic information. The content analysis of metadata of articles indexed in Web of Science and eLibrary suggests that Russian economists still have insufficient familiarity with the principles of content analysis and their applications to research compared with their Western counterparts. It is argued that the creation of on-line platforms for content analysis and on-line banks of qualitative data may become a trigger for changing this situation.


2021 ◽  
Vol 25 (1) ◽  
pp. 48-70
Author(s):  
Dave Aftandilian

Abstract Although animals have served as subjects and objects of religion since the Paleolithic, they are often omitted from standard religious studies courses. In this article, I discuss some best practices for introducing students to the study of animals and religion. After outlining some of the benefits of teaching about animals and religion, I explain the pros and cons of the two main approaches: by tradition or by topic. The majority of the article discusses some of the most important topics to include, as well as how best to approach several of them in terms of pedagogy and media. The final section explains the importance of bringing real animals into courses like this, and offers a variety of experiential education techniques for doing so, including contemplative practices.


2021 ◽  
pp. 026010602110527
Author(s):  
Vera Salvo ◽  
Adriana Sanudo ◽  
Jean Kristeller ◽  
Mariana Cabral Schveitzer ◽  
Patricia Martins ◽  
...  

Background: Worldwide, approximately 95% of obese people who follow diets for weight loss fail to maintain their weight loss in the long term. To fill this gap, mindfulness-based interventions, with a focus on mindful eating, are promising therapies to address this challenging public health issue. Aim: To verify the effects of the Mindfulness-Based Eating Awareness Training (MB-EAT) protocol by exploring quantitative and qualitative data collected from Brazilian women. Methods: A single-group, mixed-methods trial was conducted at a public university with adult women ( n = 34). Four MB-EAT groups were offered weekly for 2.5-h sessions over 12 weeks. Pre- and post-intervention assessments included body mass index (BMI) and self-report measures of anxiety, depression, mindfulness, self-compassion, and eating behaviour. Qualitative information was collected using focus groups in the last session of each group, including both participants and MB-EAT instructors. The qualitative data were examined using thematic analyses and empirical categories. Results: Twenty participants (58.8%) completed both pre- and post-intervention assessments, with adequate attendance (≥4 sessions). There was a significant average decrease in weight of 1.9 ± 0.6 kg from pre- to post-intervention. All participants who had scored at the risk level for eating disorders on the EAT-26 decreased their score below this risk level. Qualitative analysis identified that participants were able to engage a more compassionate perspective on themselves, as well as greater self-awareness and self-acceptance. Conclusion: The MB-EAT showed preliminary efficacy in promoting weight loss and improvements in mindfulness and eating behaviour. This intervention promoted effects beyond those expected, extending to other life contexts.


BMJ Open ◽  
2017 ◽  
Vol 7 (8) ◽  
pp. e015452 ◽  
Author(s):  
Elaine Toomey ◽  
James Matthews ◽  
Deirdre A Hurley

Objectives and designDespite an increasing awareness of the importance of fidelity of delivery within complex behaviour change interventions, it is often poorly assessed. This mixed methods study aimed to establish the fidelity of delivery of a complex self-management intervention and explore the reasons for these findings using a convergent/triangulation design.SettingFeasibility trial of the Self-management of Osteoarthritis and Low back pain through Activity and Skills (SOLAS) intervention (ISRCTN49875385), delivered in primary care physiotherapy.Methods and outcomes60 SOLAS sessions were delivered across seven sites by nine physiotherapists. Fidelity of delivery of prespecified intervention components was evaluated using (1) audio-recordings (n=60), direct observations (n=24) and self-report checklists (n=60) and (2) individual interviews with physiotherapists (n=9). Quantitatively, fidelity scores were calculated using percentage means and SD of components delivered. Associations between fidelity scores and physiotherapist variables were analysed using Spearman's correlations. Interviews were analysed using thematic analysis to explore potential reasons for fidelity scores. Integration of quantitative and qualitative data occurred at an interpretation level using triangulation.ResultsQuantitatively, fidelity scores were high for all assessment methods; with self-report (92.7%) consistently higher than direct observations (82.7%) or audio-recordings (81.7%). There was significant variation between physiotherapists’ individual scores (69.8% - 100%). Both qualitative and quantitative data (from physiotherapist variables) found that physiotherapists’ knowledge (Spearman's association at p=0.003) and previous experience (p=0.008) were factors that influenced their fidelity. The qualitative data also postulated participant-level (eg, individual needs) and programme-level factors (eg, resources) as additional elements that influenced fidelity.ConclusionThe intervention was delivered with high fidelity. This study contributes to the limited evidence regarding fidelity assessment methods within complex behaviour change interventions. The findings suggest a combination of quantitative methods is suitable for the assessment of fidelity of delivery. A mixed methods approach provided a more insightful understanding of fidelity and its influencing factors.Trial registration numberISRCTN49875385; Pre-results.


2016 ◽  
Vol 77 (2) ◽  
pp. 197-211 ◽  
Author(s):  
Phil Jones ◽  
Julia Bauder ◽  
Kevin Engel

Grinnell College participated in ACRL’s first cohort of Assessment in Action (AiA), undertaking a mixed-methods action research project to assess the effectiveness of librarian-led research literacy sessions in improving students’ research skills. The quantitative data showed that the quality of students’ sources did not markedly improve following a research literacy session, while the qualitative data indicated that many students were able to state and describe important research concepts they learned. This article profiles the development of Grinnell’s AiA project and discusses how Grinnell’s librarians responded when the initial results led to more questions rather than to satisfactory answers.


Author(s):  
Wendy D. Rock ◽  
Jennifer Curry

This mixed methods, concurrent nested study was designed to explore the extent to which one state’s school counselors report daily activities that align to the ASCA National Model (ASCA, 2005, 2012, 2019). In spite of federal and state legislation, state policy, and a state model supporting best practices for school counseling, a significant number of school counselors in this study (approximately 25%) report barriers to implementing comprehensive, developmental models. These barriers include inordinate amounts of duty, testing, and coordination of specialized services. However, with nearly three out of four school counselors in the sample reporting knowing and implementing pieces of the ASCA National Model (ASCA, 2005, 2012, 2019), we remain hopeful for the future of school counseling in Louisiana.


Author(s):  
Laura Macia

In this article I discuss cluster analysis as an exploratory tool to support the identification of associations within qualitative data. While not appropriate for all qualitative projects, cluster analysis can be particularly helpful in identifying patterns where numerous cases are studied. I use as illustration a research project on Latino grievances to offer a detailed explanation of the main steps in cluster analysis, providing specific considerations for its use with qualitative data. I specifically describe the issues of data transformation, the choice of clustering methods and similarity measures, the identification of a cluster solution, and the interpretation of the data in a qualitative context.


Sign in / Sign up

Export Citation Format

Share Document