Implementing QDAS Throughout an Evaluation Project Using the Five-Level QDA Method

2021 ◽  
pp. 109821402110279
Author(s):  
Kyle L. Bower

The purpose of this paper is to introduce the Five-Level Qualitative Data Analysis (5LQDA) method for ATLAS.ti as a way to intentionally design methodological approaches applicable to the field of evaluation. To demonstrate my analytical process using ATLAS.ti, I use examples from an existing evaluation of a STEM Peer Learning Assistant program. Aligned with the 5LQDA method for ATLAS.ti, I first contextualize the strategies used to develop the analytical framework (Levels 1 & 2) and then deconstruct the translation process (Level 3) of pairing conceptual strategies with software tools. I then demonstrate the potential of the software in terms of selected and constructed tools (Levels 4 & 5) and discuss the importance of choosing tools aligned with the project's conceptual strategies. This paper acts as a resource to convey the value of integrating 5LQDA for ATLAS.ti throughout qualitative evaluation by engaging in an iterative process that creates opportunity for engagement.

Author(s):  
Su Li Chong

This paper illustrates how the Analytic Guiding Frame (AGF) and the Overall Guiding Frame (OGF) are applied when analytic shifts occur in qualitative data analysis. Analytic shifts mainly occur when a proposed analytical method is found to be not fully amenable for analysis because of the contextually-bound nature of qualitative data. In this paper, the illustration located in the field of literacy education revolves around how a methodological and analytical problem was confronted during the fieldwork/analysis stage of research and how analytic negotiations were made with the help of the AGF/OGF framework. From here, it is proposed that much more consideration on matters of epistemology, methodology, research objective and research questions in qualitative research must be made when the iterative process of qualitative data analysis takes place.


2020 ◽  
Vol 27 (2) ◽  
pp. 505-530
Author(s):  
Hendi Yogi Prabowo

Purpose The purpose of this paper is to explore the potential of computer-assisted qualitative data analysis software (CAQDAS) to support qualitative evaluation of corruption prevention initiatives, especially those focusing on behavioral changes. To achieve this objective, this paper applies the principles of qualitative inquiries to establish a foundation for developing effective means for evaluating behavior-oriented corruption prevention initiatives in Indonesia. Design/methodology/approach Through exploratory study, this paper assesses current corruption prevention evaluation practice in the Indonesian public sector to highlight major deficiencies thereof primarily through examination of publicly available documents on anti-corruption practice in Indonesia. Furthermore, this paper also discusses how qualitative methods using CAQDAS may strengthen the existing anti-corruption regime by aiding decision-makers to better evaluate the success or failure of their corruption prevention initiatives in particular those aiming for behavioral changes. To illustrate how a qualitative data analysis application can support anti-corruption evaluators, NVivo will be used as a reference from which multiple analytical tools will be discussed to highlight their potential for qualitative qualitative analysis analysis in corruption prevention evaluation. Findings The author establishes that the existing quantitative measures of evaluation are insufficient in generating a comprehensive picture of the success or failure of the existing anti-corruption initiatives in Indonesia. Evidences suggest that the existing quantitative measures appear to be unable to cope with the growing complexity of various corruption problems in the country in particular to those related to organizational culture and behavior. Despite the numerous behavior-oriented initiatives to reduce the risk of corruption in the Indonesia public sector, it is still unclear if such initiatives actually have made a difference in preventing corruption, as many of their elements cannot be measured quantitatively. Therefore, the author believe that deeper insights into corruption problems can be obtained through proper qualitative assessments in which evaluators play the role as the primary analytical instrument. To enhance evaluators’ capability in obtaining and analyzing qualitative data, the author proposes the use of CAQDAS and the evaluation of corruption prevention initiatives. With a special reference to NVivo, the author argues that using CAQDAS will enable evaluators to conduct qualitative analysis more efficiently to identify patterns within the data, as it offers various tools to look deeper into context, diversity, nuance and process so as to gain deeper understanding of the meaning of human action and how it may affect the risk of corruption within organizations. Research limitations/implications This study is self-funded and is relying primarily on documentary analysis in assessing the existing corruption prevention evaluation measures in Indonesia. Future studies may benefit from in-depth interviews with anti-corruption evaluators in particular from the country’s anti-corruption agency. Practical implications This paper contributes to the development of corruption prevention strategy by proposing a framework for systematically performing qualitative evaluation on behavior-oriented corruption prevention initiatives. Originality/value This paper highlights the importance of qualitative measures in evaluating behavior-oriented corruption prevention initiatives in the Indonesian public sector.


2017 ◽  
Vol 21 (5) ◽  
pp. 486-504
Author(s):  
Beata Paragi

The article is concerned with the perceptions and experiences of civil society actors receiving foreign aid from international and regional donors. By means of qualitative data analysis and within the analytical framework of gift exchange it aims to explore the ‘spiritual essence’ of contemporary gifts. Findings draw attention both to conflict and cooperation entailed by external gifts in light of the multiple understandings of culture.


2001 ◽  
pp. 63-82
Author(s):  
Räsänen Pekka

The aim of the paper is to examine the emergence of computer assistance in qualitativeresearch and to describe its impact on research practices. The use of data analysisprograms is approached from methodological frameworks ofbasic and structured qualitativeapproaches. Computer use is also examined from the viewpoint of concreteoperations of data analysis. Particularly the new features, which software packages areclaimed to have brought to data analysis, are discussed in the paper.It is argued that computer assisted techniques provide possibilities fr developing theoften impressionistic qualitative data analysis procedures into something more integrated,explicit and systematic. However, it is also emphasised that analysis programsthemselves do not represent any methodological approaches. By offering a special toolkitfr data processing, computer assistance should be understood only as an attempt toenhance analytic practices in qualitative research.


Author(s):  
Heather Churchill ◽  
Jeremy M. Ridenour

Abstract. Assessing change during long-term psychotherapy can be a challenging and uncertain task. Psychological assessments can be a valuable tool and can offer a perspective from outside the therapy dyad, independent of the powerful and distorting influences of transference and countertransference. Subtle structural changes that may not yet have manifested behaviorally can also be assessed. However, it can be difficult to find a balance between a rigorous, systematic approach to data, while also allowing for the richness of the patient’s internal world to emerge. In this article, the authors discuss a primarily qualitative approach to the data and demonstrate the ways in which this kind of approach can deepen the understanding of the more subtle or complex changes a particular patient is undergoing while in treatment, as well as provide more detail about the nature of an individual’s internal world. The authors also outline several developmental frameworks that focus on the ways a patient constructs their reality and can guide the interpretation of qualitative data. The authors then analyze testing data from a patient in long-term psychoanalytically oriented psychotherapy in order to demonstrate an approach to data analysis and to show an example of how change can unfold over long-term treatments.


Author(s):  
Diah Fauzi Ningtyas ◽  
Lidiman Sinaga

This study concerns on improving students’ achievement in writing procedure texts through word webbing technique. The research was conducted by using Classroom Action Research (CAR). The population was the 2012-2013 nine grade students of SMP Negeri 1 Batang Kuis. The number of students was 36, consisting of 21 females and 15 males. The procedure of the research was administrated into two cycles where each cycle consisted of three meetings. Each meeting included four steps namely: planning, action, observation, and reflection. There were two kinds of data collected during the study, qualitative and quantitative data. The instrument for collecting the quantitative data was the writing of procedure texts test while the qualitative data were gathered by using interview, diary notes and observation sheet. Based on the data analysis, the mean of students’ score in Test I was 53,47, for the Test II was 63,05, and for the Test III was 75 The qualitative data showed that the students were interested in the applying of Word webbing Technique. The conclusion is that Word Webbing Technique in writing Procedure Texts improves the students’ achievement in writing procedure texts. Keywords: Students’ achievement, writing, procedure text, word webbing


2018 ◽  
Vol 2 (2) ◽  
pp. 72
Author(s):  
Eka Saraswati ◽  
Devi Novallyan

Tujuan dari penelitian ini adalah mengembangkan media pembelajaran interaktif berbasis android untuk memudahkan pemahaman konsep trigonometri. Penelitian ini merupakan penelitian pengembangan dengan pendekatan kualitatif yang didukung data kuantitatif. Model Pengembangan yang digunakan yaitu ADDIE. Karya inovasi ini dibuat dengan macromediaflash 8. Subjek dalam penelitian ini terdiri dari 8 siswa pada ujicoba kelompok kecil dan 30 siswa pada ujicoba kelompok besar. Teknik pengumpulan data yang digunakan yaitu angket dan wawancara. Teknik analisis data kualitatif dengan menggunakan model Miles Huberman.Hasilpengembangan diperoleh sebuah media pembelajaran yang dapat membantu siswa untuk mempermudah mengingat rumus trigonometri. Kata kunci: Media pembelajaran, android, konsep trigonometri Abstract [The Development of Interactive Android Based Learning Media to Facilitate Understanding of Trigonometric Concepts]. The purpose of this research is to develop interactive android based learning media to facilitate understanding of trigonometric concepts. This research is a development research with qualitative approach supported by quantitative data. Development model used is ADDIE. The innovation work was made with Macromedia Flash 8. The subjects in this study consisted of 8 students on a small group trial and 30 students on a large group trial. Data collection techniques used questionnaires and interviews. Qualitative data analysis technique using Miles Huberman model. The results of the development obtained a learning media that can help students to simplify remembering the trigonometric formula. Keywords: Learning media, android, the concept of trigonometry


2018 ◽  
Vol 2 (2) ◽  
pp. 210-220
Author(s):  
Wendelinus Oscar Janggo ◽  
Yuliana Wisnawati Nona Nungsi

This research is entitled “The Effectiveness of Using Cooperative Script Method to Improve Students’ Reading Comprehension on Recount Text of 8th Grade Students of SMP N Kewapante, Maumere in Academic Year 2017/ 2018”. The objective of this research is to investigate and to find out whether the use of cooperative script method effective to improve students’ reading comprehension on recount text. The method of this research is experimental research especially quasi experimental research. In analyzing the data, the researcher combined both quantitative and qualitative data analysis. In qualitative data analysis, the researcher used interview technique in order to get information about students’ perceptions in reading, while in quantitative data analysis, the researcher used SPSS version 16. The result of the research showed that the implementation of Cooperative Script Method in experimental class was more effective to help the students in reading comprehension on recount text compared to the use of the conventional method in control class of the eighth grade students of SMP N Kewapante, Maumere. It is also found that cooperative script method positively contributed to improve students’ reading comprehension. Therefore ,the researcher  suggests the teachers to use cooperative script method in order to improve students reading comprehension Additionally, cooperative script method can also motivate students to be more active, relax and enthusiastic to comprehend reading texts.


2019 ◽  
Vol 3 (II) ◽  
pp. 41-70
Author(s):  
Florence Wanjiku Njau ◽  
Mary Mutisya Mutungi ◽  
Rayvisic Mutinda

Increasingly, hotel industry has witnessed rapid growth in the 21stcentury and as a result competition within the industry has also intensified. This competition has been fueled by the preoccupation of service quality to add value and strengthen the complete guest experience. However, a major challenge facing the sector is the aspect of service quality particularly in budget hotels which target price sensitive customers. These hotels provide the customers with satisfactory core product at a reasonable price but tend to focus more on profits than on customer satisfaction. The services offered are not standardized and service quality variability is a challenge. The study used an integrated SERVQUAL and Gap model to evaluate customer satisfaction in budget hotels in Nairobi City County, Kenya. The specific objectives of the study were to determine the effect of service design on customer satisfaction, establish the effect of service delivery on customer satisfaction and determine the moderating effect of management perception of service quality on customer satisfaction in budget hotels in Nairobi City County, Kenya. The study adopted a cross sectional survey design and was conducted in 50 budget hotels. A sample size of 334 drawn from the hotel managers, customers and employees were involved in this study. Systematic random sampling technique was used to select the study sample for customers and employees. Data were collected through use of questionnaires and interviews. Both descriptive and inferential statistics was used in data analysis. The study hypotheses were tested was tested using multiple regression (ANOVA) and qualitative data from management perception was analyzed using qualitative data analysis (QCA). The regression analysis indicated that all five dimensions of service quality in service design were significant (0.000) when tested at 95% confidence level. The model was found to be significant. Correlation analysis indicated that the service design factors that had significant impact were realization of assured service in reliability (p = .044 < .05), responsiveness in informing the customers about the time of service delivery (p = .000< .05) and empathy in that operating hours are convenient to customers (p = .030 < .05). The other variables did not have significant values. The results indicate that there are gaps in the budget hotels under study between service design and customer satisfaction. Relationship between service delivery and customer satisfaction was found to be positive but not all the variables were significant. The study findings indicated that four variables; good location (p = .115 > .05), closeness to main city facilities (p = .527 > .05), someone recommended hotel (p = .665 > .05), and good experiences from the hotel (p = .458 > .05) did not have no significant values. This implied that these variables did not have an effect on customer satisfaction resulting in a gap between service delivery and customer satisfaction. This indicated that the service delivery did fully not meet customer expectations. Management perception was found to have a moderating effect between service quality and customer satisfaction. The study concluded that although managers seemed to have a reasonably good understanding of the customer and developed service designs for quality service delivery, the services delivered still fell short of customer expectations. The study therefore recommends that to enhance customer satisfaction, management needs to focus on the changing needs of their customers and develop service designs that twill offer service delivery that satisfies the customer. The study makes some contribution to the body of knowledge as an integrated model in evaluating customer satisfaction. This is an open-access article published and distributed under the terms and conditions of the  Creative Commons Attribution 4.0 International License of United States unless otherwise stated. Access, citation and distribution of this article is allowed with full recognition of the authors and the source.


Sign in / Sign up

Export Citation Format

Share Document