Appreciative inquiry's potential in program evaluation and research

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Dana M. Griggs ◽  
Mindy Crain-Dorough

PurposeThe purposes of this paper are to provide a description of AI and to document and compare two applications of AI, one in program evaluation and another in an applied research study.Design/methodology/approachFocus groups, interviews and observations were used to gather rich qualitative data which was used to detail Appreciative Inquiry's value in evaluation and research.FindingsAI aided the researcher in connecting with the participants and valuing what they shared. In both studies, the use of AI amassed information that answered the research questions, provided a rich description of the context and findings, and led to data saturation. The authors describe and compare experiences with two applications of AI: program evaluation and a research study. This paper contributes further understanding of the use of AI in public education institutions. The researchers also explore the efficacy of using AI in qualitative research and recommend its use for multiple purposes.Research limitations/implicationsLimitations occurred in the AI-Design Stage by using a positive viewpoint and because both program and partnership studied were new with limited data to use for designing a better future. So, the authors recommend a revisit of both studies through the same 4D Model.Practical implicationsThis manuscript shows that AI is useful for evaluation and research. It amplifies the participants' voices through favorite stories and successes. AI has many undiscovered uses.Social implicationsThrough the use of AI the authors can: improve theoretical perspectives; conduct research that yields more authentic data; enable participants to deeply reflect on their practice and feel empowered; and ultimately impact and improve the world.Originality/valueAI is presented as an evaluation tool for a high-school program and as a research approach identifying strengths and perceptions of an educational partnership. In both studies, AI crumbled the walls that are often erected by interviewees when expecting to justify or defend decisions and actions. This paper contributes further understanding of the use of AI in public education institutions.

2019 ◽  
Vol 38 (3) ◽  
pp. 349-361 ◽  
Author(s):  
Valerie Gray Hardcastle ◽  
Stacie Furst-Holloway ◽  
Rachel Kallen ◽  
Farrah Jacquez

PurposeA lot is known about systemic barriers to broadening participation (BP) in STEM. Empirical research has demonstrated the existence and impact of implicit bias, stereotype threat, and micro-aggressions on a sense of belonging, organizational productivity and leadership opportunities. We also know that achieving greater participation of women and faculty of color in the STEM disciplines is complicated and depends on altering complex and multi-layered interactions between activities and actors. Further, because researcher and institutional goals vary as a function of target population and context, generalizable models can struggle in the face of larger BP efforts. Through the authors experience as an NSF ADVANCE-IT awardee, the authors believe that a dynamic, multi-scaled and organizational level approach is required to reflect the reciprocal dialogue among research questions, best practices, tailored applications and quantifiable goals. The authors describe several examples of research, programming activities and program evaluation that illustrate this approach. In particular, the authors describe both the programming successes and challenges, with the aim of helping others to avoid common mistakes by articulating very broad and, the authors’ hope, generalizable “lessons learned.” The paper aims to discuss these issues.Design/methodology/approachTo better understand the barriers for women in STEM, the authors utilized an iterative methodology. Specifically, the authors conducted a social network analysis, an exit survey of departed faculty, longitudinal analysis of career trajectories and research productivity, and a survey on the interaction between values and climate.FindingsThe analyses suggest three strategies better retain women in STEM: improve women’s professional networks; re-aling policy documents and departmental practices to better reflect faculty values; and improve departmental climate.Practical implicationsThe pay-off for using this more complex research approach to triangulate onto specific challenges is that the interventions are more likely to be successful, with a longer-lasting impact.Originality/valueWith continuous institutional research, metric refinement, and program evaluation the authors are better able to develop targeted programming, policy reform, and changes in institutional practice. The interventions should result in permanent institutional and systemic change by integrating multi-method qualitative and quantitative research into BP practices, which the authors couple with longitudinal analysis that can quantify success of the authors’ efforts.


2019 ◽  
Vol 17 (6) ◽  
pp. 1146-1160
Author(s):  
Salaheddine Bendak ◽  
Ahlam A. Alhammadi

Purpose House fire risk would be minimised if fire safety principles were incorporated at the design stage. This issue is rarely addressed in the literature. The purpose of this study is to propose a multi-criteria decision-making framework to evaluate fire risk of detached house designs in the United Arab Emirates and countries of similar cultural background. Design/methodology/approach The framework was developed based on function areas where (detached) house fires start, expert opinion and recommendations derived from the published literature on residential fire safety. This framework was applied to a sample of ten public detached house designs to check the applicability of the framework and to determine how safe these designs are from a fire safety perspective. Findings The proposed framework is proven to be an effective preliminary fire risk evaluation tool of detached house designs, and more research is needed in this area. Research limitations/implications The proposed framework is an encouraging first step in incorporating fire risk minimisation at the design stage of detached houses based on determining the preferred location of function areas but requires further development and validation, especially in other design settings. Practical implications The proposed framework is an initial endeavour in helping designers of detached houses to minimise fire risk and its potential effects on residents. Originality/value This research proposes a way to minimise fire risk at the design stage of detached houses.


2019 ◽  
Vol 9 (3) ◽  
pp. 319-328
Author(s):  
Ian Pepper ◽  
Ruth McGrath

Purpose The purpose of this paper is to evaluate the impact of an employability module, the College of Policing Certificate in Knowledge of Policing (CKP), on students’ career aspirations, their confidence and wish to join the police along with the appropriateness of the module. This will inform the implementation of employability as part of the College of Policing-managed Police Education Qualifications Framework (PEQF). Design/methodology/approach A three-year longitudinal research study used mixed methods across four points in time to evaluate the impact on students studying the employability module. Findings The research suggests that the employability-focussed CKP was useful as an introduction to policing, it developed interest in the police and enhanced the confidence of learners applying to join. Lessons learnt from the CKP should be considered during the implementation of the PEQF. Research limitations/implications The ability to generalise findings across different groups is limited as other influences may impact on a learner’s confidence and employability. However, the implications for the PEQF curriculum are worthy of consideration. Practical implications As the police service moves towards standardised higher educational provision and evolution of policing as a profession, lessons can be learnt from the CKP with regards to the future employability of graduates. Originality/value Enhancing the employability evidence base, focussing on policing, the research identified aspects which may impact on graduates completing a degree mapped to the PEQF. The research is therefore of value to higher education and the professional body for policing.


2019 ◽  
Vol 57 (6) ◽  
pp. 731-747 ◽  
Author(s):  
Mehmet Şükrü Bellibaş ◽  
Sedat Gümüş

Purpose While the current knowledge in the field of educational leadership and management (EDLM) has been primarily based on research produced in English-speaking Western societies, there have been significant efforts by other societies to contribute to the knowledge production, especially during the past decade. The purpose of this paper is to identify the contribution of Turkey to the international EDLM literature by investigating the topical focus, conceptual frameworks and research designs of papers published by EDLM scholars from Turkey. Design/methodology/approach Descriptive content analysis method was employed to examine 315 empirical, review, conceptual and commentary papers published by Turkish scholars in core educational administration and Web of Science journals. The time period of the review left open-ended. However, in practical terms, it begins in the year 1994 when the first article from Turkey was published in any of the selected sources and ends at the end of 2018. Information relevant to the research was extracted from each article and was coded to facilitate quantitative analysis. Using Excel software, descriptive statistics including frequencies and percentages were provided for each research question. Findings Results show that Turkish EDLM scholars mostly rely on survey based quantitative research approach, employing advanced statistical techniques in the analysis of the data. However, mixed method and qualitative studies are relatively less common. Organizational behavior, school leadership and emotions stand out as most frequently used topics, while Turkish scholars are not interested in analyzing the educational outcomes such as student achievement and school improvement. Consistent with the findings related to topical foci, a large number of those who were interested in correlational studies examined the relationship between leadership roles and organizational behaviors. Research limitations/implications The data set only included journal articles and excluded conference proceedings, books and theses/dissertations. Nevertheless, the authors believe this review adds significantly to previous reviews of local EDLM journals conducted by Turkish scholars. The authors concluded that the Turkish scholars should direct their future research to exploring and better understanding the practices of Turkish principals in schools by: diversifying their research topics; incorporating more qualitative and mixed-method designs; and taking into account specific features of the culture and educational system in Turkey. Practical implications Based on the current higher education context, reducing scholars’ teaching load, diversifying research funding opportunities, and modifying access to tenure tracks seem necessary interventions to support EDLM research with strong ties to practice and to the sociocultural context. In addition, policy changes aiming professionalization of administrative positions and establishing some forms of formal training for school principalship are needed. Such changes can help transfer the knowledge produced by the Turkish EDLM researchers to the practice and provide solutions to problems related to school administration. Originality/value This paper will add to recent effort to identify how a developing nation outside Western perspective approaches the field, and contributes to the global knowledge base.


2020 ◽  
Vol 33 (2) ◽  
pp. 217-228
Author(s):  
Martijn van Ooijen ◽  
Antonie van Nistelrooij ◽  
Marcel Veenswijk

PurposeThe purpose of this paper is to expand the theory on multistory cultural change by showing how a dominant narrative on construction safety dynamically interrelates and is contested on multiple intertextual levels in an organizational field of organizations contributing to the recovery of houses in an earthquake region.Design/methodology/approachAn ethnoventionist research approach was adopted in which interpretation of data to find narratives and designing interventions went hand-in-hand.FindingsWe found four distinctive composite narratives besides the dominant narrative to which five actors refer in their accounts, thereby contributing to three types of story patterns. These narratives disclose the taken-for-granted ideas and beliefs that characterize the challenge of changing organizational culture. One intervention, which intended multiple stories to touch the surface, was highlighted as a multistory intervention.Research limitations/implicationsFurther research could extend the knowledge on other change interventions that contribute to multistory cultural change processes.Originality/valueAdopting an ethnoventionist approach to provide deep insights on an unfolding cultural change process for both scholars and practitioners.


2014 ◽  
Vol 29 (2) ◽  
pp. 131-152 ◽  
Author(s):  
Claus Holm ◽  
Frank Thinggaard

Purpose – The authors aim to exploit a natural experiment in which voluntary replace mandatory joint audits for Danish listed companies and analyse audit fee implications of using one or two audit firms. Design/methodology/approach – Regression analysis is used. The authors apply both a core audit fee determinants model and an audit fee change model and include interaction terms. Findings – The authors find short-term fee reductions in companies switching to single audits, but only where the former joint audit contained a dominant auditor. The authors argue that in this situation bargaining power is more with the auditors than in an equally shared joint audit, and that the auditors' incentives to offer an initial fee discount are bigger. Research limitations/implications – The number of observations is constrained by the small Danish capital market. Future research could take a more qualitative research approach, to examine whether the use of a single audit firm rather than two has an effect on audit quality. The area calls for further theory development covering audit fee and audit quality in joint audit settings. Practical implications – Companies should consider their relationship with their auditors before deciding to switch to single auditors. Fee discounts do not seem to reflect long-lasting efficiency gains on the part of the audit firm. Originality/value – Denmark is the first country to leave a mandatory joint audit system, so this is the first time that it is possible to study fee effects related to this.


2018 ◽  
Vol 8 (4) ◽  
pp. 376-394 ◽  
Author(s):  
Sonali Bhattacharya ◽  
Netra Neelam

Purpose The purpose of this paper is to examine how internship value is manifested in the context of a business school. The authors have examined the internship experience in terms of experiential learning and employability. Specifically, the authors investigate the factors that determine internship at four phases: design, conduct, evaluation and feedback. Design/methodology/approach The authors have applied a mixed method approach. In all, 110 students of a busines school were first surveyed on their expectation, motivation and level of preparation through a self-administered questionnaire before internship. Based on the survey result, eight of these students were interviewed in details about internship expectations from industry, the selection process for internship, communications or exchanges between intern and companies prior to internship and perceived industry expectation from interns. At the next phase, authors used a qualitative research approach by conducting semi-structured, in-depth interviews with 14 interns and their mentors after internship period. They were interviewed on design, conduct, evaluation and feedback process of the internship. Interviews tried capture what kind of leader-member exchange led to satisfactory internship experience and outcome from view of both inter and mentor. Findings The authors find that at various stages of internship program quality of mentor – intern exchanges (as defined by leadership exchange theory), and task characteristics as indicated by autonomy, task variety, task significance and performance feedback determine intern’s performance. An intern’s performance is antecedent to an intern’s and a mentor’s satisfaction and overall internship value. The authors also found that intrinsic capability of intern such as critical thinking ability and learning orientation result in enhanced value of internship experience. The proposed models, postulate that at designing stage, lower the level of communication from employers, higher the feeling of ambiguity and lower the perceived internship value in terms of experiential learning and perceived employability. Feeling of ambiguity is moderated by existence of prior work experience of interns. At conduction stage, mentor-intern exchange is directly related to flexibility in structure of the program and inversely related to dependency on peer learning. Mentor-intern exchange also related to mentor and intern’s learning value. However, the learning value is moderated by learning orientation of the intern. Originality/value The authors have tried the summer internship experience from the perspective of interns and mentors. This is the uniqueness of the research.


2014 ◽  
Vol 14 (1) ◽  
pp. 108-134 ◽  
Author(s):  
Morteza Shokri-Ghasabeh ◽  
Nicholas Chileshe

Purpose – A research study has been undertaken at the University of South Australia to introduce application of lessons learned process in construction contractors ' bidding process in the context of knowledge management. The study aims to identify barriers to effectively capture lessons learned in Australian construction industry and how knowledge management can benefit from lessons learned application. Design/methodology/approach – The research study has been undertaken through conducting a “methodological triangulation” and “interdisciplinary triangulation”. This involved an extensive literature review of knowledge management, organisation learning, lessons learned and associated processes and administration of a questionnaire to a sample of construction contractors operating in Australia to elicit opinions on the main barriers to capturing lessons learned, practices such as existence and retention of documentation procedures. A total of 81 useable responses were received from 450 organisations. Response data were subjected to descriptive and inferential statistics with correlation analysis to examine the strength of relationship among the barriers. Findings – The top-3 barriers to the effective capturing of lessons learned were “lack of employee time”, “lack of resources” and “lack of clear guidelines”, whereas, “lack of management support” was the least ranked barrier. The study established that despite the majority of the ACCs having formal procedures for recording the tenders submitted and their outcomes, only a minority actually retained the lessons learned documentation for each project. The larger contractors were found to be more aware of the importance of lessons learned documentation. A comparative analysis with previous studies also found a disparity in the ranking of the barriers. Research limitations/implications – The majority of the participants were small construction contractors in Australia. The reason is that the researchers were not aware of the contractors ' size prior to inviting them for participation in the research study. Second the findings may not generalize to other industries or to organisations operating in other countries. Originality/value – The findings of this survey help ACCs to understand the importance of lessons learned documentation as part of lessons learned implementation and identify the barriers to effectively document their lessons learned. The study provides insights on the barriers and proposes advocated solutions in form of drivers and enablers (critical success factors) of organisational learning capturing among the Australian construction contractors. By reviewing the current literature, “post-project reviews” and “lessons learned” as important elements of organisation learning knowledge transfer, are addressed. Finally, contribution of this study to knowledge and practice has been discussed in this paper.


2019 ◽  
Vol 25 (4) ◽  
pp. 717-730 ◽  
Author(s):  
Veland Ramadani ◽  
Robert D. Hisrich ◽  
Leo-Paul Dana ◽  
Ramo Palalic ◽  
Laxman Panthi

Purpose Throughout Macedonia, beekeeping is becoming popular regardless of ethnicity. Studying ethnicity, the purpose of this paper is to determine what beekeepers in Macedonia thought in their own words about their beekeeping entrepreneurship. The objective is to identify whether motivations of ethnic Albanian beekeepers in Macedonia were the same or different compared to those of ethnic Macedonians in the same country, and if different, how. Design/methodology/approach To accomplish this objective, in-depth interviews were conducted with 40 beekeepers in Macedonia. A total of 29 interviews were conducted face-to-face and the other 11 by phone. The first set of interviews took place between December 2016 and February 2017, followed by more interviews in June 2017. In total, 27 respondents said they were ethnic Albanians, and 13 identified themselves as ethnic Macedonians. Also, ten respondents were women. While eight were full-time beekeepers, 32 were part-time beekeepers. Findings The results indicated that beekeeping businesses play a significant role in the transition economy of Macedonia. Beekeeping provides additional earnings that support rural families and keeps them financially stable. The majority of both Albanians and Macedonians understood that beekeeping on a part-time job basis provided a needed supplement to their income. Some part-time beekeepers are also working as auto-mechanics, locksmiths, medical doctors, restaurant/cafeteria owners, and tailors. A few in the sample were retired from their jobs or full-time beekeepers. An important difference between ethnic Albanian beekeepers and ethnic Macedonians in Macedonia is that the majority of ethnic Albanian participants see beekeeping as following in “my father’s footsteps”, while most Macedonians were motivated by the perceived opportunity of having a good business. Research limitations/implications Limitations of the research are twofold. First, financial data of family beekeeping are not available, which would be useful in determining the contribution made to economic development. It is common, especially in transition economies such as the western Balkans, that financial results are very sensitive to their owners. Second, unavailable databases for beekeepers make any quantitative approach difficult, if not impossible, resulting in most research using the qualitative research approach. Originality/value This paper is one of the first to treat beekeeping as a form of artisan entrepreneurship, which also contributes to the understanding of family business. As in other countries, the important and operation of the family business among family members in Macedonia is passed from generation to generation. The results of this research revealed the value of networking, which was found to be very important to income. For beekeepers to develop, grow, and be branded in the community, networking is an important ingredient.


2017 ◽  
Vol 25 (2) ◽  
pp. 233-250 ◽  
Author(s):  
Sangeetha Lakshman ◽  
C. Lakshman ◽  
Christophe Estay

Purpose The purpose of this paper is to examine the relationship of business strategies with executive staffing of multinational companies (MNCs). Design/methodology/approach Based on in-depth interviews conducted with top executives of 22 MNCs’, the authors identify important connections between international business strategies and staffing orientation. The authors used the qualitative research approach of building theory from interviews; thus, creating theoretical propositions from empirical evidence. Findings The authors find that when the pressure for global integration is high, MNCs use more parent-country national (PCNs) (ethnocentric staffing) as against the use of host-country managers (HCNs) (polycentric staffing) when this pressure is low. Additionally, MNCs using a global strategy are more likely to use an ethnocentric staffing approach, those using a multi-domestic strategy use a polycentric approach and firms using transnational strategy adopt a mix of ethnocentric and polycentric approaches. Research limitations/implications Although the authors derive theoretical patterns based on rich qualitative data, their sample is relatively small and comprises mostly of French MNCs. Generalizability to a broader context is limited. However, the authors’ findings have critical implications for future research. Practical implications The authors’ findings provide critical managerial implications for MNCs in matching their HR strategies with business strategies. These are important for effective strategy implementation. Originality/value Although MNC staffing orientations have been studied for a long time, their relationship to international business strategies is still not clearly understood. The authors contribute to the literature by investigating the relationship between MNCs’ business strategy types with staffing orientations.


Sign in / Sign up

Export Citation Format

Share Document