scholarly journals Examining Rater Biases of Peer Assessors in Different Assessment Environments

2021 ◽  
Vol 8 (4) ◽  
pp. 136-151
Author(s):  
Sabahattin YEŞİLÇINAR ◽  
Mehmet ŞATA
Keyword(s):  
Classroom Management ◽  
Student Teachers ◽  
Peer Assessment ◽  
Reliability And Validity ◽  
Central Tendency ◽  
Structured Interviews ◽  
Management Communication ◽  
Individual Level ◽  
Halo Effects ◽  
The Individual

The current study employed many-facet Rasch measurement (MFRM) to explain the rater bias patterns of EFL student teachers (hereafter students) when they rate the teaching performance of their peers in three assessment environments: online, face-to-face, and anonymous. Twenty-four students and two instructors rated 72 micro-teachings performed by senior Turkish students. The performance was assessed using a five-category analytic rubric developed by the researchers (Lesson Presentation, Classroom Management, Communication, Material, and Instructional Feedback). MFRM revealed the severity and leniency biases in all three assessment environments at the group and individual levels, drawing attention to the less occurrence of biases anonymous assessment. The central tendency and halo effects were observed only at the individual level in all three assessment environments, and these errors were similar to each other. Semi-structured interviews with peer raters (n = 24) documented their perspectives about how the anonymous assessment affected the severity, leniency, central tendency, and halo effects. Besides, the findings displayed that hiding the identity of the peers develops the reliability and validity of the measurements performed during peer assessment.

scholarly journals The use of Twitter for innovation in business markets

2020 ◽  
Vol 38 (5) ◽  
pp. 587-601
Author(s):  
Helen Cripps ◽  
Abhay Singh ◽  
Thomas Mejtoft ◽  
Jari Salo
Keyword(s):  
Social Media ◽  
Peer Interactions ◽  
Methodological Approach ◽  
Relationship Building ◽  
Business Relationships ◽  
Structured Interviews ◽  
Content Type ◽  
B2b Marketing ◽  
Individual Level ◽  
The Individual

PurposeThe purpose of this research is to investigate the use of Twitter in business as a medium for knowledge sharing and to crowdsource information to support innovation and enhance business relationships in the context of business-to-business (B2B) marketing.Design/methodology/approachThis study uses a combination of methodologies for gathering data in 52 face-to-face interviews across five countries and the downloaded posts from each of the interviewees' Twitter accounts. The tweets were analysed using structural topic modelling (STM), and then compared to the interview data. This method enabled triangulation between stated use of Twitter and respondent's actual tweets.FindingsThe research confirmed that individuals used Twitter as a source of information, ideas, promotion and innovation within their industry. Twitter facilitates building relevant business relationships through the exchange of new, expert and high-quality information within like-minded communities in real time, between companies and with their suppliers, customers and also their peers.Research limitations/implicationsAs this study covered five countries, further comparative research on the use of Twitter in the B2B context is called for. Further investigation of the formalisation of social media strategies and return on investment for social media marketing efforts is also warranted.Practical implicationsThis research highlights the business relationship building capacity of Twitter as it enables customer and peer conversations that eventually support the development of product and service innovations. Twitter has the capacity for marketers to inform and engage customers and peers in their networks on wider topics thereby building the brand of the individual users and their companies simultaneously.Originality/valueThis study focuses on interactions at the individual level illustrating that Twitter is used for both customer and peer interactions that can lead to the sourcing of ideas, knowledge and ultimately innovation. The study is novel in its methodological approach of combining structured interviews and text mining that found the topics of the interviewees' tweets aligned with their interview responses.

scholarly journals Achieving radical change

2018 ◽  
Vol 31 (2) ◽  
pp. 428-455 ◽  
Author(s):  
Noel Hyndman ◽  
Mariannunziata Liguori
Keyword(s):  
Performance Management ◽  
Radical Change ◽  
Practice Variation ◽  
Structured Interviews ◽  
Content Type ◽  
Individual Level ◽  
Incremental Change ◽  
The Individual ◽  
The Uk ◽  
Perceived Outcomes

Purpose The purpose of this paper is to focus on strategies and “spoken discourses” used to construct legitimation around change at the individual level. Comparing changes in financial accounting, budgeting and performance management at two government levels (Westminster and Scotland), it explores the use of legitimation strategies in the implementation of accounting change and its perceived outcomes. Design/methodology/approach Drawing on semi-structured interviews, six legitimation/delegitimation strategies are used to code the transcribed data. Patterns with the perceived outcomes of change are explored. Findings Changes introduced to enhance “rational” decision making are often received as pushed by some source of authority. Regardless of the interviewees’ background and level, the results suggest that for radical accounting change to embed, it is necessary for it to be perceived as rational, rather than merely driven by authorisation-based pressures. Conversely, incremental change is associated with modest legitimation via rationalisation and delegitimation based on pathos and rationalisation. Research limitations/implications The study deals with actors’ legitimation strategies and perceptions of change. These may not correspond to actual substantial change. Taken-for-granted ideas often remain “under the radar”, therefore care must be taken in interpreting the results. The focus of the empirical study is on the UK, therefore conclusions are restricted to this context. Originality/value Existing studies struggle to explain organisations’ heterogeneity and practice variation; this study sheds light on how individual legitimation, which may lead to different organisational results, occurs. Differences in how actors interpret changes may be based on their position (central vs devolved administration) and on their ownership of the changes.

Rocks in the Stream: An Exploration of Knowledge Flow Inhibitors and Modulators within Organizations

2013 ◽  
Author(s):  
Joseph Kasten
Keyword(s):  
Content Analysis ◽  
Knowledge Flow ◽  
Structured Interviews ◽  
Individual Level ◽  
The Individual

This study analyzes the flow of knowledge within firms at the individual level. Managers participate in semi-structured interviews. Content analysis identifies factors that obstruct or modulate the flow of knowledge such as knowledge filtering and packaging. These must be understood in order to create more effective knowledge flow within organizations.Cette étude analyse la circulation des connaissances dans les organisations au niveau individuel. Les gestionnaires participent à des entrevues semi-structurées. Une analyse du contenu identifie les facteurs qui entravent ou modulent la circulation des connaissances, comme le filtrage et l’intégration des connaissances. Ces facteurs doivent être compris de manière à créer une circulation des connaissances plus efficace dans les organisations. 

Leadership in Vietnamese state owned enterprises (SOEs)

2016 ◽  
Vol 8 (1) ◽  
pp. 21-36 ◽  
Author(s):  
Dong Mai Tran ◽  
Wayne Fallon ◽  
Margaret H. Vickers
Keyword(s):  
Cultural Context ◽  
Leadership Practices ◽  
Economic Transition ◽  
Critical Time ◽  
Structured Interviews ◽  
Business Leadership ◽  
Content Type ◽  
Business Context ◽  
Individual Level ◽  
The Individual

Purpose – The purpose of this paper is to explore multiple stakeholders’ perceptions of leadership in Vietnamese state-owned enterprises (SOEs). Design/methodology/approach – The paper presents findings from semi-structured interviews that were conducted in Vietnam, with seven different stakeholders who had varying understandings of Vietnamese business leadership within the Vietnamese business context. All interviews were transcribed, then translated into English, and thematic analysis of the interview data undertaken. Findings – The paper suggests that there was a significant variation in Vietnamese leadership perceptions when compared to Western leadership practices, especially when considering the perceptions of those stakeholders with regard to business leadership in the Vietnamese collectivist cultural context. The themes presented include: SOE decision making and responsibility; SOE promotions and appointments; and SOE performance. Research limitations/implications – In the absence of studies of leadership in Vietnamese SOEs, and leadership studies in the Vietnamese culture in general, this research was deliberately exploratory and qualitative. Future mixed methods or quantitative studies are recommended to offer more generalizable conclusions. Practical implications – Implications are discussed that point to leadership changes in Vietnamese organizations, and at the individual level, to assist the Vietnamese government, SOEs, and future leaders. Recommendations are also made that are intended to assist foreign business investors and multinational companies operating in Vietnam, now and in the future, to improve their leadership capacity within this context. Social implications – Vietnam is a country in social and economic transition. Understanding the leadership practices and perceptions, especially how that might differ from leadership in Western nations, is critical for the success of organizations in Vietnam and, in turn, for the economic and social prosperity of the Vietnamese people. Originality/value – The paper contributes perceptions of business leadership in Vietnamese SOEs that have not previously been explored and should be, especially given this critical time of economic and social transition for the Vietnamese nation and economy.

scholarly journals The Influence of Marginalization on Cultural Attitudes and Trash Disposal Practices in Esfuerzo de Paraíso of the Dominican Republic: A Qualitative Interview Study

2021 ◽  
Vol 18 (6) ◽  
pp. 2872
Author(s):  
Madison Sasman ◽  
Carrie B. Dolan ◽  
Daniel Villegas ◽  
Estelle Eyob ◽  
Catherine Barrett
Keyword(s):  
Dominican Republic ◽  
Municipal Government ◽  
Public Health Problem ◽  
Past Research ◽  
Major Public Health Problem ◽  
Structured Interviews ◽  
Cultural Attitudes ◽  
Individual Level ◽  
Qualitative Interview Study ◽  
The Individual

The inadequate management of municipal solid waste (MSW) in fast-developing nations is a major public health problem. Trash collection is often inconsistent, leaving residents to use unsafe disposal methods such as incineration or unregulated dumping. The issue is especially pronounced in marginalized communities, where public service provision is scarce. Past research has identified factors that perpetuate harmful disposal practices. The current study expanded on previous work by exploring how individuals’ perceptions of political, spatial, and economic marginalization affected their agency with regards to waste management. Researchers focused on a marginalized community in the Dominican Republic known as Esfuerzo de Paraíso. There, they conducted semi-structured interviews to explore residents’ perceptions of marginalization at the individual, interpersonal, community, and institutional levels, and its effects on their agency. A qualitative coding process revealed that most community members were discontent with their trash disposal practices, but that long-standing marginalization left them feeling ill equipped to generate change at the individual level. Interviewees believed that change should be initiated at the community level and implemented with the support of institutional-level actors, namely the municipal government. Residents did not identify any non-governmental organizations as possible sources of help, which may suggest a limited view of institutional support networks.

scholarly journals How Assessment in Final Year Project Can Threatening the Validity?

2020 ◽  
Vol 8 (5) ◽  
pp. 277-283
Keyword(s):  
Student Performance ◽  
Validity And Reliability ◽  
Separation Index ◽  
Individual Level ◽  
Halo Effects ◽  
Analysis Group ◽  
Subjective Evaluations ◽  
Separation Ratio ◽  
Level Of Understanding ◽  
The Individual

An undergraduate project evaluation is measured using a rubric assessment. The tendency for the examiner to be biased is high. Otherwise, these subjective evaluations will threaten the validity and reliability of the assessment. Therefore, this study was conducted to investigate the effect of halo in the evaluation of undergraduate projects using analysis software program Multi Facet Rasch Measurement (MFRM) version 3.82.2. The methodology of this study is by using a design approach quantitative form. A total number of 98 students and 43 lecturers who serve as examiners of the Faculty of Electrical and Electronic Engineering of Tun Hussein Onn Malaysia University were involved in this study using purposive sampling. Halo effects were analyzed based on the objective of the study and detected using two methods, as a group and individually. In the analysis group there were four indicators examined (i) A Fixed ChiSquared Test (Fixed) (ii) The trait separation ratio (iii) The trait separation index and (iv) The Reliability of the trait separation index. Meanwhile, in the analysis of individual level was examined by identifying significant bias interactions. From the study, it was found that studies show that there are halo effects at the individual level while halo effects cannot be detected at the group level. The findings of the study are to create that measurement is an important element in interpreting student performance. Although halo effects can be identified individually among examiners. But it does not affect the assessment because it does not exist in the group. Training and coordination need to be done to further develop the same level of understanding to improve student's ability to be translated to actual ability. Quality assessment will produce excellent and valuable human capital in the future

scholarly journals Social Justice Perception of Pre-Service Visual Arts Teachers: Visual Inquiries

2021 ◽  
Vol 7 (3) ◽  
pp. 517-545
Author(s):  
Ebru Güler
Keyword(s):  
Social Justice ◽  
Violence Against Women ◽  
Visual Arts ◽  
Animal Rights ◽  
Reliability And Validity ◽  
Structured Interviews ◽  
Justice Perception ◽  
Arts Teachers ◽  
The Individual ◽  
Academic Year

<p style="text-align:justify">This study seeks to reveal the perceptions of pre-service visual arts teachers on social justice through art-based practices focused on social justice. Designing on visual phenomenology, this study was performed in the fall semester of the 2018-2019 academic year. Five different activities involving visual inquiries are presented to reveal the perceptions of the pre-service teachers on social justice. The research participants are 35 (13 male, 22 female) sophomore-level pre-service teachers. The data are obtained through course documents, reflective diaries and semi-structured interviews. The data are then analysed through content analysis; reliability and validity are ensured through triangulation. This study identifies four different themes: association, questioning, transformation and reflection. The findings show that the pre-service teachers questioned common issues related to social justice. It was observed in the activities performed in this study that the pre-service teachers identified the visual themes. They mentioned common social justice issues based on the things they experienced and their observations. These are such as women's rights, violence against women, children's rights, LGBT, animal rights, language and religion differences, income imbalance, racism, and discrimination. The issues they questioned were the direct expression of the individual experiences of the pre-service teachers through visuals.</p>

Local capacity building after crisis

2019 ◽  
Vol 29 (2) ◽  
pp. 214-226 ◽  
Author(s):  
Wine Tesseur
Keyword(s):  
Capacity Building ◽  
Structured Interviews ◽  
Theoretical Understanding ◽  
Content Type ◽  
Individual Level ◽  
Local Capacity ◽  
Negative Effect ◽  
The Individual ◽  
Local Capacity Building

Purpose The purpose of this paper is to discuss the role of languages and translation in the context of capacity building in NGOs in Kyrgyzstan. It argues that language barriers can impede local capacity building, while translation can help in overcoming some of the issues encountered. Design/methodology/approach The paper reports on what NGO workers have said on the role of languages and translation in their work in 34 semi-structured interviews conducted in Kyrgyzstan in January 2018. The discussion is structured around a theoretical understanding of capacity building at three levels: the organisational level, the individual level and a broader enabling environment. Findings First, the paper demonstrates that knowledge of English plays a key role in accessing international funding and information. Second, it describes the challenges that NGO workers encounter when translating information related to development into Russian and Kyrgyz. Third, it argues that donors do not overtly consider the important role of languages. Together, the findings suggest that ignoring the role of languages and translation can have a negative effect on project outcomes and power relationships. Practical implications Policy recommendations for international NGOs and donors drawn from this case study and from comparative case studies on Peru and Malawi have been published in Crack et al. (2018). Originality/value The paper argues that taking the role of languages and translation into account can result in a more in-depth understanding of aspects that may contribute to better local capacity building.

scholarly journals Racialised professionals’ experiences of selective incivility in organisations: A multi-level analysis of subtle racism

2020 ◽  
pp. 001872672095772
Author(s):  
Mustafa Bilgehan Ozturk ◽  
Aykut Berber
Keyword(s):  
Structured Interviews ◽  
Dynamic Changes ◽  
Individual Level ◽  
Subtle Racism ◽  
Societal Level ◽  
Conditions Of Possibility ◽  
Multi Level ◽  
The Individual ◽  
Level Analysis ◽  
Organisational Level

This article explores how racialised professionals experience selective incivility in UK organisations. Analysing 22 in-depth, semi-structured interviews, we provide multi-level findings that relate to individual, organisational and societal phenomena to illuminate the workings of subtle racism. On the individual level, selective incivility appears as articulated through ascriptions of excess and deficit that marginalise racialised professionals; biased actions by white employees who operate as honest liars or strategic coverers; and white defensiveness against selective incivility claims. On the organisational level, organisational whitewashing, management denial and upstream exclusion constitute the key enablers of selective incivility. On the societal level, dynamic changes relating to increasing intolerance outside organisations indirectly yet sharply fuel selective incivility within organisations. Finally, racialised professionals experience intersectional (dis-)advantages at the imbrications of individual, organisation and society levels, shaping within-group variations in experiences of workplace selective incivility. Throughout all three levels of analysis and their interplay, differences in power and privilege inform the conditions of possibility for and the continual reproduction of selective incivility.

A Theoretical Framework for IT Consumerization

2019 ◽  
pp. 114-129 ◽  
Author(s):  
Ibrahim Arpaci
Keyword(s):  
Technology Acceptance ◽  
Theoretical Framework ◽  
Bring Your Own Device ◽  
Organizational Level ◽  
Structured Interviews ◽  
Privacy And Security ◽  
Individual Level ◽  
Innovation Diffusion Theory ◽  
Ict Adoption ◽  
The Individual

The chapter provided a comprehensive review of previous studies on the adoption of information and communication technology (ICT). The study further conducted a qualitative study on the adoption of “bring your own device” (BYOD). The study systematically reviewed technology acceptance theories and models such as TAM, TPB, and UTAUT at the individual level and technology adoption theories such as “innovation diffusion theory,” “technology-organization-environment framework,” and “institutional theory” at the organizational level. Thereby, key factors predicting the ICT adoption at the individual, organizational, institutional, and environmental level were identified. A theoretical framework that explains the ICT adoption and the consumerization process was proposed based on the theories. The qualitative data collected by semi-structured interviews with senior-level managers was analyzed using the content analysis. The findings suggested that perceived financial cost, compatibility, privacy, and security concerns were significant factors in predicting the enterprise's adoption of BYOD.

Sign in / Sign up

Export Citation Format

Share Document