scholarly journals Fostering learners’ involvement in the assessment process during the COVID-19 pandemic: Perspectives of university language and communication teachers across the globe

2021 ◽  
Vol 18 (5) ◽  
pp. 197-217
Author(s):  
Rita Koris ◽  
◽  
Ágnes Pál ◽  

With the transition to online teaching due to the COVID-19 pandemic, the need for identifying effective methods of assessment has become paramount. The methods of traditional summative in-person, paperand-pencil exams could not be adapted to the online environment. In case of unsupervised (nonproctored) exams it was impossible to ensure students’ academic honesty. Some universities have offered remotely supervised (proctored) examinations, which has been a rare exception. The pandemic prompted teachers to innovate their assessment practice and apply formative assessment methods as an alternative to traditional summative assessment. They have started using tasks such as e-portfolios, online learning journals, blogs, online presentations, creative writing, and open-book exams, which present golden opportunities to involve students in the assessment process. This study aims to explore assessment-related experiences of language and communication teachers at higher education institutions (HEIs) during the pandemic. Our mixed-method research combines an international survey administered to university language and communication teachers (N=301) with in-depth interviews with a selection of participants (n=18) of the same background. The results provide valuable insights into the perceptions that university language and communication teachers have of effective assessment methods and pedagogical approaches engaging learners in assessment. The implications of the study advocate a growing trend toward a wider use of learner-centered assessment.

Author(s):  
John Hunsley ◽  
Eric J. Mash

Evidence-based assessment relies on research and theory to inform the selection of constructs to be assessed for a specific assessment purpose, the methods and measures to be used in the assessment, and the manner in which the assessment process unfolds. An evidence-based approach to clinical assessment necessitates the recognition that, even when evidence-based instruments are used, the assessment process is a decision-making task in which hypotheses must be iteratively formulated and tested. In this chapter, we review (a) the progress that has been made in developing an evidence-based approach to clinical assessment in the past decade and (b) the many challenges that lie ahead if clinical assessment is to be truly evidence-based.


Leadership ◽  
2021 ◽  
pp. 174271502199649
Author(s):  
Dag Jansson ◽  
Erik Døving ◽  
Beate Elstad

The notion of leadership competencies is a much-debated issue. In this article, we propose that how the leader makes sense of his or her competencies is key to leadership practice. Specifically, we look at how leaders reconcile discrepancies between the self-perceived proficiency of various competencies and their corresponding importance. Empirically, we study leaders within the music domain – how choral conductors make sense of their competencies in the shaping of their professional practice. We investigated how choral leaders in Scandinavia ( N = 638) made sense of their competencies in the face of demands in their working situations. A mixed methodology was used, comprising a quantitative survey with qualitative comments and in-depth interviews with a selection of the respondents. The results show that when choral leaders shape their practice, they frequently face competency gaps that compel them to act or adjust their identity. The key to this sensemaking process is how they move competency elements they master to the foreground and wanting elements to the background. The concept of ‘sensemaking affordance’ is introduced to account for how various leader competency categories are negotiated to safeguard overall efficacy.


2021 ◽  
pp. 026553222110361
Author(s):  
Chao Han

Over the past decade, testing and assessing spoken-language interpreting has garnered an increasing amount of attention from stakeholders in interpreter education, professional certification, and interpreting research. This is because in these fields assessment results provide a critical evidential basis for high-stakes decisions, such as the selection of prospective students, the certification of interpreters, and the confirmation/refutation of research hypotheses. However, few reviews exist providing a comprehensive mapping of relevant practice and research. The present article therefore aims to offer a state-of-the-art review, summarizing the existing literature and discovering potential lacunae. In particular, the article first provides an overview of interpreting ability/competence and relevant research, followed by main testing and assessment practice (e.g., assessment tasks, assessment criteria, scoring methods, specificities of scoring operationalization), with a focus on operational diversity and psychometric properties. Second, the review describes a limited yet steadily growing body of empirical research that examines rater-mediated interpreting assessment, and casts light on automatic assessment as an emerging research topic. Third, the review discusses epistemological, psychometric, and practical challenges facing interpreting testers. Finally, it identifies future directions that could address the challenges arising from fast-changing pedagogical, educational, and professional landscapes.


2020 ◽  
pp. 204138662098341
Author(s):  
Marvin Neumann ◽  
A. Susan M. Niessen ◽  
Rob R. Meijer

In personnel- and educational selection, a substantial gap exists between research and practice, since evidence-based assessment instruments and decision-making procedures are underutilized. We provide an overview of studies that investigated interventions to encourage the use of evidence-based assessment methods, or factors related to their use. The most promising studies were grounded in self-determination theory. Training and autonomy in the design of evidence-based assessment methods were positively related to their use, while negative stakeholder perceptions decreased practitioners’ intentions to use evidence-based assessment methods. Use of evidence-based decision-making procedures was positively related to access to such procedures, information to use it, and autonomy over the procedure, but negatively related to receiving outcome feedback. A review of the professional selection literature showed that the implementation of evidence-based assessment was hardly discussed. We conclude with an agenda for future research on encouraging evidence-based assessment practice.


2021 ◽  
pp. 147490412110317
Author(s):  
Rory Mc Daid ◽  
Emer Nowlan

Despite an increase in ethnic diversity within the state, the Irish teaching workforce remains starkly mono-ethnic. This article is based on an analysis of data generated through a sequential explanatory mixed method research project involving questionnaire responses from 240 migrant teachers and subsequent focus group with a selection of teachers. Findings suggest that migrant teachers are slow to engage in the formal accreditation process, and face considerable challenges when they do. This reflects not only practical difficulties, but also narrow discourses of who can legitimately be recognised as a teacher in Ireland. This in turn is linked to cultural arbitraries highlighted through the research, such as a requirement to be able to teach through the Irish language in primary school and a requirement to be registered to teach in primary or post-primary schools only. In exploring these barriers, we draw broadly on Bourdieu and Passeron’s (1990) work, which understands teachers as pedagogic agents, imbued with pedagogic authority through formal processes of accreditation and selection. These processes involve the imposition of cultural arbitraries which legitimate certain languages, content or stances over others. Recommendations include revisions to the registration process to take previous teaching experience into account.


2014 ◽  
Vol 72 (3) ◽  
pp. 1057-1068 ◽  
Author(s):  
Enric Cortés ◽  
Elizabeth N. Brooks ◽  
Kyle W. Shertzer

Abstract We review three broad categories of risk assessment methodology used for cartilaginous fish: productivity-susceptibility analysis (PSA), demographic methods, and quantitative stock assessments. PSA is generally a semi-quantitative approach useful as an exploratory or triage tool that can be used to prioritize research, group species with similar vulnerability or risk, and provide qualitative management advice. Demographic methods are typically used in the conservation arena and provide quantitative population metrics that are used to quantify extinction risk and identify vulnerable life stages. Stock assessments provide quantitative estimates of population status and the associated risk of exceeding biological reference points, such as maximum sustainable yield. We then describe six types of uncertainty (process, observation, model, estimation, implementation, and institutional) that affect the risk assessment process, identify which of the three risk assessment methods can accommodate each type of uncertainty, and provide examples mostly for sharks drawn from our experience in the United States. We also review the spectrum of stock assessment methods used mainly for sharks in the United States, and present a case study where multiple methods were applied to the same species (dusky shark, Carcharinus obscurus) to illustrate differing degrees of model complexity and type of uncertainty considered. Finally, we address the common and problematic case of data-poor bycatch species. Our main recommendation for future work is to use Management Strategy Evaluation or similar simulation approaches to explore the effect of different sources of uncertainty, identify the most critical data to satisfy predetermined management objectives, and develop harvest control rules for cartilaginous fish. We also propose to assess the performance of data-poor and -rich methods through stepwise model construction.


2017 ◽  
Vol 18 (2) ◽  
pp. 148-157 ◽  
Author(s):  
Karine Fournier ◽  
Lindsey Sikora

Purpose Though we live in a digital era, libraries offer significant hours of in-person reference services, in combination with online reference services. Nevertheless, an increase in requests for in-person, individualized research consultations (IRCs) over the last few years has been observed. IRCs between librarians and students are common practice in academic institutions. While these sessions can be deemed useful for patrons, as they are tailored to their specific needs, however, they can also be time consuming for the librarians. Therefore, it is important to evaluate this service, and assess its impact in order to ensure that the users are getting the most out of their sessions. The purpose of this paper is to gather information on the evaluation and assessment tools that Canadian institutions are using to obtain feedback, measure their impact and improve their consultation services. Design/methodology/approach A bilingual (French and English) web-based questionnaire was issued, with a generic definition of IRCs provided. The questionnaire included general demographics and background information on IRC practices among Canadian academic librarians, followed by reflective questions on the assessment process of such practices. The questionnaire was sent to Canadian academic librarians via e-mail, using professional librarian associations’ listservs, and Twitter was used for dissemination as well. Findings Major findings of the survey concluded that the disciplines of health sciences and medicine, as well as the arts and humanities are the heaviest users of the IRC service model. On average, these sessions are one hour in length, provided by librarians who often require advanced preparation time to adequately help the user, with infrequent follow-up appointments. It was not surprising that a lack of assessment methods for IRCs was identified among Canadian academic libraries. Most libraries have either no assessment in place for IRCs, or they rely heavily on informal feedback from users, comments from faculty members and so on. A small portion of libraries use usage statistics to assess their IRCs service, but other means of assessment are practically non-existent. Research limitations/implications The survey conducted was only distributed to Canadian academic libraries. Institutions across the USA and other countries that also perform IRCs may have methods for evaluating and assessing these sessions which the authors did not gather; therefore, the evidence is biased. As well, each discipline approaches IRCs very differently; therefore, it is challenging to compare the evaluation and assessment methods between each discipline. Furthermore, the study’s population is unknown, as the authors did not know the exact number of librarians or library staff providing IRCs by appointment in academic Canadian institution. While the response rate was reasonably good, it is impossible to know if the sample is representative of the population. Also, it needs to be acknowledged that the study is exploratory in nature as this is the first study solely dedicated at examining academic librarians’ IRC practices. Further research is needed. As future research is needed to evaluate and assess IRCs with an evidence-based approach, the authors will be conducting a pre-test and post-test to assess the impact of IRC on students’ search techniques. Originality/value Evidence-based practice for IRCs is limited. Very few studies have been conducted examining the evaluation and assessment methods of these sessions; therefore, it was believed that a “lay of the land,” so to speak, was needed. The study is exploratory in nature, as this is the first study solely dedicated at examining the evaluation and assessment methods of academic librarians’ IRC practices.


2014 ◽  
Vol 100 (4) ◽  
pp. 8-16 ◽  
Author(s):  
André F. De Champlain ◽  
Cindy Streefkerk ◽  
Marguerite Roy ◽  
Fang Tian ◽  
Sirius Qin ◽  
...  

ABSTRACT One of the routes for entry into practice for international medical graduates (IMGs) in Canada entails completing some form of an in-practice assessment program. The latter route is referred to as practice ready assessment and is the focus of the present investigation. A pan-Canadian practice ready assessment process is currently being designed to evaluate IMGs' practice readiness. The selection of candidates who will not only have the highest likelihood of successfully completing the practice-ready assessment program but who will also attain specialty certification is of paramount importance. Our study focused on assessing how well practice-ready assessment candidates' performance on Medical Council of Canada (MCC) examinations and four demographic variables could predict both their score and pass fail status on the College of Family Physicians' (CFPC) certification examination. Data from 132 practice-ready assessment candidates were analyzed and indicate that MCC Qualifying Examination Part 1 scores, gender and age were significant predictors of both pass/fail status (p<0.05) as well as scores (p<0.01) on the short-answer management problems component of the family medicine certification examination. This study provides initial validity evidence for using the MCCQE Part I as a selection tool for practice-ready assessment. Practice-ready assessment programs across Canada might consider adopting the set of standardized predictors examined in this investigation, in addition to other measures, in an effort to better promote a pan-Canadian model.


2013 ◽  
Vol 5 (2) ◽  
pp. 69-83 ◽  
Author(s):  
Ruth Fassinger ◽  
Susan L. Morrow

Various research methods can be appropriate for social justice aims. Quantitative, qualitative, and mixed-method approaches offer different kinds of strengths in advancing a social justice agenda. This article recaptures and expands upon the ideas presented by the authors of this special issue, recommending best practices in research for social justice in the following areas: (a) cultural competence and the role of the researcher(s); (b) formulating the focus of the research; (c) selection of the underlying paradigm and research method/design; (d) the research team: formation, process, and issues of power; (e) power and relationship with research participants; and (f) data gathering, analysis, and reporting.


2016 ◽  
Vol 5 (3) ◽  
pp. 216
Author(s):  
Soraya Soraya ◽  
Zulham Al Farizi

Educators accountants have a significant role in the education world. This paper aims to gain a better understanding and in-depth information on the aspects that make up the women’s options for a career as an accountant educators. Further goal is to explaining the selection of women’s careers as educators accountant in perspective Simone de Beauvoir. This paper used a qualitative approach. Researcher also conducted narrative researchers through in-depth interviews to the 7 (seven) women in the Department of Accounting Faculty of Economics and Business, University of Tanjungpura Pontianak. From the interviews, founded are six aspects that make up the women’s options for a career as an accountant educators. These six aspect are the job opportunity (vacancies), time work flexibility, family background, meeting many people (students), childhood dream, and knowledge sharing. From these six aspect of the career choice, job opportunity (vacancies) and time flexibility aspect are the most disclosed widely aspect in choosing a career as an accountant educators. In addition, Simone de Beauvoir perspective can not explain the selection of women’s careers as educators accountant. 


Sign in / Sign up

Export Citation Format

Share Document