scholarly journals CPRTM: Adopting An Out-Of-Discipline Innovation

2011 ◽  
Vol 4 (1) ◽  
pp. 65
Author(s):  
Kay E. Strong

Calibrated Peer Review (CPR) is a web-based instructional tool that encourages writing gain for students without adding grading pain for the instructor! The use of CPR provides students frequent opportunities to hone both writing as well as peer review skills in a guided environment. And once an assignment is authored, instructors have little to do beside monitor progress and arbitrate possible grading complaints! The four phase process of the Calibrated Peer Review reinforces learning of the content material and provides immediate assessment feedback. Students access the assignment by logging into CPR. Phase one involves the preparation and submission of the students text response to the writing assignment. During phase two the student evaluates three instructor written calibrations (high quality, mid quality and low quality) of the same assignment using pre-specified rubrics assessing content and style. An unsuccessful outcome prompts a return to the calibrations and a retry. A successful outcome moves the student forward into phase three. The software randomly selects three anonymous peer assignments. Using the same evaluation criteria the student assesses each assignment. At phase four, the student is presented his/her own assignment for self-review. Time limits at each phase insure timely completion of the assignment in full. The CPR tool provides immediate feedback on student performance at each phase. At the conclusion the CPR tool produces a complete set of results corresponding to performance at each phase; a score for the text entry, a score for the three calibrations, a score for the three peer reviews, a self-assessment score and concluding overall score. To bypass problems commonly associated with students reviewing student work, CPR has built in a set of weighting factors based on standard deviations which are reflected in the students own scores. Given its discipline-independent nature, Calibrated Peer Review makes an excellent instructional management tool to encourage students to read for content, master the content, write-to-learn, as well as, critically review writing.

2002 ◽  
Vol 26 (3) ◽  
pp. 174-184 ◽  
Author(s):  
Nancy J. Pelaez

The aim of this study was to determine whether problem-based writing with peer review (PW-PR) improves undergraduate student performance on physiology exams. Didactic lectures were replaced with assignments to give students practice explaining their reasoning while solving qualitative problems, thus transferring the responsibility for abstraction and generalization to the students. Performance on exam items about concepts taught using PW-PR was compared with performance on concepts taught using didactic lectures followed by group work. Calibrated Peer Review™, a Web-delivered program, was used to collect student essays and to manage anonymous peer review after students “passed” three calibration peer reviews. Results show that the students had difficulty relating concepts. Relationship errors were categorized as 1) problems recognizing levels of organization, 2) problems with cause/effect, and 3) overgeneralizations. For example, some described cells as molecules; others thought that vesicles transport materials through the extracellular fluid. With PW-PR, class discussion was used to confront and resolve such difficulties. Both multiple-choice and essay exam results were better with PW-PR instead of lecture.


2005 ◽  
Vol 80 (Supplement) ◽  
pp. S67-S70 ◽  
Author(s):  
Teresita McCarty ◽  
Marie V. Parkes ◽  
Teresa T. Anderson ◽  
Jan Mines ◽  
Betty J. Skipper ◽  
...  

2016 ◽  
Vol 15 (4) ◽  
pp. ar51 ◽  
Author(s):  
K. F. Weaver ◽  
V. Morales ◽  
M. Nelson ◽  
P. F. Weaver ◽  
A. Toledo ◽  
...  

This study examines the relationship between the introduction of a four-course writing-intensive capstone series and improvement in inquiry and analysis skills of biology senior undergraduates. To measure the impact of the multicourse write-to-learn and peer-review pedagogy on student performance, we used a modified Valid Assessment of Learning in Undergraduate Education rubric for Inquiry and Analysis and Written Communication to score senior research theses from 2006 to 2008 (pretreatment) and 2009 to 2013 (intervention). A Fisher-Freeman-Halton test and a two-sample Student’s t test were used to evaluate individual rubric dimensions and composite rubric scores, respectively, and a randomized complete block design analysis of variance was carried out on composite scores to examine the impact of the intervention across ethnicity, legacy (e.g., first-generation status), and research laboratory. The results show an increase in student performance in rubric scoring categories most closely associated with science literacy and critical-thinking skills, in addition to gains in students’ writing abilities.


2021 ◽  
Vol 14 (3) ◽  
pp. 139
Author(s):  
José Ruiz-Canela López

Operational risk is defined as the potential losses resulting from events caused by inadequate or failed processes, people, equipment, and systems or from external events. One of the most important challenges for the management of the company is to improve its results through its operational risk identification and evaluation. Most of Enterprise Risk Management (ERM) scholarship has roots in the finance/risk management and insurance (RMI) discipline, mainly in the banking sector. This study proposes an innovative operational risk assessment methodology (OpRAM), to evaluate operational risks focused on telecommunications companies (TELCOs), on the basis of an operational risk self-assessment (OpRSA) process and method. The OpRSA process evaluates operational risks through a quantitative analysis of estimates which inputs are the economic impact and the probability of occurrence of events. The OpRSA method is the “engine” for calculating the economic risk impact, applying actuarial techniques, which allow estimation of unexpected losses and expected losses distributions in a TELCO. The results of the analyzed business unit in the field work were compared with standardized ratings (acceptable, manageable, critical, or catastrophic), and contrasted against the company’s managers, proving that the OpRSA framework is a reliable and useful management tool for the business, and leading to more research in other sectors where operational risk management is key for the company success.


Author(s):  
Jadranka Stojanovski ◽  
Elías Sanz-Casado ◽  
Tommaso Agnoloni ◽  
Ginevra Peruginelli

The field of law has retained its distinctiveness regarding peer review to this day, and reviews are often conducted without following standardized rules and principles. External and independent evaluation of submissions has recently become adopted by European law journals, and peer review procedures are still poorly defined, investigated, and attuned to the legal science publishing landscape. The aim of our study was to gain a better insight into current editorial policies on peer review in law journals by exploring editorial documents (instructions, guidelines, policies) issued by 119 Croatian, Italian, and Spanish law journals. We relied on automatic content analysis of 135 publicly available documents collected from the journal websites to analyze the basic features of the peer review processes, manuscript evaluation criteria, and related ethical issues using WordStat8. Differences in covered topics between the countries were compared using the chi-square test. Our findings reveal that most law journals have adopted a traditional approach, in which the editorial board manages mostly anonymized peer review (104, 77%) engaging independent/external reviewers (65, 48%). Submissions are evaluated according to their originality and relevance (113, 84%), quality of writing and presentation (94, 70%), comprehensiveness of literature references (93, 69%), and adequacy of methods (57, 42%). The main ethical issues related to peer review addressed by these journals are reviewer’s competing interests (42, 31%), plagiarism (35, 26%), and biases (30, 22%). We observed statistically significant differences between countries in mentioning key concepts such as “Peer review ethics”, “Reviewer”, “Transparency of identities”, “Publication type”, and “Research misconduct”. Spanish journals favor reviewers’ “Independence” and “Competence” and “Anonymized” peer review process. Also, some manuscript types popular in one country are rarely mentioned in other countries. Even though peer review is equally conventional in all three countries, high transparency in Croatian law journals, respect for research integrity in Spanish ones, and diversity and inclusion in Italian are promising indicators of future development.


2021 ◽  
pp. 318-333
Author(s):  
Oleksandra Markiv

The main purpose of the study predetermines the main issue of the article: to show the importance of formation of a culture of working with information among students during distance learning, which means the ability to evaluate, perceive information, prevent manipulation, distinguish truth from falsehood. The main task is to assess the existing and desired level of this competence, to develop an organizational model of its formation which consists of the following components: goals and objectives, pedagogical conditions and evaluation criteria. The model was implemented simultaneously at the Drahomanov National Pedagogical University and National Technical University of Ukraine “Igor Sikorsky Kyiv Polytechnic Institute” by teachers of humanities in experimental and control groups (16 people) in three stages: ascertaining, formative and final. A questionnaire and a self-assessment map of the formation of the culture of working with information were developed for the ascertaining stage; purposeful work with students was conducted (special tasks, discussion conversations, discussions) at the formative stage the results before and after the experiment were compared at the final stage in particular. Positive dynamics in the experimental group was noted, the average rate of formation increased. The proposed evaluation criteria – motivational, cognitive and activity ones have demonstrated practical value. It is advisable to recommend their use at other faculties. It is concluded that the organizational model is effective. The prospect of the study is the scientific substantiation of the implementation of the model among a wider range of students and the development of a distance specialized course.


Sign in / Sign up

Export Citation Format

Share Document