scholarly journals Individual versus general structured feedback to improve agreement in grant peer review: a randomized controlled trial

2021 ◽  
Vol 6 (1) ◽  
Author(s):  
Jan-Ole Hesselberg ◽  
Knut Inge Fostervold ◽  
Pål Ulleberg ◽  
Ida Svege

Abstract Background Vast sums are distributed based on grant peer review, but studies show that interrater reliability is often low. In this study, we tested the effect of receiving two short individual feedback reports compared to one short general feedback report on the agreement between reviewers. Methods A total of 42 reviewers at the Norwegian Foundation Dam were randomly assigned to receive either a general feedback report or an individual feedback report. The general feedback group received one report before the start of the reviews that contained general information about the previous call in which the reviewers participated. In the individual feedback group, the reviewers received two reports, one before the review period (based on the previous call) and one during the period (based on the current call). In the individual feedback group, the reviewers were presented with detailed information on their scoring compared with the review committee as a whole, both before and during the review period. The main outcomes were the proportion of agreement in the eligibility assessment and the average difference in scores between pairs of reviewers assessing the same proposal. The outcomes were measured in 2017 and after the feedback was provided in 2018. Results A total of 2398 paired reviews were included in the analysis. There was a significant difference between the two groups in the proportion of absolute agreement on whether the proposal was eligible for the funding programme, with the general feedback group demonstrating a higher rate of agreement. There was no difference between the two groups in terms of the average score difference. However, the agreement regarding the proposal score remained critically low for both groups. Conclusions We did not observe changes in proposal score agreement between 2017 and 2018 in reviewers receiving different feedback. The low levels of agreement remain a major concern in grant peer review, and research to identify contributing factors as well as the development and testing of interventions to increase agreement rates are still needed. Trial registration The study was preregistered at OSF.io/n4fq3.

2018 ◽  
Vol 5 (3) ◽  
pp. 1041 ◽  
Author(s):  
Chandrashekar Reddy J. Madinur ◽  
Prashant Tubachi ◽  
Prashant Tubachi ◽  
A. S. Godhi ◽  
A. S. Godhi

Background: The primary function of the skin is to serve as a protective barrier against the environment. The process of wound healing constitutes an array of interrelated and concomitant events. Understanding these processes and various factors affecting these processes continue to expand. The present study was undertaken to compare and evaluate the effect of piroxicam versus diclofenac on wound healing in clean abdominal wounds.Methods: The present one year randomized controlled trial was conducted on all the patients undergoing appendicectomies for uncomplicated appendicitis and uncomplicated inguinal hernia repairs in the Department of Surgery, KLES Dr. Prabhakar Kore Hospital and Medical Research Centre, Belgaum during the period of one year. Based on the thumb rule a total of 60 patients divided into two groups of 30 each were studied. Based on the computer-generated randomization patients were allocated to two groups that is group A (Inj. Piroxicam) and Group B (Inj. Diclofenac).Results: In the present study, males outnumbered females with male to female ratio between of 1.72 to 2:1. The mean age in group A was30.9±7.86 years and in group B it was 30.3±7.97 years. Both the groups that is Group A and B were graded under grade I (Good wound healing) from the POD 3 onwards. Overall the individual score and total scores had no influence of the final grading (outcome) of the wound.Conclusions: Overall, better results were seen on wound healing in patients who received Inj piroxicam with significantly less post-operative redness and edema. However, this did not have significant difference in the final outcome of the grading of the wound. 


Author(s):  
Udayanila Thangavel ◽  
Harish Narasing Katakdhond ◽  
Deepak Dalmia ◽  
Narsinha Davange ◽  
Parth Patni ◽  
...  

<p class="abstract"><strong>Background:</strong> Otosclerosis presents as conductive hearing loss, stapedotomy is the treatment for otosclerosis, and different sizes of piston diameter are available for the procedure. Aims and objectives were to study and compare hearing improvement between the 0.4 and 0.6 mm sizes of teflon piston in stapedotomy.</p><p class="abstract"><strong>Methods:</strong> It was a prospective randomized controlled trial. Patients fulfilling inclusion criteria were subjected for small fenestra stapedotomy. Patients were divided into two groups after randomization into group A (with 0.4 mm piston diameter) and group B (with 0.6 mm piston diameter). The hearing outcome with standard audiological assessment was performed at one month and six months postoperatively.  </p><p class="abstract"><strong>Results:</strong> Comparison of 1 month AB gap among the patients with 0.4 mm piston and 0.6 mm piston showed that there was no statistically significant difference among both the groups of patients (independent t test p value=0.699). Comparison of 6 month AB gap among the patients with 0.4 mm piston and 0.6 mm piston showed that there was no statistically significant difference among both the groups of patients (independent t test p value=0.54).</p><p class="abstract"><strong>Conclusions:</strong> There was no significant difference in hearing improvement among the individual methods (piston size 0.4 and 0.6) with each other both in 1 month post-operative and 6 month post-operative follow up. Hence, we conclude that there is no relevance of different diameter of teflon piston prosthesis (0.4 mm versus 0.6 mm) as far as hearing outcome is concerned.</p>


2004 ◽  
Vol 28 (1) ◽  
pp. 22-27 ◽  
Author(s):  
K. R. Woodburn ◽  
S. Sockalingham ◽  
H. Gilmore ◽  
M. E. Condie ◽  
C. V. Ruckley

Background: A multicentre randomised controlled trial to determine the effect of a rigid plaster dressing applied at the time of trans-tibial amputation on the number of days to casting for a prosthesis, and the incidence of post-operative stump infection. Methods: Patients requiring trans-tibial amputation were randomised to one of 2 groups: In Group 1 (intervention) a rigid above-knee plaster dressing was applied at operation and patients were managed according to a standard protocol. Group 2 (control) had the individual surgeons' usual non-rigid dressing regime. Rehabilitation data were extracted from the national physiotherapy database. On completion of the trial a questionnaire was sent to all participants. Results: 14 surgeons in 7 centres enrolled 154 patients, with 96 ultimately cast for a prosthesis. Patients who received a rigid dressing (n=78) had reduced days to casting (median 36, confidence interval 30–47) when compared with other dressings (n=76) (median 42, confidence interval 36–45), these differences did not reach statistical significance. There was no significant difference in post-operative infection rates in the two groups. 64% of surgeons, and all physiotherapists and vascular nurses responding to the post-trial questionnaire felt that the rigid dressing was an improvement on their normal regime and wished to continue with the technique. Conclusions: Despite a median reduction of 6 days in time to casting in patients treated with a rigid post-operative dressing this failed to reach statistical significance: The majority of participants who replied to the post-trial questionnaire expressed a wish to continue using the rigid dressing technique. To confirm that the trends shown in this trial are statistically valid a larger trial is needed.


2013 ◽  
pp. 133-144
Author(s):  
I Made Darma Oka, I Nyoman Winia I Made Darma Oka, I Nyoman Winia

Abstrak:Aplikasi multimedia dalam pembelajaran materi Tata Hidangan akan menjadi lebih menarik, karena materi yang disajikan lebih mudah dipahami mahasiswa karena dilengkapi dengan visualisasi baik statik maupun dinamik. Berdasarkan hasil analisis tentang persepsi mahasiswa terhadap modul Tata Hidangan pada Program Studi Perhotelan Politeknik Negeri Bali menunjukkan bahwa persepsi mahasiswa dalam ujicoba perseorangan diperoleh skor rata rata 83.56%, kelompok kecil rata-rata 85.28%, dan uji coba lapangan rata-rata 84.81%. Nilai tersebut memenuhi kriteria sangat layak dan tidak perlu direvisi. Terjadi perbedaan yang signifikan pada hasil belajar mahasiswa berdasarkan hasil pretes dan postes yang dilakukan, sehingga modul Tata Hidangan yang dikembangkan ini mampu meningkatkan kompetensi mahasiswa dalam melaksanakan kegiatan praktek di restoran. Kata kunci: Persepsi, mahasiswa, kompetensi, modul, tata hidangan.Abstract:Through multimedia application the food and beverage service instructional becomes more interesting since the material presented is more easily understood by students and it is equipped with both static and dynamic visualization. The result of the analysis on the student’s perception on the food and beverage service module of Hotel Study Program at Bali State Polytechnic showed that the perception of student in the individual tryout was at the average score of 83.56%, the small group was at the average score of 85.28%, and the field tryout was at the average score of 84.81%. The value met the requirements and does not need to be revised. There is a significant difference on the achievement of students based on the result of pre test and post test. Therefore the module of food and beverage service that has been developed is able to increase the competency of student in conducting the activities in restaurant.Key words: Perception, student, competency, module, food and beverages service.


2021 ◽  
Vol 11 (11) ◽  
pp. 91-99
Author(s):  
O. Suhonos

Down syndrome children need special attention. As long as the illness is often accompanied by mental disorders, there should be an individual approach to child in upbringing and education. This compels parents to adjust their rhythm of life in accordance with child's needs. Difficulties in raising a child with special needs can lead to a deterioration in the attitude of parents towards the child. This comes out in the behavior of parents and leaves an imprint on the psychological state of the child, his character and subsequent life. Materials and methods: 97 Down syndrome children were examined. All patients met the inclusion criteria. The patients' parents gave informed consent to the participation in the study. Down syndrome in children has been genetically verified. Patients were divided into two groups according to the criterion of ability to verbal communication: group 1 (G1) included 77 children capable of verbal communication, group 2 (G2) – 20 children who did not speak. Individualization in the most of both groups respondents was at an average level, which indicated sufficient parents’ acceptance of the individual characteristics of the child, sufficient attention to his interests, satisfaction with the time spent together. Cooperation did not show statistically significant differences in G1 and G2. The average score on this indicator did not differ in both groups (6.87±1.13 for G1, 6.75±1.10 for G2). Statistically significant difference between G1 and G2 was found in symbiosis (4.25±1.43 points against 5.10±1.55 points, respectively). Authoritarianism in G1 was 3.27±1.26 points, in G2 – 4.05±1.60 points, which corresponds to the average level of severity and means achieving a balance between giving the child freedom of action and the establishment of restrictions. Disability in G1 and G2 was 2.43±1.40 and 2.90±1.77, respectively, which corresponds to a low level of its severity: parents of Down syndrome children are generally not inclined to increase the defects of their children, regardless of their language skills.


2013 ◽  
Vol 203 (5) ◽  
pp. 334-340 ◽  
Author(s):  
Jim McCambridge ◽  
Marcus Bendtsen ◽  
Nadine Karlsson ◽  
Ian R. White ◽  
Per Nilsen ◽  
...  

BackgroundBrief interventions can be efficacious in changing alcohol consumption and increasingly take advantage of the internet to reach high-risk populations such as students.AimsTo evaluate the effectiveness of a brief online intervention, controlling for the possible effects of the research process.MethodA three-arm parallel groups design was used to explore the magnitude of the feedback and assessment component effects. The three groups were: alcohol assessment and feedback (group 1); alcohol assessment only without feedback (group 2); and no contact, and thus neither assessment nor feedback (group 3). Outcomes were evaluated after 3 months via an invitation to participate in a brief cross-sectional lifestyle survey. The study was undertaken in two universities randomising the email addresses of all 14910 students (the AMADEUS-1 study, trial registration: ISRCTN28328154).ResultsOverall, 52% (n = 7809) of students completed follow-up, with small differences in attrition between the three groups. For each of the two primary outcomes, there was one statistically significant difference between groups, with group 1 having 3.7% fewer risky drinkers at follow-up than group 3 (P = 0.006) and group 2 scoring 0.16 points lower than group 3 on the three alcohol consumption questions from the Alcohol Use Disorders Identification Test (AUDIT-C) (P = 0.039).ConclusionsThis study provides some evidence of population-level benefit attained through intervening with individual students.


2014 ◽  
Vol 2014 ◽  
pp. 1-8 ◽  
Author(s):  
Hanne Skarsholm ◽  
Henrik Stoevring ◽  
Bent Nielsen

Background. Numerous studies have been conducted with a view to developing strategies for improvement of medical compliance in patients with schizophrenia. All of the studies conducted so far have had an individual approach to compliance based on the assumption that noncompliance is determined individually due to inappropriate behavior in the patient. We conducted a pragmatic controlled trial with a system-oriented approach, to provide a new perspective on compliance and test the efficacy of a multifactorial intervention at the system level in a routine clinical setting, an approach that has not previously been used for the improvement of compliance.Methods. 30 patients were allocated to the system-oriented therapy and 40 patients were allocated to the reference intervention, which consisted of individually based compliance therapy. The follow-up period was six months. Primary endpoint was improvement in compliance, measured by improvement in a compliance scale specifically developed for the project.Results. When accounting for missing values with a multiple imputation approach, we found a tendency toward a difference in both the compliance scale and PANSS favoring the system-oriented therapy, although it did not reach statistical significance. A significant difference in incidence of adverse events and time to first readmission was found. Attrition rates were significantly higher in the reference group and nonsignificant among individuals with lower compliance, which may have diluted effect estimates. This was reflected by significant differences found in an analysis based on a last observation carried forward approach.Conclusion. This study suggests that compliance problems are better solved by a multifactorial intervention at the system level than at the individual level.


1976 ◽  
Vol 41 (4) ◽  
pp. 523-529 ◽  
Author(s):  
Daniel R. Boone ◽  
Harold M. Friedman

Reading and writing performance was observed in 30 adult aphasic patients to determine whether there was a significant difference when stimuli and manual responses were varied in the written form: cursive versus manuscript. Patients were asked to read aloud 10 words written cursively and 10 words written in manuscript form. They were then asked to write on dictation 10 word responses using cursive writing and 10 words using manuscript writing. Number of words correctly read, number of words correctly written, and number of letters correctly written in the proper sequence were tallied for both cursive and manuscript writing tasks for each patient. Results indicated no significant difference in correct response between cursive and manuscript writing style for these aphasic patients as a group; however, it was noted that individual patients varied widely in their success using one writing form over the other. It appeared that since neither writing form showed better facilitation of performance, the writing style used should be determined according to the individual patient’s own preference and best performance.


2020 ◽  
Vol 20 (2) ◽  
pp. 101-120
Author(s):  
Ayça Aktaç Gürbüz ◽  
Orçun YORULMAZ ◽  
Gülşah DURNA

Scientific research into the reduction of stigmatization, particularly related to specific problems such as Obsessive-Compulsive Disorder (OCD), is scarce. In the present study, we examine the impact of a video-based antistigma intervention program for OCD in a pretest-posttest control group research. After being randomly assigned to either an intervention (n= 101) or control group (n= 96), the participants reported their attitudes on a hypothetical case vignette before and after OCD vs. Multiple Sclerosis (MS) videos, and again six months later as a follow up assessment. The mixed design analyses for the group comparisons indicated that although there was no significant difference in the measures of the control group, the participants watching the anti-stigma OCD video, in which the focus was psychoeducation and interaction strategies, reported significantly lower scores on social distances and negative beliefs for the case vignettes they read, and this difference was maintained six months later. Then, the present results indicate the effectiveness of our anti-stigma intervention program for OCD. Interventions to reduce stigmatization can also be viewed as effective tools for changing the attitudes of people toward OCD, although further research and applications are needed related to specific disorders if a longlasting impact is to be achieved.


2020 ◽  
Vol 22 (1) ◽  
Author(s):  
Farokh Saljughi ◽  
Mitra Savabi-Esfahani ◽  
Shahnaz Kohan ◽  
Soheila Ehsanpour

Mother-infant attachment is an intimate, lasting and satisfying relationship that leads to better cognitive, emotional and social growth of the infant. The aim of this study was to determine the effects of breastfeeding training by role-play on mother-infant attachment behaviours. This research was a randomised clinical trial (parallel design). Inclusion criteria were: no history of mental disorders; ability to read and write the Persian language to complete the questionnaire; no history of drug and tobacco intake in primigravida women. The sample comprised 100 pregnant women (in 2 groups), selected through simple random sampling at healthcare centres. The researcher reviewed prenatal care registries of selected healthcare centres and extracted the names of pregnant women in their early third trimester. The data were imported into randomisation software. The control group received routine breastfeeding training, while the intervention group received routine training together with training through role-play. The data collection tool was the Maternal Behaviour Inventory Questionnaire. Consequently 75 samples were analysed in SPSS16. Independent t-tests and chi-square tests were used to examine the difference between the two groups. Results showed that the mean score of mother-infant attachment one week after delivery was significantly higher in the intervention group in comparison to that in the control group (p<0.001). No significant difference was observed between the two groups in maternal age, age of marriage, neonatal gender, maternal employment and education, number of parity, and number of abortions (P>0.05). Since breastfeeding training through role-play could affect mother-infant attachment, it is suggested that this type of training should be provided for pregnant women to promote mother-infant attachment and exclusive breastfeeding.


Sign in / Sign up

Export Citation Format

Share Document