scholarly journals Funders’ responsibility to ensure value in research: a self-audit by the Health Research Board Ireland

2021 ◽  
Vol 4 ◽  
pp. 35
Author(s):  
Anne Cody ◽  
Maura Hiney ◽  
Patricia Clarke ◽  
Mairead O'Driscoll

As a public funder of health research, the Health Research Board (HRB) Ireland has an obligation to manage its funds well and to maximise the value of the research that it funds. Ways in which research funding can be wasted have been examined by researchers over the years, and a seminal series on research waste was published in the Lancet in 2014. The series systematically analysed every step of the funding lifecycle in five major stages and made recommendations to various actors including research funders. Prompted by its participation in the Ensuring Value in Research Funders’ Forum, between June and October 2019 the HRB undertook a self-audit against the 17 recommendations identified in the Lancet series. Key HRB staff collated relevant policies and practices regarding each recommendation and sub-recommendation and assessed the HRB’s performance under each heading. The self-assessment reflects the state of HRB policies and practices in October 2019.  Of the 17 recommendations, five were found to be areas of strength and six were found to be areas of partial strength. Areas of strength reflect work over many years such as support for evidence synthesis, strong processes around award selection, driving research integrity and open data including an HRB-funded open publishing platform. Four recommendations were found to be areas for growth. These mostly revolve around real time reporting of study protocols and of ongoing funded research outside of clinical trials. Work is progressing to address some of these areas. Two were found not to apply to the HRB.

2021 ◽  
Vol 4 ◽  
pp. 35
Author(s):  
Anne Cody ◽  
Maura Hiney ◽  
Patricia Clarke ◽  
Mairead O'Driscoll

As a public funder of health research, the Health Research Board (HRB) Ireland has an obligation to manage its funds well and to maximise the value of the research that it funds. Ways in which research funding can be wasted have been examined by researchers over the years, and a seminal series on research waste was published in the Lancet in 2014. The series systematically analysed every step of the funding lifecycle in five major stages and made recommendations to various actors including research funders. Prompted by its participation in the Ensuring Value in Research Funders’ Forum, between June and October 2019 the HRB undertook a self-audit against the 17 recommendations and 35 sub-recommendations identified in the Lancet series. Key HRB staff collated relevant policies and practices regarding each recommendation and sub-recommendation and assessed the HRB’s performance under each heading. The self-assessment reflects the state of HRB policies and practices in October 2019. Of the 17 recommendations, two were found not to apply to the HRB. Of the remaining 15 recommendations covering 33 sub-recommendations, five were found to be areas of strength and six were found to be areas of partial strength. These 11 recommendations encompass 22 sub-recommendations. Areas of strength reflect work over many years such as support for evidence synthesis, strong processes around award selection, driving research integrity and open data including an HRB-funded open publishing platform. Four recommendations were found to be areas for growth. These mostly revolve around real time reporting of study protocols and of ongoing funded research outside of clinical trials. Work is progressing to address some of these areas.


Neurology ◽  
2021 ◽  
pp. 10.1212/WNL.0000000000012424
Author(s):  
Heather L. Thompson ◽  
Ann Blanton ◽  
Barbara Franklin ◽  
Vanessa L. Merker ◽  
Kevin H. Franck ◽  
...  

Objective:To systematically evaluate published patient-reported outcome measures for the assessment of hearing function and hearing-related quality of life, and subsequently recommend measures selected by the Response Evaluation in Neurofibromatosis and Schwannomatosis International Collaboration (REiNS) as endpoints for clinical trials in Neurofibromatosis Type 2.Methods:The REiNS patient-reported outcomes working group systematically evaluated published patient-reported outcome measures of (1) hearing function and (2) hearing-related quality of life for individuals with hearing loss of various etiologies using previously published REiNS rating procedures. Ten measures of hearing functioning and 11 measures of hearing-related quality of life were reviewed. Measures were numerically scored and compared primarily on their participant characteristics (including participant age range and availability of normative data), item content, psychometric properties, and feasibility for use in clinical trials.Results:The Self-Assessment of Communication and the Self-Assessment of Communication-Adolescent were identified as most useful for adult and pediatric populations with NF2, respectively, for the measurement of both hearing function and hearing-related quality of life. Measures were selected for their strengths in participant characteristics, item content, psychometric properties, and feasibility for use in clinical trials.Conclusions:Currently, REiNS recommends the Self-Assessment of Communication adult and adolescent forms for the assessment of patient-reported hearing function and hearing-related quality of life for clinical trials for neurofibromatosis type 2. Further work is needed to demonstrate the utility of these measures in evaluating pharmacological and/or behavioral interventions.


F1000Research ◽  
2019 ◽  
Vol 8 ◽  
pp. 288
Author(s):  
Evelyn P. Whitlock ◽  
Joe V. Selby ◽  
Kelly M. Dunham ◽  
Alicia Fernandez ◽  
Laura P. Forsythe ◽  
...  

International experts have recommended actions that funders can take to improve the value of research investments. They state that self-assessment and public sharing are the basis for accountability and improvement. We examined our policies and practice to determine the extent to which the Patient-Centered Outcomes Research Institute’s (PCORI) policies and practices as a research funder align with international best practice recommendations. A self-audit of current policies and practice against 17 recommendations and 35 sub-recommendations representing five major stages of research production, based on adapted methods used for self-assessment by another funder, was performed.  Fit of existing PCORI policies and practices with 35 sub-recommendations, qualitative assessment of adequacy (area of strength; area of partial strength; area of growth; not applicable) for 17 recommendations for five stages of research production was assessed. Of the 17 recommendations, 15 were applicable to PCORI’s research mission and focus.  PCORI has policies and practices in place for all elements of six recommendations (“area of strength”) and policies that address each element but with some still in active development for three (“area of partial strength”). PCORI is partially addressing six of the 15 relevant recommendations (“area of growth”). Areas for growth include making study protocols publicly available, improving policies on data sharing, and enhancing collaboration with other funders to reduce redundant funding. A voluntary consortium of international funders is underway to encourage further progress, including additional self-assessment and public sharing for accountability. These findings indicate PCORI has undertaken efforts to align its funding practices with international recommendations to ensure the value of public dollars invested in research.  Further efforts will likely require additional coordination and collaboration between funders and stakeholders.


2021 ◽  
Author(s):  
Maia Salholz-Hillel ◽  
Daniel Strech ◽  
Benjamin Gregory Carlisle

AbstractObjectiveTo evaluate links between registration and publication across clinical trials led by German university medical centers (UMCs) and registered in either ClinicalTrials.gov or the German Clinical Trials Registry (DRKS). Inadequate links make trial publications and registrations less findable and compromise evidence synthesis and health policy decision making. The World Health Organization (WHO) and others call for better adoption of this straightforward transparency practice.DesignCross-sectional bibliographic studySettingGerman UMC clinical trialsMethodsWe used automated strategies to download and extract data from trial registries, PubMed, and trial publications for a cohort of all registered, published clinical trials conducted across German UMCs and completed between 2009 and 2017. We implemented regular expressions to detect and classify publication identifiers (DOI and PMID) in registrations, and trial registrations numbers (TRNs) in publication metadata, abstract, and full-text.Main outcome measuresThe proportion of trial registrations that reference a known results publication. The proportion of results publications that report the known TRN in the metadata, abstract, and full-text.Secondary analysesWe constructed exploratory logistic regression models to investigate the relationship between trial completion date, registry, and registration-publication linking.ResultsOnly 20% (373/1,895) of trials have a linked publication (DOI or PMID) in the registration as well as the TRN in the publication full-text, abstract, and metadata, and only 25% (477) of trials met the CONSORT and ICMJE guidelines to include TRNs in both the full-text and the abstract. 17% (327) of trials had no links. The most common link was TRN reported in the full-text (60%, 1,137). ClinicalTrials.gov trials were overall better linked than DRKS trials, and this difference appears to be driven by PubMed and registry infrastructure, rather than by trialists. Of trials reporting a TRN in the abstract, trials in ClinicalTrials.gov were more likely than trials in DRKS to have the TRN captured in the PubMed metadata. Most (78%, 662/849) ClinicalTrials.gov registrations with a publication link were automatically indexed from PubMed metadata, which is not possible in DRKS.ConclusionGerman UMCs have not comprehensively linked trial registrations and publications by both including a structured reference to the publication in the registration, and reporting TRNs in results publications. In addition to improved linking by trialists, changes in the PubMed TRN capturing process (such as automated strategies like those developed in this study) and automated indexing of publications in DRKS would make trial registrations and results more findable.Open Data and CodeAll code and the final analysis data for this study are available at https://github.com/maia-sh/reg-pub-link. Raw data is available at https://github.com/maia-sh/intovalue-data.


F1000Research ◽  
2019 ◽  
Vol 8 ◽  
pp. 288
Author(s):  
Evelyn P. Whitlock ◽  
Joe V. Selby ◽  
Kelly M. Dunham ◽  
Alicia Fernandez ◽  
Laura P. Forsythe ◽  
...  

International experts have recommended actions that funders can take to improve the value of research investments. They state that self-assessment and public sharing are the basis for accountability and improvement. We examined our policies and practice to determine the extent to which the Patient-Centered Outcomes Research Institute’s (PCORI) policies and practices as a research funder align with international best practice recommendations. A self-audit of current policies and practice against 17 recommendations and 35 sub-recommendations representing five major stages of research production, based on adapted methods used for self-assessment by another funder, was performed.  Fit of existing PCORI policies and practices with 35 sub-recommendations, qualitative assessment of adequacy (area of strength; area of partial strength; area of growth; not applicable) for 17 recommendations for five stages of research production was assessed. Of the 17 recommendations, 15 were applicable to PCORI’s research mission and focus.  PCORI has policies and practices in place for all elements of six recommendations (“area of strength”) and policies that address each element but with some still in active development for three (“area of partial strength”). PCORI is partially addressing six of the 15 relevant recommendations (“area of growth”). Areas for growth include making study protocols publicly available, improving policies on data sharing, and enhancing collaboration with other funders to reduce redundant funding. A voluntary consortium of international funders is underway to encourage further progress, including additional self-assessment and public sharing for accountability. These findings indicate PCORI has undertaken efforts to align its funding practices with international recommendations to ensure the value of public dollars invested in research.  Further efforts will likely require additional coordination and collaboration between funders and stakeholders.


2019 ◽  
Vol 17 (1) ◽  
pp. 99-105 ◽  
Author(s):  
O’Mareen Spence ◽  
Kyungwan Hong ◽  
Richie Onwuchekwa Uba ◽  
Peter Doshi

Background: To improve reporting transparency and research integrity, some journals have begun publishing study protocols and statistical analysis plans alongside trial publications. We sought to assess the overall availability and characteristics of protocols and statistical analysis plans of randomized clinical trials published in the top five (by impact factor) general medicine journals. Methods: All randomized clinical trials published in Annals of Internal Medicine, BMJ, JAMA, Lancet, and NEJM in 2016 were identified. For each randomized clinical trial, we searched for protocols and statistical analysis plans on journal websites (including supplementary material) and in the article, for example, a referenced publication or link to trial or institutional website. Characteristics of randomized clinical trials were extracted from the publication and clinical trial registry. A detailed assessment of protocols and statistical analysis plans was conducted in a 20% random sample of randomized clinical trials. Results: Protocols were available for 299 (82%) trials, ranging from 50% in BMJ to >95% in NEJM and JAMA. Statistical analysis plans were available for 182 (50%) trials and varied from <10% for Annals of Internal Medicine, BMJ, and Lancet to 92% for NEJM. Of the 76 randomized clinical trials in the 20% random sample, 63 (83%) had a protocol but less than half (31; 44%) included an a priori (dated prior to patient enrollment) version of the protocol. Statistical analysis plans were available for 35 (46%) trials, and only 5 (7%) included an a priori version. Conclusion: Protocols and statistical analysis plans are publicly available for the majority of trials. However, the a priori versions of these documents are only available for a minority of trials. More attention must be paid to ensuring the public availability of a priori versions.


2019 ◽  
Vol 14 (1) ◽  
Author(s):  
Siti Ulfah

The purposes of this reasearch are 1) describing the efforts of increasing the elementary school of Turusgede teachers pedagogic competence at the first semester of 2018/2019 academic year in opening and closing the learning by using the self assessment technique and 2) analysing the increase of the elementary school of Turusgede teachers pedagogic competence at the first semester of 2018/2019 academic year in opening and closing the learning by using the self assessment technique. This research is School Action Research (SAR). This research is taken palce in elementary school of Turusgede, Subdistrict of Rembang, Regency of Rembang. The time of this research is the early-middle first semester of 2018/2019 academic year. The subjects of this research are teachers in the elementary school of Turusgede, Subdistrict of Rembang, Regency of Rembang, consist of twelve teachers. The data of this research is teachers pedagogic competence in opening and closing the learning. The techniques of collecting data are using nontest technique and test technique. The tools of collecting data are using the sheets of observation, camera application on hand phone and the form of self assessment. The technique of analizing data in this research is decriptive comparation. The procedure of this research is using Cycle Model, consist of four steps: planning, action, observation and reflection. Each cycle is going on one week. The results of this research are 1) the academic supervision with self assessment technique is previously sharing the form of self assessment to the subjects of this research, 2) self assessment technique is self assessment according to the next theme and matter, 3) self assessment technique is self assessment after the learning finish and 4) teachers pedagogic competence with self assessment technique is increasing and including good category (B) that according with the result of observation and including very good category (A) that according with the result of self assessment. Key words: Pedagogic, Supervision, Self Assessment Technique.


Author(s):  
Milen Dimov

The present study traces the dynamics of personal characteristics in youth and the manifested neurotic symptoms in the training process. These facts are the reason for the low levels of school results in the context of the existing theoretical statements of the problem and the empirical research conducted among the trained teenagers. We suggest that the indicators of neurotic symptomatology in youth – aggression, anxiety, and neuroticism, are the most demonstrated, compared to the other studied indicators of neurotic symptomatology. Studies have proved that there is a difference in the act of neurotic symptoms when tested in different situations, both in terms of expression and content. At the beginning of the school year, neurotic symptoms, more demonstrated in some aspects of aggressiveness, while at the end of school year, psychotism is more demonstrated. The presented summarized results indicate that at the beginning of the school year, neurotic symptoms are strongly associated with aggression. There is a tendency towards a lower level of social responsiveness, both in the self-assessment of real behavior and in the ideal “I”-image of students in the last year of their studies. The neurotic symptomatology, more demonstrated due to specific conditions in the life of young people and in relation to the characteristics of age.


Author(s):  
Vasiliy Dvortsov ◽  
Alexander Efimenko

В статье предпринята попытка теоретического анализа и изучения научной литературы по организации и становлению воспитательной работы с осужденными в местах лишения свободы, продемонстрирована взаимосвязь между политико-воспитательной работой, ресоциализацией и исправлением осужденных в пенитенциарных учреждениях. Проведенное исследование позволяет предполагать, что воспитательная работа является основополагающим средством исправления различных категорий осужденных (регламентировано ст. 9 УИК РФ). На этой основе критерием исправления будет становиться устойчивое правопослушное поведение человека. В связи с этим возникает необходимость использования психолого-педагогической программы по перестройке и самооценке осужденных, позволяющей формировать их готовность к самореализации, когда осознание совершенных преступлений становится внутренне неприемлемым. Авторами отмечается, что, самоисправление человека зависит от ряда направлений воспитательной работы: нравственного, правового, физического воспитания, получения основного общего образования, получения профессии. Очевидно, что для закрепления положительного результата процесс ресоциализации в пенитенциарных учреждениях должен проводиться сотрудниками всех отделов и служб на основе комплексных программ, разработанных с учетом специфики и возраста осужденных.The article attempts a theoretical analysis and study of scientific literature on the organization and formation of educational work with convicts in prisons, demonstrates the relationship between «political and educational work», re-socialization and correction of convicts in prisons. The study suggests that educational work is a fundamental means of correcting various categories of convicts (regulated by article 9 of the criminal code). Based on this criterion fixes will become sustainable human behavior, demonstrating a conscious rejection of the violation of legal norms with the aim of securing sustainable patterns of law-abiding behavior. There is a need to use the psychological and pedagogical Program for restructuring and self-assessment of convicts, which allows to form on this basis their readiness for self-realization, when the awareness of the crimes committed becomes internally unacceptable. In this regard, the self-correction of a person depends on a number of areas, namely, moral, legal, physical education, basic General education, profession, forming the basis of educational work. It is obvious that in order to consolidate a positive result in penitentiary institutions, the activities of all departments and services should be carried out a process of re-socialization on the basis of comprehensive Programs developed taking into account the specifics and different ages of convicts.


Sign in / Sign up

Export Citation Format

Share Document