Sustainable Water and Sanitation in Sierra Leone: Impact evaluation of the ‘Improved WASH Services in WAU and WAR Districts’ project

Between October 2016 and March 2019, the Freetown WASH Consortium, led by Oxfam with Against Hunger, Concern Worldwide and Save the Children as members, carried out the 'Improved WASH Services in Western Area Urban (WAU) and Western Area Rural (WAR) Districts' project. Broadly, the project aimed to improve the availability, accessibility, affordability and sustainability of integrated water, sanitation and hygiene (WASH) services, in alignment with the Government of Sierra Leone's national agenda on Ebola recovery and increased preparedness against possible future outbreaks. This Effectiveness Review evaluates the success of this project to increase the sustainability of water and sanitation systems and services. Using a quasi-experimental, mixed method evaluation design, impact is assessed among individuals, households and communities in intervention and comparison areas. Community-level factors contributing to better individual- and household-level outcomes are explored. Find out more by reading the full report now.

Evaluating and extending the Informed Consent Ontology for representing permissions from the clinical domain

The purpose of this study was to evaluate, revise, and extend the Informed Consent Ontology (ICO) for expressing clinical permissions, including reuse of residual clinical biospecimens and health data. This study followed a formative evaluation design and used a bottom-up modeling approach. Data were collected from the literature on US federal regulations and a study of clinical consent forms. Eleven federal regulations and fifteen permission-sentences from clinical consent forms were iteratively modeled to identify entities and their relationships, followed by community reflection and negotiation based on a series of predetermined evaluation questions. ICO included fifty-two classes and twelve object properties necessary when modeling, demonstrating appropriateness of extending ICO for the clinical domain. Twenty-six additional classes were imported into ICO from other ontologies, and twelve new classes were recommended for development. This work addresses a critical gap in formally representing permissions clinical permissions, including reuse of residual clinical biospecimens and health data. It makes missing content available to the OBO Foundry, enabling use alongside other widely-adopted biomedical ontologies. ICO serves as a machine-interpretable and interoperable tool for responsible reuse of residual clinical biospecimens and health data at scale.

Evaluating the Evolution of Social Networks: A Ten-Year Longitudinal Analysis of an Agricultural, Fishing and Forestry Occupational Health Research Center

As part of our evaluation of the NIOSH-funded Northeast Center for Occupational Health and Safety: Agriculture, Forestry and Fishing (NEC), we present methodology, findings and the potential implications of a sequential social network analysis (SNA) conducted over ten years. Assessing the effectiveness of the center’s scientific projects was our overarching evaluation goal. The evaluation design employed SNA to (a) look at changes to the center’s network over time by visualizing relationships between center collaborators annually, (b) document collaborative ties and (c) identify particularly strong or weak areas of the network. Transdisciplinary social network criteria were applied to the SNA to examine the collaboration between center personnel, their partners and the industry groups they serve. SNA participants’ perspectives on the utility of the SNA were also summarized to assess their interest in ongoing SNA measures. Annual installments of the SNA (2011–2020) showed an expansion of the network with a 30% increase in membership from baseline, as well as an increase in total relational ties (any type of contact). SNA measures also indicated significant increases in co-publication, cross-sector and transdisciplinary ties. Overall, SNA is an effective tool in visualizing and sustaining an occupational safety and health research and outreach network. Its utility is limited by how ties are characterized, grant cycle timeframes and how SNA metrics relate to productivity.

Conversations that Count: Lessons From Evaluating a Men’s Digital Mental Health Response During COVID-19

This paper details disruption and innovation in digital evaluation practice at Movember, as a result of the COVID-19 pandemic. The paper examines a men’s digital health intervention (DHI) – Movember Conversations – and the product pivot that was necessary to ensure it could respond to the pandemic. The paper focuses on the implications of the pivot for the evaluation and how the evaluation was adapted to the COVID-19 exigencies. It details the redesign of the evaluation to ensure methods wrapped around the modified product and could deliver real-time, practical insights. The paper seeks to fill knowledge gaps in the DHI evaluation space and outlines four key principles that support evaluation re-design in an agile setting. These include a user-centred approach to evaluation design, proportionate data collection, mixed (and flexible) methodologies, and agile evaluation reporting. The paper concludes with key lessons and reflections from the evaluators about what worked at Movember, to support other evaluators planning digital evaluations.

Evaluating the GO Programming Language with Design Patterns

<p>GO is a new object-oriented programming language developed at Google by Rob Pike, Ken Thompson, and others. GO has the potential to become a major programming language. GO deserves an evaluation. Design patterns document reoccurring problems and their solutions. The problems presented are programming language independent. Their solutions, however, are dependent on features programming languages provide. In this thesis we use design patterns to evaluate GO. We discuss GO features that help or hinder implementing design patterns, and present a pattern catalogue of all 23 Gang-of-Four design patterns with GO specific solutions. Furthermore, we present GoHotDraw, a GO port of the pattern dense drawing application framework JHotDraw. We discuss design and implementation differences between the two frameworks with regards to GO.</p>

Evaluating the GO Programming Language with Design Patterns

<p>GO is a new object-oriented programming language developed at Google by Rob Pike, Ken Thompson, and others. GO has the potential to become a major programming language. GO deserves an evaluation. Design patterns document reoccurring problems and their solutions. The problems presented are programming language independent. Their solutions, however, are dependent on features programming languages provide. In this thesis we use design patterns to evaluate GO. We discuss GO features that help or hinder implementing design patterns, and present a pattern catalogue of all 23 Gang-of-Four design patterns with GO specific solutions. Furthermore, we present GoHotDraw, a GO port of the pattern dense drawing application framework JHotDraw. We discuss design and implementation differences between the two frameworks with regards to GO.</p>

Dynamic Evaluation Design

A principal owns a firm, hires an agent of uncertain productivity, and designs a dynamic policy for evaluating his performance. The agent observes ongoing evaluations and decides when to quit. When not quitting, the agent is paid a wage that is linear in his expected productivity; the principal claims the residual performance. After quitting, the players secure fixed outside options. I show that equilibrium is Pareto efficient. For a broad class of performance technologies, the equilibrium wage deterministically grows with tenure. My analysis suggests that endogenous performance evaluation plays an important role in shaping careers in organizations. (JEL D21, D82, D83, J24, J31, J41, M51)

Evidence-based Medical Leadership Development: A Systematic Review

1Alexander Mafi, 2Oscar Lyons, 3Robynne George, 4Joao Galante, 5Thomas Fordwoh, 6Jan Frich,7Jaason Geerts 1University of Oxford, UK, 2University of Oxford, UK, 3Royal United Hospital Bath NHS Trust,4Oxford University Hospitals NHS Trust, UK, 5University of Oxford, UK, 6University of Oslo,Norway, 7Canadian College of Health Leaders, Ottawa, Canada Health systems invest significant resources in leadership development for physicians and other health professionals. Competent leadership is considered vital for maintaining and improving quality and patient safety. We carried out this systematic review to synthesise new empirical evidence regarding medical leadership development programme factors which are associated with outcomes at the clinical and organisational levels. 117 studies were included in this systematic review. 28 studies met criteria for higher reliability studies. The median critical appraisal score according to the Medical Education Research Study Quality Instrument for quantitative studies was 8.5/18 and the median critical appraisal score according to the Jonna Briggs Institute checklist for qualitative studies was 3/10. There were recurring causes of low study quality scores related to study design, data analysis and reporting. There was considerable heterogeneity in intervention design and evaluation design. Programmes with internal or mixed faculty were significantly more likely to report organisational outcomes than programmes with external faculty only (p=0.049). Project work and mentoring increased the likelihood of organisational outcomes. No leadership development content area was particularly associated with organisational outcomes. In leadership development programmes in healthcare, external faculty should be used to supplement in-house faculty and not be a replacement for in-house expertise. To facilitate organisational outcomes, interventions should include project work and mentoring. Educational methods appear to be more important for organisational outcomes than specific curriculum content. Improving evaluation design will allow educators and evaluators to more effectively understand factors which are reliably associated with organisational outcomes of leadership development.

A Protocol for a Comprehensive Monitoring and Evaluation Framework With a Compendium of Tools to Assess Quality of Project ECHO (Extension for Community Healthcare Outcomes) Implementation Using Mixed Methods, Developmental Evaluation Design

Introduction: The United States Centers for Disease Control and Prevention (CDC), through U.S. President's Emergency Plan for AIDS Relief (PEPFAR), supports a third of all people receiving HIV care globally. CDC works with local partners to improve methods to find, treat, and prevent HIV and tuberculosis. However, a shortage of trained medical professionals has impeded efforts to control the HIV epidemic in Sub-Saharan Africa and Asia. The Project Extension for Community Healthcare Outcomes (ECHOTM) model expands capacity to manage complex diseases, share knowledge, disseminate best practices, and build communities of practice. This manuscript describes a practical protocol for an evaluation framework and toolkit to assess ECHO implementation.Methods and Analysis: This mixed methods, developmental evaluation design uses an appreciative inquiry approach, and includes a survey, focus group discussion, semi-structured key informant interviews, and readiness assessments. In addition, ECHO session content will be objectively reviewed for accuracy, content validity, delivery, appropriateness, and consistency with current guidelines. Finally, we offer a mechanism to triangulate data sources to assess acceptability and feasibility of the evaluation framework and compendium of monitoring and evaluation tools.Expected impact of the study on public health: This protocol offers a unique approach to engage diverse group of stakeholders using an appreciative inquiry process to co-create a comprehensive evaluation framework and a compendium of assessment tools. This evaluation framework utilizes mixed methods (quantitative and qualitative data collection tools), was pilot tested in Tanzania, and has the potential for contextualized use in other countries who plan to evaluate their Project ECHO implementation.