scholarly journals Social impact measurement in social housing: a theory-based investigation into the context, mechanisms and outcomes of implementation

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Alice Jones ◽  
Néstor Valero-Silva
Keyword(s):  
Social Housing ◽  
Social Impact ◽  
Contextual Factors ◽  
Realist Evaluation ◽  
Theory Of Change ◽  
Green Paper ◽  
Impact Measurement ◽  
Implementation Theory ◽  
Programme Theory ◽  
Content Type

Purpose English social housing providers are increasingly turning to social impact measurement to assess their social value. This paper aims to understand the contextual factors causing this rise in the practice, specifically within this sector; the mechanisms that enable it to be effectively implemented within an individual organisation and the outcomes of successful implementation for individual organisations and more widely across the sector and beyond. Design/methodology/approach A realist theory-based approach is applied to the study of a small number of social housing organisations and leaders within the sector to explore the use of social impact measurement. The paper addresses three questions: Why is social impact measurement being adopted in this sector? How is it successfully implemented? And what happens (outcomes) when it is successfully implemented? Addressing these questions necessitates deeper insight into the contextual pressures that have brought to the fore social impact measurement within the sector and the beneficial outcomes the practice provides (or is anticipated to provide) to social housing providers. The methodological approach of Realist Evaluation (Pawson and Tilley, 1997, 2004) is used to structure and analyse the empirical data and findings into a programme theory for social impact measurement. Realist Evaluation provides a programme theory perspective, seeking to answer the question “what works, for whom and in what circumstances?”. In this research, the “whom” refers to English social housing providers and the circumstances are the contextual conditions experienced by the sector over the past decade. The programme theory aims to set out the links between the contextual drivers for social impact measurement, the mechanisms that bring about its implementation and the outcomes that occur as a result. Within this, greater detail on the implementation perspective is provided by developing an implementation theory using a Theory of Change approach (Connell et al., 1995; Fulbright-Anderson et al., 1998). The implementation theory is then embedded within the wider programme theory so as to bring the two elements together, thereby creating a refinement of the overall theory for social impact measurement. In turn, this paper demonstrates its importance (the outcomes that it can achieve for organisations and the sector) and how it can effectively be implemented to bring about those outcomes. Findings Social housing providers use social impact measurement both internally, to determine their organisational priorities and externally, to demonstrate their value to local and national governments and cross-sector partners then to shape and influence resource allocation. The practice itself is shown to be an open and active programme, rather than a fixed calculative practice. Research limitations/implications The intensive nature of the research means that only a limited number of cases were explored. Further research could test theories developed here against evidence collected from a wider range of cases, e.g. other types of providers or non-adopters. Practical implications The research makes a strong contribution to practice in the form of a re-conceptualisation of how social impact measurement can be shown to be effective, based on a deeper understanding of causal mechanisms, how they interact and the outcomes that result. This is of value to the sector as such information could help other organisations both to understand the value of social impact measurement and to provide practical guidance on how to implement it effectively. Social implications As the practice of impact measurement continues to develop, practitioners will need to be aware of any changes to these contextual factors and consider questions such as: is the context still supportive of impact measurement? Does the practice need to be adjusted to meet the needs of the current context? For instance, the recent tragedy at Grenfell Tower has led to a reconsideration of the role of social housing; a new Green Paper is currently being drafted (Ministry for Housing, Communities and Local Government, 2018). This may have a number of implications for social impact measurement, such as a rebalancing of emphasis on outcomes relating to environmental improvements, towards outcomes relating to the well-being of tenants. Originality/value Existing literature is largely limited to technical guides. This paper links theory-based evaluation to practice contributing to social housing practice.

How impact measurement devices act: the performativity of theory of change, SROI and dashboards

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Katherine Ruff
Keyword(s):  
Social Impact ◽  
Theory Of Change ◽  
Impact Measurement ◽  
Data Set ◽  
Content Type ◽  
The Social ◽  
Measurement Devices ◽  
The Impact ◽  
Practical Implications

Purpose This study aims to examine the role of devices in assessing the social impact of an organization. The study examines the effects of device and analyst expertise on the contents and conclusions of the report. Design/methodology/approach Six impact reports based on the same data from the same organization were compared to each other, to the charity data and to the devices used. Specific attention is paid to the role of the device’s sociomaterial form and discursive entanglements. Findings The six reports assessed the impact differently from each other and in ways that were consistent with the devices used. The devices performatively reconfigured the charity in impact reports through a series of omissions and misrepresentations which could be traced to the discourses hardwired into the devices themselves. The devices did not simply present the same impact assessment to different audiences or for different purposes, but (mis)represented the charity in specific ways aligned with the discursive entanglements. Research limitations/implications The performativity of sociomaterial impact devices has implications for how researchers approach the study of impact measurement. Practical implications In this study, faithful adherence to an impact device led to greater omissions and misrepresentations than less expert impact assessments. Analysts should be supported to identify biases in their devices and be aware of sorts of omissions and misrepresentations that may result. Faithful adherence may not be the mark of rigorous analysis. Originality/value Performativity of impact measurement devices is explored with a unique data set.

Challenges to measuring social value creation through social impact assessments: the case of RVA Works

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Balashankar Mulloth ◽  
Stefano Rumi
Keyword(s):  
Value Creation ◽  
Real World ◽  
Social Enterprise ◽  
Social Impact ◽  
Social Value ◽  
Impact Measurement ◽  
Social Entrepreneurs ◽  
Content Type ◽  
Social Value Creation

PurposeDespite the prevalence of academic literature debating and proposing competing conceptions of social value creation through socially driven enterprises, there is a lack of empirical studies on established impact measurement methodologies in the context of real-world ventures. The purpose of this paper is to illustrate a structured process of conducting social impact assessments (SIAs) through the real-world case of Richmond, Virginia Works Enterprise Support (RVA Works), a social enterprise in Richmond, Virginia, that provides educational programming on small business ownership to minorities and lower-income individuals.Design/methodology/approachThis qualitative research study incorporates an in-depth case study methodology. Evidence was collected through interpretive/qualitative interviews and direct observations by the researchers.FindingsUsing the example of RVA Works, the authors show that there is a lack of standardization and guidance for social entrepreneurs in choosing methods to assess their organizational performance, and that leading conceptions of social impact continue to face key weaknesses in their methodologies.Practical implicationsBy incorporating a qualitative case study approach, the authors present a real-world study of a social enterprise – specifically a microenterprise development organization – that may serve as a valuable example to social entrepreneurs and not-for-profit leaders facing similar challenges of social value creation and impact measurement.Originality/valueIn studying the experience of conducting SIAs by social enterprises, the authors illustrate the real-world challenges faced by entrepreneurs in applying theoretical conceptions of social value to the outcomes of their ventures, thus illustrating a need for additional clarity and discussion around a more comprehensive, standardized and broadly applicable measurement approach.

scholarly journals Can sexual health interventions make community-based health systems more responsive to adolescents? A realist informed study in rural Zambia

2020 ◽  
Vol 17 (1) ◽  
Author(s):  
Chama Mulubwa ◽  
Anna-Karin Hurtig ◽  
Joseph Mumba Zulu ◽  
Charles Michelo ◽  
Ingvild Fossgard Sandøy ◽  
...  
Keyword(s):  
Reproductive Health ◽  
Health Systems ◽  
Contextual Factors ◽  
Realist Evaluation ◽  
Health Interventions ◽  
Alternative Theory ◽  
Health Coverage ◽  
Programme Theory ◽  
Community Based ◽  
Sexual Reproductive Health

Abstract Introduction Community-based sexual reproductive interventions are key in attaining universal health coverage for all by 2030, yet adolescents in many countries still lack health services that are responsive to their sexual reproductive health and rights’ needs. As the first step of realist evaluation, this study provides a programme theory that explains how, why and under what circumstances community-based sexual reproductive health interventions can transform (or not) ‘ordinary’ community-based health systems (CBHSs) into systems that are responsive to the sexual reproductive health of adolescents. Methods This realist approach adopted a case study design. We nested the study in the full intervention arm of the Research Initiative to Support the Empowerment of Girls trial in Zambia. Sixteen in-depth interviews were conducted with stakeholders involved in the development and/or implementation of the trial. All the interviews were recorded and analysed using NVIVO version 12.0. Thematic analysis was used guided by realist evaluation concepts. The findings were later synthesized using the Intervention−Context−Actors−Mechanism−Outcomes conceptualization tool. Using the retroduction approach, we summarized the findings into two programme theories. Results We identified two initial testable programme theories. The first theory presumes that adolescent sexual reproductive health and rights (SRHR) interventions that are supported by contextual factors, such as existing policies and guidelines related to SRHR, socio-cultural norms and CBHS structures are more likely to trigger mechanisms among the different actors that can encourage uptake of the interventions, and thus contribute to making the CBHS responsive to the SRHR needs of adolescents. The second and alternative theory suggests that SRHR interventions, if not supported by contextual factors, are less likely to transform the CBHSs in which they are implemented. At individual level the mechanisms, awareness and knowledge were expected to lead to value clarification’, which was also expected would lead to individuals developing a ‘supportive attitude towards adolescent SRHR. It was anticipated that these individual mechanisms would in turn trigger the collective mechanisms, communication, cohesion, social connection and linkages. Conclusion The two alternative programme theories describe how, why and under what circumstances SRHR interventions that target adolescents can transform ‘ordinary’ community-based health systems into systems that are responsive to adolescents.

Evaluation of an English language peer tutoring intervention

2019 ◽  
Vol 34 (5) ◽  
pp. 869-880
Author(s):  
Lee Mackenzie
Keyword(s):  
Student Performance ◽  
Peer Tutoring ◽  
English Language ◽  
Contextual Information ◽  
Contextual Factors ◽  
Academic Failure ◽  
Realist Evaluation ◽  
Language Instruction ◽  
Content Type ◽  
Efl Students

PurposeDesertion rates in Colombian universities remain unacceptably high. In the field of foreign languages, academic failure is particularly concerning since English language instruction is compulsory in most universities. To address the issue of poor student performance and high dropout rates, the University of Colombia has set up a peer tutoring scheme (PTS) for English as a foreign language (EFL) students in order to inform programme development. The paper aims to discuss this issue.Design/methodology/approachThe study was informed by realist evaluation principles. Qualitative in-depth interviews were conducted with eight PTS stakeholders supplemented by documentary analysis of the programme’s publicity material on the PTS website. The data were analysed using thematic analysis.FindingsFindings reveal discrepancies between the “espoused theory” about how the programme operates and the “theory-in-use”. In particular, according to stakeholders, the programme does not appear to be used by many of those EFL students who would benefit from it, which suggests that the programme is not as effective as it could be. Student and teacher contextual factors and mechanisms may explain the reasons for issues with programme effectiveness.Research limitations/implicationsFormative evaluations such as the current study can provide rich contextual information, but cannot be generalised to other settings. Also, this study does not explore the perspective of peer tutors and tutees, which means key variables may have been overlooked. Further research into the perspectives of tutors and tutees would therefore be needed to firm up these conclusions.Practical implicationsDue to the scarcity of literature into EFL peer tutoring interventions in higher education (HE), it is hoped that these findings will have relevance for similar contexts. The current evaluation highlights the influence of contextual factors such as willingness to ask for help, student motivation, student priorities, tutor credibility, teacher workload, timetabling and scheduling issues and involvement from teachers on the success of open-access peer tutoring programmes for EFL students in higher educational settings.Originality/valueAs far the researcher is aware, this is the first evaluation of an EFL peer tutoring programme in a private HE context in Colombia, and one of only a handful of studies into EFL peer tutoring programmes. The findings therefore have implications for those working in similar contexts.

Perspectives on social impact measurement and non-profit organisations

2016 ◽  
Vol 34 (1) ◽  
pp. 80-98 ◽  
Author(s):  
Michael Jay Polonsky ◽  
Stacy Landreth Grau ◽  
Sharyn McDonald
Keyword(s):  
Social Impact ◽  
Objective Assessment ◽  
International Perspective ◽  
Impact Measurement ◽  
Content Type ◽  
Non Profit ◽  
True Value ◽  
The Social ◽  
The Usa ◽  
Depth Interviews

Purpose – Acknowledgement of the social impact created by organisations has become an increasingly frequent discussion among practitioners. The importance of such value creation cannot be understated, yet in an increasingly competitive funding environment, the need to articulate “true” value is paramount. The purpose of this paper is to examine how Australian and US managers of non-profit organisations (NPOs) and foundations view the measurement of the social impact of NPOs. Design/methodology/approach – The paper includes 19 in-depth interviews of non-profit professionals in the USA and Australia. Respondents included non-profit managers, foundation managers and consultants in both countries. Findings – The in-depth interviews found that in both countries respondents generally agreed that objective measures of impact are desirable, but recognised the difficulties in developing objective assessment frameworks enabling comparisons across the non-profit sector. These difficulties, as well as the implications for developing assessments of social value for NPOs, are discussed. This paper demonstrates that there is an opportunity to reposition reporting expectations. The NPO sector can pool together and build on each other’s strengths and market their outcomes as a collective entity. A sector-wide approach provides potential for much needed within-sector mentoring and will showcase the rich and varied outcomes generated by NPOs. Originality/value – This research compares viewpoints in two Western countries, thus offering at least an exploratory examination of social impact assessment from an international perspective. Additionally, this research shows commonalities in terms of what is valued and what is most difficult for non-profits when determining social impact.

Measuring business impact: the lessons from the business schools

2020 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Michel Kalika ◽  
Gordon Shenton
Keyword(s):  
Social Impact ◽  
Business Schools ◽  
Assessment System ◽  
Impact Measurement ◽  
Self Assessment ◽  
Content Type ◽  
Measurement Framework ◽  
The Social ◽  
First Time ◽  
Practical Implications

Purpose The purpose of this paper is to present an example of a fully operational impact assessment system called Business School Impact System (BSIS). It is designed specifically for business schools with a particular emphasis on their local and regional impact. Since its creation, the process has been adapted to schools of engineering and indeed to entire universities. The question of its relevance to all organisations is on the table. Design/methodology/approach Talking about measurement raises methodological issues that are common to all organisations. The methodology used in this chapter, particularly in its second part, is mainly inductive, based on direct experience in interviewing 44 business schools in 15 countries. The system was designed on the basis of a survey among around 20 actors of the education industries (deans, journalists). First of all, the system involves an extensive self-assessment phase based on the BSIS impact measurement framework consisting of 7 major impact dimensions and about 100 indicators. This is followed up by a two-day visit by two experienced experts (former deans) who engage in challenging discussions with internal practitioners and external stakeholders. Findings The question of the relevance of the dimensions used by business schools for companies is systematically asked, and it is argued that the seven dimensions of impact can be applied to all organisations whatever their mission. Research limitations/implications The methodology has not yet been tested on private organisations. Practical implications The process can be easily adapted to companies and could permit them to assess in a shared framework their impact. So, the practical implications are potentially large. Social implications One of the seven dimensions of impact is the social impact of the organisation and indeed the implications are significant in the social field. Originality/value To the best of the authors’ knowledge, the transfer of a process of impact measurement from the educational sector to companies is studied for the first time.

Measuring, evaluating, and documenting social marketing impact

2021 ◽  
Vol 11 (3) ◽  
pp. 259-277
Author(s):  
V. Dao Truong ◽  
X. Dam Dong ◽  
Stephen Graham Saunders ◽  
Quynh Pham ◽  
Hanh Nguyen ◽  
...  
Keyword(s):  
Systematic Review ◽  
Social Marketing ◽  
Social Impact ◽  
Vegetable Intake ◽  
Direct Products ◽  
Impact Measurement ◽  
Intervention Programme ◽  
Content Type ◽  
Use Of Resources

Purpose This paper aims to examine how social marketing intervention programmes to measure, evaluate and document social marketing impact. Design/methodology/approach A systematic review of 49 nutritional behaviour intervention programmes (2006–2020) was conducted. To examine the social marketing impact of the programmes, a logic model of social impact was used. The model comprises inputs (the resources used for an intervention programme), outputs (the direct products resulting from the use of resources), outcomes (short- to medium-term programme effects) and impacts (long-term programme effects on the individual, community or societal levels). Findings Most intervention programmes set the goal of encouraging their target audience to increase fruit and vegetable intake, choose healthy food items, drink less sugary beverages or consume low-fat diaries, while few others sought policy or systems change. Multiple criteria were used for impact evaluation (e.g. exposure and reach, changes in knowledge, awareness, attitudes, behaviours and body mass index). (Quasi) experiments were the most popular method used for impact measurement, followed by the pre-post model of impact. Positive changes were found in 33 programmes, often reported in terms of short-term outputs or outcomes. Long-term impact particularly on the broader societal level was not indicated. Originality/value This research offers a systematic review of how social marketing impact is measured, evaluated and documented. It also provides some guidance for social marketers on how to shift from a reductionist, behavioural outcome-focussed approach towards an “expansionist” impact approach that explicitly considers social marketing impacts on the quality of life of individuals, communities and societies.

Impact measurement in social enterprises: Australia and India

2016 ◽  
Vol 12 (1) ◽  
pp. 78-103 ◽  
Author(s):  
Debbie Haski-Leventhal ◽  
Akriti Mehra
Keyword(s):  
Qualitative Methodology ◽  
Social Impact ◽  
Social Enterprises ◽  
Impact Measurement ◽  
Social Entrepreneurs ◽  
Developed Country ◽  
Content Type ◽  
The Social ◽  
Theoretical Sampling ◽  
Practical Implications

Purpose This study aims to extend existing research on impact measurement (IM) in social enterprises (SEs) by capturing, comparing and contrasting perceptions of IM in SEs in Australia and India. Design/methodology/approach A qualitative methodology was used to study five cases each in India and Australia. The SEs were identified using snowball and theoretical sampling, and grounded theory was applied to analyze the data. Findings Emerging perceptions of IM in both countries are described according to the development of the SE, its perceived impact and IM methods and challenges. Primary differences between India and Australia lie in perceptions of impact and IM, and related tools and processes. Similarities include understanding the importance of IM and the challenges faced. Signaling theory is used to depict how some SEs use IM to signal quality to their stakeholders and how information asymmetry can be reduced by measuring and reporting on IM. Research limitations/implications There is limited representation from developed and developing countries, and the snowball and theoretical sampling approaches used to identify SEs have limitations, including limited representation of SEs. Practical implications There is presently no standardized method of IM due to common challenges and perceived barriers. It is, therefore, important for SEs to work toward developing their own comprehensive IM methodology that is ingrained in strategy, applied on a regular basis and used to measure collective impact to increase sense of ownership and acceptability for employees and partners. Originality/value The paper brings the social entrepreneurs’ perspectives on measuring social impact while comparing these perspectives in one developing and one developed country.

Social impact measurement: why do stakeholders matter?

2016 ◽  
Vol 7 (1) ◽  
pp. 99-124 ◽  
Author(s):  
Ericka Costa ◽  
Caterina Pesci
Keyword(s):  
Social Impact ◽  
Performance Standards ◽  
Social Enterprises ◽  
Standard Approach ◽  
Impact Measurement ◽  
Content Type ◽  
The Social ◽  
Golden Standard ◽  
New Perspective ◽  
Corporate Social

Purpose – This paper aims to discuss the notion of social impact of social impact measurement in social enterprises by supporting the multiple-constituency theory as a contribution to this under-theorised issue. Moreover, the paper proposes the stakeholder-based approach as the most appropriate solution for selection among metrics related to the growing number of social impact measurements. Design/methodology/approach – The paper proposes a review of social impact measurement studies by considering contributions from both academia and practitioners, while providing a reassessment and conceptualisation of this issue in terms of the multiple-constituency theory. Findings – The paper criticises the “golden standard approach” to social impact measurement according to which social enterprises have to find one standardised metric capable of determining an organisation’s real impact. The golden standard approach promotes a more “political view” of social enterprises, according to which multiple stakeholders set performance standards based on their viewpoints regarding the measurement’s purposes. Research limitations/implications – The paper responds to the urgent call to define a theoretical framework that might guide social impact measurement, seeking to avoid the current lack of order and transparency in existing practices that could serve as a vehicle for camouflaging corporate social un-sustainability. Originality/value – The multiple-constituency approach should discourage organisations from opportunistically selecting a social impact measurement with the sole purpose of proving a higher impact, as, within the proposed new perspective, social impact metrics are no longer managed independently by the social enterprises themselves. Instead, these metrics are defined and constructed with the stakeholders. As a result, social enterprises’ manipulative intentions should diminish.

Mega-event and urban sustainable development

2016 ◽  
Vol 7 (3) ◽  
pp. 152-171 ◽  
Author(s):  
Ying-Wen Liang ◽  
Chih-Hung Wang ◽  
Sheng-Hshiung Tsaur ◽  
Chang-Hua Yen ◽  
Jin-Hua Tu
Keyword(s):  
Social Impact ◽  
Urban Sustainability ◽  
Social Impacts ◽  
Measurement Scale ◽  
Impact Measurement ◽  
Content Type ◽  
Positive Effects ◽  
Impact Indicators ◽  
Mega Event ◽  
The Impact

Purpose The purpose of this paper is to identify the impact indicators of the 2010 Taipei International Flora Exposition from the perspective of residents and to investigate the effects of these impacts on the urban sustainability through the perceptions of Taipei residents after the exposition. Design/methodology/approach The authors conducted a literature review and consulted experts to identify the impact indicators of the exposition. This process resulted in 17 indicators of economic impact, 12 indicators of environmental impact, and 13 indicators of social impact, and the authors developed a 12-dimension/42-indicator mega-event impact measurement scale. Using a survey of 1,628 host residents after the exposition, the authors performed regression analysis to investigate the effects of these impacts on the urban sustainability. Findings The results indicated that economic, environmental, and social impacts exerted significant positive effects on urban sustainability. All positive dimensions of economic, environmental, and social impact exerted significant positive effects on urban sustainability, and all negative dimensions exerted nonsignificant effects on urban sustainability. Originality/value This study identified the impact indicators of the 2010 Taipei International Flora Exposition and investigated the effects of these impacts on the urban sustainability. The findings of this study indicated that economic, environmental, and social impacts of the exposition exerted significant positive effects on urban sustainability.

Sign in / Sign up

Export Citation Format

Share Document