scholarly journals A Methodological Framework for the Selection of Key Performance Indicators to Assess Smart City Solutions

Smart Cities ◽  
2019 ◽  
Vol 2 (2) ◽  
pp. 269-306 ◽  
Author(s):  
Komninos Angelakoglou ◽  
Nikos Nikolopoulos ◽  
Paraskevi Giourka ◽  
Inger-Lise Svensson ◽  
Panagiotis Tsarchopoulos ◽  
...  

Smart and sustainable cities are expected to form a cornerstone for achieving resource efficiency and sustainability worldwide. In this specific study we introduce a holistic framework for determining a repository of key performance indicators (KPIs) that are able to evaluate both business-as-usual and novel technologies and services related to smart city solutions. The framework includes six steps: (a) Clustering of the technology/service solutions into groups called Transition Tracks; (b) definition of the main groups of stakeholders; (c) definition of KPIs dimensions (or domains); (d) definition of KPIs repository per dimension; (e) definition of the scope of evaluation per KPI; and (f) threshold definition per KPI. The implementation of the proposed framework led to the development of a repository of 75 KPIs categorized in six dimensions (technical, environmental, economic, social, ICT and legal KPIs) with the corresponding levels of assessment and stakeholders’ group of interest. The proposed repository can serve as a great basis for similar projects to monitor and evaluate the performance of their solutions. Tips and guidance based on the actual implementation and lessons learned from a smart city project are provided.

Smart Cities ◽  
2020 ◽  
Vol 3 (3) ◽  
pp. 705-735
Author(s):  
Komninos Angelakoglou ◽  
Konstantinos Kourtzanidis ◽  
Paraskevi Giourka ◽  
Vasilis Apostolopoulos ◽  
Nikos Nikolopoulos ◽  
...  

As cities grow rapidly and energy needs increase, shaping an effective energy transition is a top priority towards urban sustainability and smart development. This study attempts to answer three key research questions that can help city authorities, planners and interested agents simplify and increase the transparency of Key Performance Indicators (KPIs) selection for smart city and communities (SCC) projects focusing on energy transition and creation of Positive Energy Districts (PEDs): Question 1: “What resources are available for extracting such KPIs?”; Question 2: “Which of those KPIs are the most suitable for assessing the energy transition of smart city projects and PED-related developments?” and Question 3: “How can a project-specific shortlist of KPIs be developed?”. Answering these questions can also serve as a major first step towards a “universal” KPI selection procedure. In line with this purpose, an experiential approach is presented, capitalizing on knowledge and lessons learned from an ongoing smart city project in Europe (POCITYF) that focuses on PED deployment. Under this framework, a) a review of smart city KPI frameworks has been conducted, resulting in a pool of 258 indicators that can potentially be adopted by smart city projects; b) eight key dimensions of evaluations were extracted, setting a holistic performance framework relevant to SCCs; c) a detailed evaluation process including pre-determined criteria and city-needs feedback was applied to shortlist the KPI pool, leading to a ready-to-be-used, project-specific list of 63 KPIs and d) KPIs were sorted and analyzed in different granularity levels to further facilitate the monitoring procedure. The experiential procedure presented in this study can be easily adapted to the needs of every smart city project, serving as a recommendation guide.


Author(s):  
Anna Mathew ◽  
Seema K Nayar ◽  
Santhosh Sathyapal

Public-Private Partnerships (PPP), now applied widely in the global construction market, are more complex than conventional public procurements in economic, social, political, legal, and administrative aspects. Therefore, in order to ensure good performance and subsequent success of project, PPPs require a well-formulated performance management system that takes into consideration the perspectives of all stakeholders involved. A general agreement on how to measure success is necessary, which may be achieved by the definition of Performance Objectives (POs) of the project. Further statistical evidence, often labelled Key Performance Indicators (KPIs), may be employed to ensure that the actual progress is at par with the targeted. Determination of appropriate POs and KPIs is important for successful performance management. Numerous studies have been conducted worldwide to identify a desirable set of POs and KPIs in PPPs.


2018 ◽  
Vol 42 (5) ◽  
pp. 491 ◽  
Author(s):  
Christopher Elliot ◽  
Cheryl Mcullagh ◽  
Michael Brydon ◽  
Karen Zwi

Objective The aim of this study is to describe the experience of developing key performance indicators (KPIs) for Sydney Children’s Hospital Network (SCHN), the largest paediatric healthcare entity in Australia. Methods Beginning with a published methodology, the process of developing KPIs involved five phases: (1) identification of potential KPIs referencing the organisational strategic plan and pre-existing internal and external documents; (2) consolidation into a pragmatic set; (3) analysis of potential KPIs against selection criteria; (4) mapping these back against the strategic plan and management structure; and (5) presentation to key stakeholders to ensure suitability and traction. Consistent with the strategic plan, a subset of indicators was selected to address quality of care for children from priority populations. Results A pragmatic list of 60 mandated and 50 potential KPIs was created from the 328 new and 397 existing potentially relevant KPIs generated by the executive team. Of these, 20 KPIs were selected as the most important; 65% were process measures. The majority of mandated KPIs were process measures. Of the KPIs selected to highlight inequities, there were proportionately more outcome measures (44% outcome, 27% process). Less than one-third could currently be measured by the organisation and were thus aspirational. Conclusion Developing a KPI suite requires substantial time, effort and organisational courage. A structured approach to performance measurement and improvement is needed to ensure a balanced suite of KPIs that can be expected to drive an organisation to improve child health outcomes. Future directions for SCHN include a systematic approach to implementation beyond the mandated KPIs, including KPIs that reflect equity and improved outcomes for priority populations, development of meaningful measures for the aspirational KPIs, adding structure KPIs and measurement of changes in child health outcomes related to the development of this KPI process. What is known about the topic? Health services are increasingly required to demonstrate accountability through KPIs. There is a body of literature on both theoretical frameworks for measuring performance and a long list of possible measures, however developing a meaningful suite of KPIs remains a significant challenge for individual organisations. What does this paper add? This paper describes lessons learned from the practical, pragmatic application of a published methodology to develop a suite of KPIs for the largest paediatric healthcare entity in Australia. It provides a select list of the highest-level KPIs selected by the organisation to stimulate further discussion among similar organisations in relation to KPI selection and implementation. What are the implications for practitioners? Developing and implementing a suite of meaningful KPIs for a large organisation requires courage, an understanding of health informatics, stakeholder engagement, stamina and pragmatism. The process we describe can be replicated and/or modified as needed, with discussion of key lessons learned to help practitioners plan ahead.


Author(s):  
Anders Berglund ◽  
Johannes Blackne ◽  
Niklas Jansson

This paper proposes a feedback system that is based on the self-evaluation of perceived productivity as a mechanism for detecting deviations in an engineering design student project. By monitoring key performance indicators, project members used feedback loops to recognize alarming patterns and act accordingly. The study is based on descriptive survey data that addressed three factors of influence: perceived productivity, perception of stage completion, and work-activity distribution. The productivity data was analysed by detecting patterns in the form of peaks and lows and by combining the patterns with qualitative data from observations and documented work activities. Measurements were taken every time the project team got together; 33 occasions during the course of the project, resulting in a total of 280 student responses for productivity (P) and completion (C) and 115 student replies for work activity distribution. The findings provide an extraction of peak values and low values that enables tracking of critical incidents. Through an in-depth activity log, each value was enriched with lessons learned about what took place and the consequences for the project, thus enhancing learning from past activities through systematic feedback sessions. The accumulated set of data provided distinguishable patterns for the project team to interpret. Over time this made student actions more proactive, activity execution more distinct and purposeful, and resource allocation in combination with feedback reflections more refined.


2021 ◽  
Vol 9 (9) ◽  
pp. 994
Author(s):  
Sara Mizar Formentin

Due to the effects of climate change on the sea levels and on the frequency and intensity of extreme weather events, many coastal defense structures are expected to be exposed to increased loads with respect to their design conditions in the near future and need to be upgraded. Often, several design alternatives are available, and the identification of the ideal solution is not straightforward. Solutions that are effective in reducing overtopping and ensuring hydraulic safety may reduce or compromise the structural performance. Solutions that are both hydraulically and structurally effective may be extremely expensive and/or environmentally harmful. Using consolidated techniques of Multi-criteria analysis, this contribution proposes a simple methodology to consistently compare and rank the performance of several alternative approaches to upgrade existing structures, and to individuate the best solution. The proposed methodology consists of Key Performance Indicators (KPIs) of alternative solutions of upgrades, considering the reduction in the wave overtopping discharge (q) and the wave forces (F) by limiting costs and environmental impact. The definition of the KPIs was developed on the basis of new experimental data of q and F at dikes with crown walls and parapets, but it can be applied to various structure types, sea levels, and wave conditions. The application of the KPIs to the new experiments prompts a few conclusions of practical utility concerning the effectiveness of berms, crown walls, and parapets as elements to upgrade existing dikes.


Sign in / Sign up

Export Citation Format

Share Document