Evaluation of the impact of patient input in health technology assessments at NICE

Abstract Objective Accounts of patient experiences are increasingly used in health technology assessment (HTA) processes. However, we know little about their impact on the decision-making process. This study aims to assess the level and the type of impact of patient input to highly specialised technologies (HSTs) and interventional procedures (IPs) guidance at the National Institute for Health and Care Excellence (NICE). Methods A questionnaire was developed to capture quantitative and qualitative data on the amount and type of impact of patient input into NICE HTAs. It was completed by committee members of the guidance-producing programs after a discussion of the considered topics. The data were analyzed by topic and overall, for each program, and compared across programs. Results Patient input was assessed on ten pieces of HST guidance published between January 2015 and November 2019, and on twenty-six pieces of IP guidance scoped between February 2016 and October 2018. A total of 96 responses were collected for HST and 440 for IP. The level of impact of patient input was higher for HST than for IP. For HST, no respondents stated that it had no impact, whereas in IP, 35 percent of respondents did. The most common types of impact found for HST and IP were that it helped interpret the other evidence and that it provided new evidence. Conclusions The impact of patient input is not necessarily explicit in changing recommendations, but it provides context, reassurance, and new information to the committee for the decision-making process in HTAs.

Download Full-text

OP29 The Impact Of Individual Patient Input; Strengthening The Evidence

International Journal of Technology Assessment in Health Care ◽

10.1017/s0266462318000892 ◽

2018 ◽

Vol 34 (S1) ◽

pp. 12-12

Author(s):

Heidi Livingstone ◽

Chloe Kastoryano ◽

Lizzie Thomas ◽

Vassilia Verdiel ◽

Kevin Harris ◽

...

Keyword(s):

Decision Making ◽

Interventional Procedures ◽

Public Involvement ◽

Electronic System ◽

Efficacy And Safety ◽

Published Evidence ◽

Committee Decision Making ◽

The Impact ◽

New Evidence ◽

Patient Opinion

Introduction:The National Institute of Health and Care Excellence (NICE) assesses the efficacy and safety of interventional procedures for use in the National Health Service (NHS). Since 2006, NICE's Public Involvement Programme (PIP) has obtained ‘patient commentary’ to inform committee decisions, using a questionnaire asking patients about their experience of the procedure including benefits, disadvantages and side effects. Commentary is considered by the committee alongside other evidence. The PIP has piloted a project to: capture the impact of the patient commentary on the committee's decision-making; explore patterns of impact; and identify criteria that indicate when patient commentary may not be required.Methods:The pilot included all interventional procedures guidance started between February 2016 and February 2017. Committee members’ views were captured using a form completed whenever patient commentary was considered. Responses were anonymized, entered into an electronic system, analyzed, and correlated against ‘committee comments’ in the published guidance. After twelve months, there was an unrepresentatively narrow spread of conditions, and most topics were updating previously published guidance rather than novel topics. The pilot was therefore extended by six months.Results:Patient commentary commonly had an impact on decision-making; however, no discernible patterns have yet been identified, nor criteria for when it may not be required. Key findings were: (i) patient commentary is equally useful for guidance updates as novel guidance, and (ii) interpretation and assessment of ‘impact’ varied across committee members but the majority agreed it reinforced the other evidence.Conclusions:Patient commentary has a measurable impact on committee decision-making. Very occasionally it provides new evidence and routinely provides reassurance that the published evidence is substantiated by real-world patient opinion. Measuring the impact of commentary seems to have raised its profile, with more committee comments about patient issues included in guidance during the pilot than in preceding years. The project needs to be extended to identify which procedures are least likely to benefit from patient commentary and why.

Download Full-text

Situation Awareness and the Decision-Making Process in a Dynamic Situation: Avoiding Collisions at Sea

Journal of Cognitive Engineering and Decision Making ◽

10.1518/155534308x284345 ◽

2008 ◽

Vol 2 (1) ◽

pp. 1-23 ◽

Cited By ~ 14

Author(s):

Christine Chauvin ◽

J. P. Clostermann ◽

Jean-Michel Hoc

Keyword(s):

Decision Making ◽

Situation Awareness ◽

The Other ◽

Decision Making Process ◽

Secondary Importance ◽

Training Course ◽

Training Facility ◽

Level 1 ◽

The One ◽

The Impact

In this study, the authors aim to determine the impact of situation awareness (SA) in the decision-making process of “young” watch officers of a Merchant Marine training facility. The trainees were shown an ambiguous interaction situation in which they could choose among several actions. The results show that Level 1 SA (perception of the elements in the environment) tends to be of secondary importance in decision making. The major variables of the decision-making process are the interpretation of the rules and anticipation of the other vessel's intentions. Moreover, four different trainee “profiles” emerged. The main difference between them lies in the distance at which they decided to change course, the direction of this maneuver (port or starboard), the way in which they interpreted the other vessel's intentions (is it going to change course?), and whether the trainees referred to the rules. Of the trainees, 55% performed a maneuver that was against regulations, and 34% did so in an unsafe manner. This result provides an incentive to rethink the training course to put more stress on recognizing prototypical situations and choosing which actions to take in situations such as the one presented here.

Download Full-text

Patient beliefs and perceptions play a crucial role in the decision-making process when managing a meniscal tear. A qualitative systematic review of the literature

European Journal of Orthopaedic Surgery & Traumatology ◽

10.1007/s00590-021-03019-8 ◽

2021 ◽

Author(s):

Imran Ahmed ◽

Fatima Dhaif ◽

Simon G. F. Abram ◽

Nick Parsons ◽

Charles Hutchinson ◽

...

Keyword(s):

Decision Making ◽

Clinical Decision Making ◽

Meniscal Tear ◽

Treatment Success ◽

Patient Experiences ◽

Patient Perceptions ◽

Decision Making Process ◽

Meniscal Tears ◽

Qualitative Evidence ◽

The Impact

Abstract Introduction There has been an increase in research on the effectiveness of treatment options for the management of meniscal tears. However, there is very little evidence about the patient experiences of meniscal tears. Aim To summarise the available qualitative evidence on patients’ experiences and expectations of meniscal tears. Method A search of EMBASE, Medline, Sociofile and Web of Science up to November 2020 was performed to identify studies reporting patient experiences of meniscal tears. Studies were critically appraised using the CASP (Critical Appraisal Skills Program) checklist, and a meta-synthesis was performed to generate third-order constructs (new themes). Results Two studies reporting semi-structured interviews from 34 participants (24 male; 10 female) were included. The mean interview length ranged from 16 to 45 min. Five themes were generated: (1) the imaging (MRI) results are a key driver in the decision-making process, (2) surgery is perceived to be the definitive and quicker approach, (3) physiotherapy and exercise is a slower approach which brought success over time, (4) patient perceptions and preferences are important in the clinical decision-making process and, (5) the impact on patient lives is a huge driver in seeking care and treatment decisions. Conclusion This is the first study to summarise the qualitative evidence on patient experiences with meniscal tears. The themes generated demonstrate the importance of patient perceptions of MRI findings and timing of treatment success as important factors in the decision-making process. This study demonstrates the need to strengthen our understanding of patients’ experiences of meniscal tears.

Download Full-text

THE IMPACT OF HEALTH TECHNOLOGY ASSESSMENT REPORTS ON DECISION MAKING IN AUSTRIA

International Journal of Technology Assessment in Health Care ◽

10.1017/s0266462311000729 ◽

2012 ◽

Vol 28 (1) ◽

pp. 77-84 ◽

Cited By ~ 32

Author(s):

Ingrid Zechmeister ◽

Ines Schumacher

Keyword(s):

Health Care ◽

Decision Making ◽

Health Technology Assessment ◽

Technology Assessment ◽

Health Care Expenditure ◽

Health Technology ◽

Decision Making Process ◽

Inclusion Criteria ◽

Distribution Of Resources ◽

The Impact

Objectives: Health technology assessment (HTA) was established in Austria in the 1990s and, since then, it has gained considerable importance. In this study, we aim to analyze whether the HTA reports that have been produced at the Institute for Technology Assessment (ITA) and at the Ludwig Boltzmann Institute for HTA (LBI-HTA) have had an impact on decision making within the Austrian health care system.Methods: We selected all reports that were intended for supporting (i) reimbursement/investment or (ii) disinvestment decisions. Eleven full HTA reports and fifty-eight rapid assessments fulfilled the inclusion criteria. We used interview data and administrative data on volumes, tariffs and expenditure of products/services to analyze whether and how reports were in reality used in decision making and what the consequences for health care expenditure and resource distribution have been.Results: Five full HTA reports and fifty-six rapid technology assessments were used for reimbursement decisions. Four full HTA reports and two rapid assessments were used for disinvestment decisions and resulted in reduced volumes and expenditure. Two full HTA reports showed no impact on decision making. Impact was most evident for hospital technologies.Conclusions: HTA has played some role in reducing volumes of over-supplied hospital technologies, resulting in reduced expenditure for several hospital providers. Additionally, it has been increasingly included in prospective planning and reimbursement decisions of late, indicating re-distribution of resources toward evidence-based technologies. However, further factors may have influenced the decisions, and the impact could be considerably increased by systematically incorporating HTA into the decision-making process in Austria.

Download Full-text

Smart Speaker Recommendations: Impact of Gender Congruence and Amount of Information on Users' Engagement and Choice

Frontiers in Psychology ◽

10.3389/fpsyg.2021.659994 ◽

2021 ◽

Vol 12 ◽

Author(s):

Jaime Romero ◽

Daniel Ruiz-Equihua ◽

Sandra Maria Correia Loureiro ◽

Luis V. Casaló

Keyword(s):

Artificial Intelligence ◽

Decision Making ◽

The Other ◽

Decision Making Process ◽

User Engagement ◽

Consumer Decision Making ◽

Message Length ◽

Purchase Process ◽

The One ◽

The Impact

The relevance of smart speakers is steadily increasing, allowing users perform several daily tasks. From a commercial perspective, smart speakers also provide recommendations of products and services that may influence the consumer decision-making process. However, previous studies have mainly focused on the adoption of smart speakers, but there is a lack of proper guidelines that help design the way these devices should offer their consumption recommendations. Based on a stimulus-organism-response approach, we analyze how two features of smart speakers' recommendations (the gender congruence between the customer and the speaker, and the length of the message) influence on the effectiveness of such recommendations (i.e., visiting intentions) through its impact on user engagement and attitude. Data was collected from a sample of undergrad students in Spain using an experiment design that focused on a restaurant recommendation, and analyzed using partial least squares. On the one hand, our results suggests that gender congruence generates user engagement with the smart speaker. On the other hand, message length is positively related to attitudes towards the restaurant, at a declining rate. In addition, while better attitudes lead to higher visiting intentions, the influence of engagement on visiting intentions is partially mediated via attitudes. Thus, our findings contribute to understand the antecedents of users' engagement with smart speakers, as well as its impact on the customers' willingness to follow smart speakers' recommendations, constituting a base to analyze the impact of artificial intelligence solutions aimed to smooth the transitions of a customer through the stages of purchase process.

Download Full-text

Essays on the Impact of Stakeholders' Sentiment on the Financial Decision Making Process

10.25148/etd.fi08121902 ◽

2008 ◽

Author(s):

Aravinthan Arunachalam

Keyword(s):

Decision Making ◽

Decision Making Process ◽

Financial Decision Making ◽

Financial Decision ◽

The Impact

Download Full-text

The Impact of Social Media Use on Consumers’ Restaurant Consumption Experiences: A Qualitative Study

Sustainability ◽

10.3390/su13126581 ◽

2021 ◽

Vol 13 (12) ◽

pp. 6581

Author(s):

Jooyoung Hwang ◽

Anita Eves ◽

Jason L. Stienmetz

Keyword(s):

Decision Making ◽

Social Media ◽

Selection Process ◽

Decision Making Process ◽

Structured Interviews ◽

High Standards ◽

Tourism And Hospitality Industry ◽

Tourism And Hospitality ◽

Search For Information ◽

The Impact

Travellers have high standards and regard restaurants as important travel attributes. In the tourism and hospitality industry, the use of developed tools (e.g., smartphones and location-based tablets) has been popularised as a way for travellers to easily search for information and to book venues. Qualitative research using semi-structured interviews based on the face-to-face approach was adopted for this study to examine how consumers’ restaurant selection processes are performed with the utilisation of social media on smartphones. Then, thematic analysis was adopted. The findings of this research show that the adoption of social media on smartphones is positively related with consumers’ gratification. More specifically, when consumers regard that process, content and social gratification are satisfied, their intention to adopt social media is fulfilled. It is suggested by this study that consumers’ restaurant decision-making process needs to be understood, as each stage of the decision-making process is not independent; all the stages of the restaurant selection process are organically connected and influence one another.

Download Full-text

Impact of CEDIT recommendations: An example of health technology assessment in a hospital network

International Journal of Technology Assessment in Health Care ◽

10.1017/s0266462306050975 ◽

2006 ◽

Vol 22 (2) ◽

pp. 161-168 ◽

Cited By ~ 23

Author(s):

Florence Bodeau-Livinec ◽

Emmanuelle Simon ◽

Catherine Montagnier-Petrissans ◽

Marie-Eve Joël ◽

Elisabeth Féry-Lemonnier

Keyword(s):

Decision Making ◽

Technology Assessment ◽

Health Technology ◽

Technological Innovations ◽

Administrative Staff ◽

Good Match ◽

French Hospital ◽

The Impact ◽

Widespread Interest

Objectives: The objective of this study is to assess the impact of CEDIT (French Committee for the Assessment and Dissemination of Technological Innovations) recommendations on the introduction of technological innovations within the AP-HP (Assistance Publique–Hôpitaux de Paris), the French hospital network to which this body is attached.Methods: In 2002, a study based on semidirective interviews of fourteen people affected by these recommendations and a case study relating to thirteen recommendations issued between 1995 and 1998 were conducted.Results: The CEDIT is very scientifically reputable among interviewees. There is generally widespread interest for the recommendations. They are used as decision-making tools by administrative staff and as negotiating instruments by doctors in their dealings with management. Based on the case study, ten of thirteen recommendations had an impact on the introduction of the technology in health establishments. One recommendation appears not to have had an impact. Furthermore, the impact of two technologies was impossible to assess.Conclusions: This study highlights the significant impact of recommendations arising from a structure that is attached to a hospital network and the good match between CEDIT's objectives and its assignments.

Download Full-text