Methods for Evaluation of Medical Terminological Systems

2005 ◽  
Vol 44 (05) ◽  
pp. 616-625 ◽  
Author(s):  
R. Cornet ◽  
E. de Jonge ◽  
N. F. de Keizer ◽  
D. G. T. Arts

Summary Objectives: The usability of terminological systems (TSs) strongly depends on the coverage and correctness of their content. The objective of this study was to create a literature overview of aspects related to the content of TSs and of methods for the evaluation of the content of TSs. The extent to which these methods overlap or complement each other is investigated. Methods: We reviewed literature and composed definitions for aspects of the evaluation of the content of TSs. Of the methods described in literature three were selected: 1) Concept matching in which two samples of concepts representing a) documentation of reasons for admission in daily care practice and b) aggregation of patient groups for research, are looked up in the TS in order to assess its coverage; 2) Formal algorithmic evaluation in which reasoning on the formally represented content is used to detect inconsistencies; and 3) Expert review in which a random sample of concepts are checked for incorrect and incomplete terms and relations. These evaluation methods were applied in a case study on the locally developed TS DICE (Diagnoses for Intensive Care Evaluation). Results: None of the applied methods covered all the aspects of the content of a TS. The results of concept matching differed for the two use cases (63% vs. 52% perfect matches). Expert review revealed many more errors and incompleteness than formal algorithmic evaluation. Conclusions: To evaluate the content of a TS, using a combination of evaluation methods is preferable. Different representative samples, reflecting the uses of TSs, lead to different results for concept matching. Expert review appears to be very valuable, but time consuming. Formal algorithmic evaluation has the potential to decrease the workload of human reviewers but detects only logical inconsistencies. Further research is required to exploit the potentials of formal algorithmic evaluation.

1995 ◽  
Vol 11 (1) ◽  
pp. 14-20 ◽  
Author(s):  
Sean M. Hammond

This paper presents an IRT analysis of the Beck Depression Inventory which was carried out to assess the assumption of an underlying latent trait common to non-clinical and patient samples. A one parameter rating scale model was fitted to data drawn from a patient and non-patient sample. Findings suggest that while the BDI fits the model reasonably well for the two samples separately there is sufficient differential item functioning to raise serious duobts of the viability of using it analogously with patient and non-patient groups.


2018 ◽  
pp. 60-67
Author(s):  
Henrika Pihlajaniemi ◽  
Anna Luusua ◽  
Eveliina Juntunen

This paper presents the evaluation of usersХ experiences in three intelligent lighting pilots in Finland. Two of the case studies are related to the use of intelligent lighting in different kinds of traffic areas, having emphasis on aspects of visibility, traffic and movement safety, and sense of security. The last case study presents a more complex view to the experience of intelligent lighting in smart city contexts. The evaluation methods, tailored to each pilot context, include questionnaires, an urban dashboard, in-situ interviews and observations, evaluation probes, and system data analyses. The applicability of the selected and tested methods is discussed reflecting the process and achieved results.


2021 ◽  
Vol 21 (1) ◽  
Author(s):  
Sophie H. Bots ◽  
Klaske R. Siegersma ◽  
N. Charlotte Onland-Moret ◽  
Folkert W. Asselbergs ◽  
G. Aernout Somsen ◽  
...  

Abstract Background Despite the increasing availability of clinical data due to the digitalisation of healthcare systems, data often remain inaccessible due to the diversity of data collection systems. In the Netherlands, Cardiology Centers of the Netherlands (CCN) introduced “one-stop shop” diagnostic clinics for patients suspected of cardiac disease by their general practitioner. All CCN clinics use the same data collection system and standardised protocol, creating a large regular care database. This database can be used to describe referral practices, evaluate risk factors for cardiovascular disease (CVD) in important patient subgroups, and develop prediction models for use in daily care. Construction and content The current database contains data on all patients who underwent a cardiac workup in one of the 13 CCN clinics between 2007 and February 2018 (n = 109,151, 51.9% women). Data were pseudonymised and contain information on anthropometrics, cardiac symptoms, risk factors, comorbidities, cardiovascular and family history, standard blood laboratory measurements, transthoracic echocardiography, electrocardiography in rest and during exercise, and medication use. Clinical follow-up is based on medical need and consisted of either a repeat visit at CCN (43.8%) or referral for an external procedure in a hospital (16.5%). Passive follow-up via linkage to national mortality registers is available for 95% of the database. Utility and discussion The CCN database provides a strong base for research into historically underrepresented patient groups due to the large number of patients and the lack of in- and exclusion criteria. It also enables the development of artificial intelligence-based decision support tools. Its contemporary nature allows for comparison of daily care with the current guidelines and protocols. Missing data is an inherent limitation, as the cardiologist could deviate from standardised protocols when clinically indicated. Conclusion The CCN database offers the opportunity to conduct research in a unique population referred from the general practitioner to the cardiologist for diagnostic workup. This, in combination with its large size, the representation of historically underrepresented patient groups and contemporary nature makes it a valuable tool for expanding our knowledge of cardiovascular diseases. Trial registration: Not applicable.


2017 ◽  
Vol 45 (5) ◽  
pp. 730-740 ◽  
Author(s):  
Brian Miller ◽  
Jeffrey L. Pellegrino

Background. Increasing lay responder cardiopulmonary resuscitation and automated external defibrillator use during sudden cardiac arrest depends on an individual’s choice. Investigators designed and piloted an instrument to measure the affective domain of helping behaviors by applying the theory of planned behavior (TPB) to better understand lay responders’ intent to use lifesaving skills. Method. Questionnaire items were compiled into 10 behavioral domains informed by the TPB constructs followed by refinement via piloting and expert review. Two samples from an American Red Cross–trained lay-responder population ( N = 4,979) provided data for an exploratory (EFA, n = 235) and confirmatory (CFA, n = 198) factor analyses. EFA derived interitem relationships into factors and affective subscales. CFA yielded statistical validation of factors and subscales. Results. The EFA identified four factors, aligned with the TPB constructs of attitudes, norms, confidence, and intention to act to explain 57% of interitem variance. The internal consistency of factor-derived subscales ranged between 0.71 and 0.91. Reduction of instrument items went from 47 to 32 (32%). The CFA yielded good model fit with the switching of the legal ramification item from the social norm to intention construct. Conclusion. The Intent to Aid (I2A) survey derived from this investigation aligned with the constructs of the TPB yielding four subscales. The I2A allows health education researchers to differentiate modalities and content impact on learner intention to act in a first aid (FA) emergency. I2A compliments cognitive and psychomotor measurements of learning outcomes. The experimental instrument aims to allow curricula developers and program evaluators a means of assessing the affective domain of human learning regarding intention-to-act in an FA emergency. In combination of with assessment of functional knowledge and essential skills, this instrument may provide curricula developers and health educators an avenue to better describe intention to act in an FA emergency.


2017 ◽  
Vol 29 (12) ◽  
pp. 1979-1991 ◽  
Author(s):  
Emma Broome ◽  
Tom Dening ◽  
Justine Schneider ◽  
Dawn Brooker

ABSTRACTBackground:Arts-based interventions play an important role in the care of people with dementia. Yet, creative arts are seldom implemented as a tool to enhance the care and wellbeing of people with dementia.Methods:We examined the involvement of care staff in creative arts activities in residential care. Aspects of involvement that appear to influence outcomes in people with dementia were identified and analyzed. A broad systematic literature search of MedLine, EMBASE, PsychInfo, CINAHL, ASSIA, SCOPUS, and Web of Science led to the identification of 14 papers. The studies identified through the search process were examined in terms of intervention, context, mechanism and outcome, and the relationships between these aspects.Results:Training sessions were identified as an opportunity to educate care personnel on useful techniques that are relevant to daily care practice. Evidence from the literature suggests that creative arts programs play a significant role in the way staff and residents interact and as a result influence the care practice of staff. Under certain conditions creative arts programs, that involve and engage staff, facilitate enhanced interactions and improve care strategies, which leads to the recognition and validation of personhood in residents with dementia.Conclusions:These findings provide a basis for illustrating which elements of care staff involvement in creative arts programs could be implemented in residential care contexts in order to have the upmost benefit.


Author(s):  
I. CARPENTIER ◽  
E. PEETERS ◽  
B. VANZIELEGHEM

Metastatic pulmonary calcification: a case report and literature overview Ground-glass opacities have a broad differential diagnosis, including infectious, metabolic, inflammatory and malignant causes. This case presents an underdiagnosed entity of dense ground-glass opacities, namely metastatic pulmonary calcifications (MPC). This is a benign metabolic disease characterised by the deposition of calcium in the lungs, mostly described in patients with chronic kidney injury and secondary hyperparathyroidism. The majority of the patients require no treatment, but in some cases it may lead to irreversible lung damage. Clinical and radiological features, as well as the patient’s history, are crucial to make a correct diagnosis since MPC has a relatively specific appearance on imaging. This case study discusses the medical history and imaging appearance of a 44-year-old woman with MPC, followed by a literature overview.


eLife ◽  
2017 ◽  
Vol 6 ◽  
Author(s):  
Sema K Sgaier ◽  
Maria Eletskaya ◽  
Elisabeth Engl ◽  
Owen Mugurungi ◽  
Bushimbwa Tambatamba ◽  
...  

Public health programs are starting to recognize the need to move beyond a one-size-fits-all approach in demand generation, and instead tailor interventions to the heterogeneity underlying human decision making. Currently, however, there is a lack of methods to enable such targeting. We describe a novel hybrid behavioral-psychographic segmentation approach to segment stakeholders on potential barriers to a target behavior. We then apply the method in a case study of demand generation for voluntary medical male circumcision (VMMC) among 15–29 year-old males in Zambia and Zimbabwe. Canonical correlations and hierarchical clustering techniques were applied on representative samples of men in each country who were differentiated by their underlying reasons for their propensity to get circumcised. We characterized six distinct segments of men in Zimbabwe, and seven segments in Zambia, according to their needs, perceptions, attitudes and behaviors towards VMMC, thus highlighting distinct reasons for a failure to engage in the desired behavior.


Author(s):  
Pieter van Staaden

The author conducted research to determine whether IT managers, IT auditors, users, management, etc. (all decision-makers) use a certain evaluation and selection process to acquire software to meet business objectives and the requirement of users. An argument was used that the more thorough the software evaluation and selection process, the more likely it would be that the organisation will chose software that meets these targets. The main objective of the research was therefore to determine whether Media24 uses evaluation methods and obtains the desired results. The results confirmed that Media24 uses suggested protocol as noted in the theory for software acquisition correctly during most stages.


Sign in / Sign up

Export Citation Format

Share Document