scholarly journals Iterative Guided Machine Learning-Assisted Systematic Literature Reviews: A Diabetes Case Study

2020 ◽  
Author(s):  
John Zimmerman ◽  
Robin Soler ◽  
Lavender James ◽  
Murphy Sarah ◽  
Atkins Charisma ◽  
...  

Abstract Background: Systematic Reviews (SR), studies of studies, use a formal process to evaluate the quality of scientific literature and determine ensuing effectiveness from qualifying articles to establish consensus findings around a hypothesis. Their value is increasing as the conduct and publication of research and evaluation has expanded and the process of identifying key insights becomes more time consuming. Text analytics and Machine Learning (ML) techniques may help overcome this problem of scale while still maintaining the level of rigor expected of SRs.Methods: In this article, we discuss an approach that uses existing examples of SRs to build and test a method for assisting the SR title and abstract pre-screening by reducing the initial pool of potential articles down to articles that meet inclusion criteria. Our approach differs from previous approaches to using ML as a SR tool in that it incorporates ML configurations guided by previously conducted SRs, and human confirmation on ML predictions of relevant articles during multiple iterative reviews on smaller tranches of citations. We applied the tailored method to a new SR review effort to validate performance.Results: The case study test of the approach proved a sensitivity (recall) in finding relevant articles during down selection that may rival many traditional processes.Conclusions: We believe this iterative method can help overcome bias in initial ML model training by having humans reinforce ML models with new and relevant information, and is an applied step towards transfer learning for ML in SR.

2021 ◽  
Author(s):  
John Zimmerman ◽  
Robin Soler ◽  
Lavinder James ◽  
Murphy Sarah ◽  
Atkins Charisma ◽  
...  

Abstract Background: Systematic Reviews (SR), studies of studies, use a formal process to evaluate the quality of scientific literature and determine ensuing effectiveness from qualifying articles to establish consensus findings around a hypothesis. Their value is increasing as the conduct and publication of research and evaluation has expanded and the process of identifying key insights becomes more time consuming. Text analytics and Machine Learning (ML) techniques may help overcome this problem of scale while still maintaining the level of rigor expected of SRs.Methods: In this article, we discuss an approach that uses existing examples of SRs to build and test a method for assisting the SR title and abstract pre-screening by reducing the initial pool of potential articles down to articles that meet inclusion criteria. Our approach differs from previous approaches to using ML as a SR tool in that it incorporates ML configurations guided by previously conducted SRs, and human confirmation on ML predictions of relevant articles during multiple iterative reviews on smaller tranches of citations. We applied the tailored method to a new SR review effort to validate performance. Results: the case study test of the approach proved a sensitivity (recall) in finding relevant articles during down selection that may rival many traditional processes. Conclusions: We believe this iterative method can help overcome bias in initial ML model training by having humans reinforce ML models with new and relevant information, and is an applied step towards transfer learning for ML in SR.


2021 ◽  
Vol 10 (1) ◽  
Author(s):  
John Zimmerman ◽  
Robin E. Soler ◽  
James Lavinder ◽  
Sarah Murphy ◽  
Charisma Atkins ◽  
...  

Abstract Background Systematic Reviews (SR), studies of studies, use a formal process to evaluate the quality of scientific literature and determine ensuing effectiveness from qualifying articles to establish consensus findings around a hypothesis. Their value is increasing as the conduct and publication of research and evaluation has expanded and the process of identifying key insights becomes more time consuming. Text analytics and machine learning (ML) techniques may help overcome this problem of scale while still maintaining the level of rigor expected of SRs. Methods In this article, we discuss an approach that uses existing examples of SRs to build and test a method for assisting the SR title and abstract pre-screening by reducing the initial pool of potential articles down to articles that meet inclusion criteria. Our approach differs from previous approaches to using ML as a SR tool in that it incorporates ML configurations guided by previously conducted SRs, and human confirmation on ML predictions of relevant articles during multiple iterative reviews on smaller tranches of citations. We applied the tailored method to a new SR review effort to validate performance. Results The case study test of the approach proved a sensitivity (recall) in finding relevant articles during down selection that may rival many traditional processes and show ability to overcome most type II errors. The study achieved a sensitivity of 99.5% (213 out of 214) of total relevant articles while only conducting a human review of 31% of total articles available for review. Conclusions We believe this iterative method can help overcome bias in initial ML model training by having humans reinforce ML models with new and relevant information, and is an applied step towards transfer learning for ML in SR.


2021 ◽  
Vol 11 (13) ◽  
pp. 5826
Author(s):  
Evangelos Axiotis ◽  
Andreas Kontogiannis ◽  
Eleftherios Kalpoutzakis ◽  
George Giannakopoulos

Ethnopharmacology experts face several challenges when identifying and retrieving documents and resources related to their scientific focus. The volume of sources that need to be monitored, the variety of formats utilized, and the different quality of language use across sources present some of what we call “big data” challenges in the analysis of this data. This study aims to understand if and how experts can be supported effectively through intelligent tools in the task of ethnopharmacological literature research. To this end, we utilize a real case study of ethnopharmacology research aimed at the southern Balkans and the coastal zone of Asia Minor. Thus, we propose a methodology for more efficient research in ethnopharmacology. Our work follows an “expert–apprentice” paradigm in an automatic URL extraction process, through crawling, where the apprentice is a machine learning (ML) algorithm, utilizing a combination of active learning (AL) and reinforcement learning (RL), and the expert is the human researcher. ML-powered research improved the effectiveness and efficiency of the domain expert by 3.1 and 5.14 times, respectively, fetching a total number of 420 relevant ethnopharmacological documents in only 7 h versus an estimated 36 h of human-expert effort. Therefore, utilizing artificial intelligence (AI) tools to support the researcher can boost the efficiency and effectiveness of the identification and retrieval of appropriate documents.


2021 ◽  
Vol 10 (18) ◽  
pp. 4245
Author(s):  
Jörn Lötsch ◽  
Constantin A. Hintschich ◽  
Petros Petridis ◽  
Jürgen Pade ◽  
Thomas Hummel

Chronic rhinosinusitis (CRS) is often treated by functional endoscopic paranasal sinus surgery, which improves endoscopic parameters and quality of life, while olfactory function was suggested as a further criterion of treatment success. In a prospective cohort study, 37 parameters from four categories were recorded from 60 men and 98 women before and four months after endoscopic sinus surgery, including endoscopic measures of nasal anatomy/pathology, assessments of olfactory function, quality of life, and socio-demographic or concomitant conditions. Parameters containing relevant information about changes associated with surgery were examined using unsupervised and supervised methods, including machine-learning techniques for feature selection. The analyzed cohort included 52 men and 38 women. Changes in the endoscopic Lildholdt score allowed separation of baseline from postoperative data with a cross-validated accuracy of 85%. Further relevant information included primary nasal symptoms from SNOT-20 assessments, and self-assessments of olfactory function. Overall improvement in these relevant parameters was observed in 95% of patients. A ranked list of criteria was developed as a proposal to assess the outcome of functional endoscopic sinus surgery in CRS patients with nasal polyposis. Three different facets were captured, including the Lildholdt score as an endoscopic measure and, in addition, disease-specific quality of life and subjectively perceived olfactory function.


2011 ◽  
Vol 693 ◽  
pp. 208-216
Author(s):  
Leonel S. Batalla ◽  
Oscar A. Godoy ◽  
María Victoria Canullo

It is well known that mold and casting table maintenance has a direct impact on the internal quality and surface quality of billets. In this paper, the evolution of the main key performance indicators (KPIs) associated with the main consumables of the Wagstaff Air slip billet casting technology is shown, such as molds, casting rings, transition plates and thimbles. The strategies taken to preserve a high standard of quality whilst monitoring the associated costs, are discussed. An automated Mold and Casting Table Maintenance Management system has been developed in house to make available the relevant information from the casting table servicing at the casting pit and at the mold room. A case study is described where this tool allowed us to reduce costs, keeping a high quality standard of the casting table maintenance, ensuring the internal quality of the final product.


2015 ◽  
Vol 12 (4) ◽  
pp. 56-68
Author(s):  
Ana Alão Freitas ◽  
Hugo Costa ◽  
Isabel Rocha

Summary To better understand the dynamic behavior of metabolic networks in a wide variety of conditions, the field of Systems Biology has increased its interest in the use of kinetic models. The different databases, available these days, do not contain enough data regarding this topic. Given that a significant part of the relevant information for the development of such models is still wide spread in the literature, it becomes essential to develop specific and powerful text mining tools to collect these data. In this context, this work has as main objective the development of a text mining tool to extract, from scientific literature, kinetic parameters, their respective values and their relations with enzymes and metabolites. The approach proposed integrates the development of a novel plug-in over the text mining framework @Note2. In the end, the pipeline developed was validated with a case study on Kluyveromyces lactis, spanning the analysis and results of 20 full text documents.


Molecules ◽  
2020 ◽  
Vol 25 (6) ◽  
pp. 1452
Author(s):  
Igor Sieradzki ◽  
Damian Leśniak ◽  
Sabina Podlewska

A great variety of computational approaches support drug design processes, helping in selection of new potentially active compounds, and optimization of their physicochemical and ADMET properties. Machine learning is a group of methods that are able to evaluate in relatively short time enormous amounts of data. However, the quality of machine-learning-based prediction depends on the data supplied for model training. In this study, we used deep neural networks for the task of compound activity prediction and developed dropout-based approaches for estimating prediction uncertainty. Several types of analyses were performed: the relationships between the prediction error, similarity to the training set, prediction uncertainty, number and standard deviation of activity values were examined. It was tested whether incorporation of information about prediction uncertainty influences compounds ranking based on predicted activity and prediction uncertainty was used to search for the potential errors in the ChEMBL database. The obtained outcome indicates that incorporation of information about uncertainty of compound activity prediction can be of great help during virtual screening experiments.


2019 ◽  
Vol 9 (15) ◽  
pp. 3037 ◽  
Author(s):  
Isaac Machorro-Cano ◽  
Giner Alor-Hernández ◽  
Mario Andrés Paredes-Valverde ◽  
Uriel Ramos-Deonati ◽  
José Luis Sánchez-Cervantes ◽  
...  

Overweight and obesity are affecting productivity and quality of life worldwide. The Internet of Things (IoT) makes it possible to interconnect, detect, identify, and process data between objects or services to fulfill a common objective. The main advantages of IoT in healthcare are the monitoring, analysis, diagnosis, and control of conditions such as overweight and obesity and the generation of recommendations to prevent them. However, the objects used in the IoT have limited resources, so it has become necessary to consider other alternatives to analyze the data generated from monitoring, analysis, diagnosis, control, and the generation of recommendations, such as machine learning. This work presents PISIoT: a machine learning and IoT-based smart health platform for the prevention, detection, treatment, and control of overweight and obesity, and other associated conditions or health problems. Weka API and the J48 machine learning algorithm were used to identify critical variables and classify patients, while Apache Mahout and RuleML were used to generate medical recommendations. Finally, to validate the PISIoT platform, we present a case study on the prevention of myocardial infarction in elderly patients with obesity by monitoring biomedical variables.


Author(s):  
R Kamhawy ◽  
R Mcginn ◽  
H He ◽  
J Ho ◽  
M Sharma ◽  
...  

Background: Machine learning (ML) methods hold promise in allowing early detection of dementia. We performed a systematic review to assess the quality of published evidence for using ML methods applied to drawing tests of cognition, and to describe the accuracy of the methods. Methods: Embase, Medline, and Cochrane Central Library databases were searched for potential studies up to December 8, 2018 by four independent reviewers. Included articles satisfied the following criteria: 1) use of ML on 2) a drawing test in order to 3) assess cognition. The quality of evidence was then assessed using GRADE methodology. Results: The initial search yielded 4620 citations. Of these, 64 were eligible for full text review. 18 articles then met inclusion criteria. Median AUC across all models was 0.765, with certain ML algorithms performing better in terms of AUC or diagnostic accuracy. However, based on GRADE, the quality of evidence was deemed very low. Conclusions: ML has been applied by several groups to drawing tests of cognition. The quality of evidence is currently too low to make recommendations on their use. Future work must focus on improving reporting, and using standard algorithms and larger, more diverse datasets to improve comparability and generalizability.


Comunicar ◽  
2020 ◽  
Vol 28 (62) ◽  
pp. 53-65
Author(s):  
Covadonga Rodrigo ◽  
Bernardo Tabuenca

E-Learning environments are enhancing both their functionalities and the quality of the resources provided, thus simplifying the creation of learning ecologies adapted for students with disabilities. The number of students with disabilities enrolled in online courses is so small, and their impairments are so specific that it becomes difficult to quantify and identify which specific actions should be taken to support them. This work contributes to scientific literature with two key aspects: 1) It identifies which barriers these students encounter, and which tools they use to create learning ecologies adapted to their impairments; 2) It also presents the results from a case study in which 161 students with recognised disabilities evaluate the efficiency and ease of use of an online learning environment in higher education studies. The work presented in this paper highlights the need to provide multimedia elements with subtitles, text transcriptions, and the option to be downloadable and editable so that the student can adapt them to their needs and learning style. Los entornos de aprendizaje en línea están mejorando sus funcionalidades y la calidad de los recursos, facilitando que estudiantes con discapacidad puedan crear y adaptar sus propias ecologías de aprendizaje. Normalmente, el número de estudiantes con discapacidad matriculados es tan residual y sus discapacidades tan particulares, que resulta difícil identificar y cuantificar qué medidas de asistencia son relevantes para este colectivo en general. El objetivo de este trabajo es hacer entender cómo aprenden los estudiantes en entornos en línea dependiendo de su discapacidad y de las características del entorno. Consistentemente, se definen cinco ecologías de aprendizaje que son más frecuentes. Este trabajo contribuye a la literatura científica en dos aspectos fundamentales: 1) identificar qué barreras se encuentran, qué herramientas de apoyo utilizan los estudiantes online con discapacidad y cómo las combinan para formar ecologías de aprendizaje adaptadas a discapacidades específicas; 2) presentar los resultados en los que 161 estudiantes con discapacidad reconocida evalúan la eficiencia y facilidad de uso de un entorno de aprendizaje online en el ámbito universitario. Se resalta la necesidad de proveer elementos multimedia con subtítulos, transcripciones de texto, y la opción de que sean descargables y editables para que el estudiante pueda adaptarlos a sus necesidades y estilo de aprendizaje.


Sign in / Sign up

Export Citation Format

Share Document