scholarly journals Assessing the quality of studies using machine learning for personality assessment: A systematic review

2021 ◽  
Author(s):  
Joanne Hinds ◽  
Thomas Parkhouse ◽  
Victoria Hotchin
Keyword(s):  
Machine Learning ◽  
Systematic Review ◽  
Personality Assessment ◽  
Ground Truth ◽  
Open Science ◽  
Digital Data ◽  
Machine Learning Techniques ◽  
Personality Computing ◽  
Future Work

In recent years, the use of machine learning to predict personality from digital data has gained increasing interest from organisations, academics and the public. In turn, a new field of personality computing has developed, which involves combining machine learning techniques with psychological measures of personality. However, effectively integrating these approaches is challenging - the fields of machine learning and psychology are highly disparate, with different objectives, methodologies, and perspectives on performing and reporting research. In this article, we report findings from a systematic review that analysed 178 personality computing studies published before November 2020. We developed a novel set of criteria that was used to evaluate the quality of study design and reporting of each study according to 10 criteria: hypotheses, study rationale, selection of features, algorithm training, ground truth, sampling, the evaluation of algorithms’ performance (i.e., classification, regression), the performance measures reported, and detail concerning ethics and open science practices. Our findings highlight that a large proportion of studies lack detail on the above criteria, which leads to questions over the validity, reliability, and replicability of the findings. We discuss the implications of this research for practice and recommend directions for future work.

scholarly journals P.013 Machine Learning on Drawing Tests of Cognition: A Systematic Review

2021 ◽  
Vol 48 (s3) ◽  
pp. S23-S23
Author(s):  
R Kamhawy ◽  
R Mcginn ◽  
H He ◽  
J Ho ◽  
M Sharma ◽  
...  
Keyword(s):  
Machine Learning ◽  
Systematic Review ◽  
Inclusion Criteria ◽  
Quality Of Evidence ◽  
Drawing Test ◽  
Published Evidence ◽  
Full Text Review ◽  
Grade Methodology ◽  
Future Work

Background: Machine learning (ML) methods hold promise in allowing early detection of dementia. We performed a systematic review to assess the quality of published evidence for using ML methods applied to drawing tests of cognition, and to describe the accuracy of the methods. Methods: Embase, Medline, and Cochrane Central Library databases were searched for potential studies up to December 8, 2018 by four independent reviewers. Included articles satisfied the following criteria: 1) use of ML on 2) a drawing test in order to 3) assess cognition. The quality of evidence was then assessed using GRADE methodology. Results: The initial search yielded 4620 citations. Of these, 64 were eligible for full text review. 18 articles then met inclusion criteria. Median AUC across all models was 0.765, with certain ML algorithms performing better in terms of AUC or diagnostic accuracy. However, based on GRADE, the quality of evidence was deemed very low. Conclusions: ML has been applied by several groups to drawing tests of cognition. The quality of evidence is currently too low to make recommendations on their use. Future work must focus on improving reporting, and using standard algorithms and larger, more diverse datasets to improve comparability and generalizability.

scholarly journals Protocol for a systematic review on the methodological and reporting quality of prediction model studies using machine learning techniques

BMJ Open ◽  
2020 ◽  
Vol 10 (11) ◽  
pp. e038832
Author(s):  
Constanza L Andaur Navarro ◽  
Johanna A A G Damen ◽  
Toshihiko Takada ◽  
Steven W J Nijman ◽  
Paula Dhiman ◽  
...  
Keyword(s):  
Machine Learning ◽  
Systematic Review ◽  
Prediction Model ◽  
Prediction Models ◽  
Reporting Quality ◽  
Risk Of Bias ◽  
Machine Learning Techniques ◽  
Published Data ◽  
Model Studies

IntroductionStudies addressing the development and/or validation of diagnostic and prognostic prediction models are abundant in most clinical domains. Systematic reviews have shown that the methodological and reporting quality of prediction model studies is suboptimal. Due to the increasing availability of larger, routinely collected and complex medical data, and the rising application of Artificial Intelligence (AI) or machine learning (ML) techniques, the number of prediction model studies is expected to increase even further. Prediction models developed using AI or ML techniques are often labelled as a ‘black box’ and little is known about their methodological and reporting quality. Therefore, this comprehensive systematic review aims to evaluate the reporting quality, the methodological conduct, and the risk of bias of prediction model studies that applied ML techniques for model development and/or validation.Methods and analysisA search will be performed in PubMed to identify studies developing and/or validating prediction models using any ML methodology and across all medical fields. Studies will be included if they were published between January 2018 and December 2019, predict patient-related outcomes, use any study design or data source, and available in English. Screening of search results and data extraction from included articles will be performed by two independent reviewers. The primary outcomes of this systematic review are: (1) the adherence of ML-based prediction model studies to the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD), and (2) the risk of bias in such studies as assessed using the Prediction model Risk Of Bias ASsessment Tool (PROBAST). A narrative synthesis will be conducted for all included studies. Findings will be stratified by study type, medical field and prevalent ML methods, and will inform necessary extensions or updates of TRIPOD and PROBAST to better address prediction model studies that used AI or ML techniques.Ethics and disseminationEthical approval is not required for this study because only available published data will be analysed. Findings will be disseminated through peer-reviewed publications and scientific conferences.Systematic review registrationPROSPERO, CRD42019161764.

A Literature Review Study of Software Defect Prediction using Machine Learning Techniques

2018 ◽  
Vol 6 (6) ◽  
pp. 300 ◽  
Author(s):  
Feidu Akmel ◽  
Ermiyas Birihanu ◽  
Bahir Siraj
Keyword(s):  
Machine Learning ◽  
Software Metrics ◽  
Quality Standard ◽  
Machine Learning Techniques ◽  
Software Systems ◽  
Health Care Insurance ◽  
Software Defect ◽  
Learning Techniques ◽  
Software Product

Software systems are any software product or applications that support business domains such as Manufacturing,Aviation, Health care, insurance and so on.Software quality is a means of measuring how software is designed and how well the software conforms to that design. Some of the variables that we are looking for software quality are Correctness, Product quality, Scalability, Completeness and Absence of bugs, However the quality standard that was used from one organization is different from other for this reason it is better to apply the software metrics to measure the quality of software. Attributes that we gathered from source code through software metrics can be an input for software defect predictor. Software defect are an error that are introduced by software developer and stakeholders. Finally, in this study we discovered the application of machine learning on software defect that we gathered from the previous research works.

scholarly journals Early Detection of Exposure to Toxic Chemicals Using Continuously Recorded Multi-Sensor Physiology

Sensors ◽  
2021 ◽  
Vol 21 (11) ◽  
pp. 3616
Author(s):  
Jan Ubbo van Baardewijk ◽  
Sarthak Agarwal ◽  
Alex S. Cornelissen ◽  
Marloes J. A. Joosen ◽  
Jiska Kentrop ◽  
...  
Keyword(s):  
Machine Learning ◽  
Early Detection ◽  
Physiological Signals ◽  
Machine Learning Techniques ◽  
Detection Accuracy ◽  
Chemical Agent ◽  
Counter Measures ◽  
Detection And Identification ◽  
Life Saving ◽  
Future Work

Early detection of exposure to a toxic chemical, e.g., in a military context, can be life-saving. We propose to use machine learning techniques and multiple continuously measured physiological signals to detect exposure, and to identify the chemical agent. Such detection and identification could be used to alert individuals to take appropriate medical counter measures in time. As a first step, we evaluated whether exposure to an opioid (fentanyl) or a nerve agent (VX) could be detected in freely moving guinea pigs using features from respiration, electrocardiography (ECG) and electroencephalography (EEG), where machine learning models were trained and tested on different sets (across subject classification). Results showed this to be possible with close to perfect accuracy, where respiratory features were most relevant. Exposure detection accuracy rose steeply to over 95% correct during the first five minutes after exposure. Additional models were trained to correctly classify an exposed state as being induced either by fentanyl or VX. This was possible with an accuracy of almost 95%, where EEG features proved to be most relevant. Exposure detection models that were trained on subsets of animals generalized to subsets of animals that were exposed to other dosages of different chemicals. While future work is required to validate the principle in other species and to assess the robustness of the approach under different, realistic circumstances, our results indicate that utilizing different continuously measured physiological signals for early detection and identification of toxic agents is promising.

Machine learning techniques based on security management in smart cities using robots

Work ◽  
2021 ◽  
pp. 1-12
Author(s):  
Zhang Mengqi ◽  
Wang Xi ◽  
V.E. Sathishkumar ◽  
V. Sivakumar
Keyword(s):  
Machine Learning ◽  
Information And Communication Technologies ◽  
Smart City ◽  
Smart Cities ◽  
Security Management ◽  
Machine Learning Techniques ◽  
Quality Of Services ◽  
Learning Techniques ◽  
Learning Concept

BACKGROUND: Nowadays, the growth of smart cities is enhanced gradually, which collects a lot of information and communication technologies that are used to maximize the quality of services. Even though the intelligent city concept provides a lot of valuable services, security management is still one of the major issues due to shared threats and activities. For overcoming the above problems, smart cities’ security factors should be analyzed continuously to eliminate the unwanted activities that used to enhance the quality of the services. OBJECTIVES: To address the discussed problem, active machine learning techniques are used to predict the quality of services in the smart city manages security-related issues. In this work, a deep reinforcement learning concept is used to learn the features of smart cities; the learning concept understands the entire activities of the smart city. During this energetic city, information is gathered with the help of security robots called cobalt robots. The smart cities related to new incoming features are examined through the use of a modular neural network. RESULTS: The system successfully predicts the unwanted activity in intelligent cities by dividing the collected data into a smaller subset, which reduces the complexity and improves the overall security management process. The efficiency of the system is evaluated using experimental analysis. CONCLUSION: This exploratory study is conducted on the 200 obstacles are placed in the smart city, and the introduced DRL with MDNN approach attains maximum results on security maintains.

Applicability of machine learning techniques in food intake assessment: A systematic review

2021 ◽  
pp. 1-18
Author(s):  
Larissa Oliveira Chaves ◽  
Ana Luiza Gomes Domingos ◽  
Daniel Louzada Fernandes ◽  
Fabio Ribeiro Cerqueira ◽  
Rodrigo Siqueira-Batista ◽  
...  
Keyword(s):  
Machine Learning ◽  
Systematic Review ◽  
Food Intake ◽  
Machine Learning Techniques ◽  
Intake Assessment ◽  
Learning Techniques

scholarly journals Leveraging Road Characteristics and Contributor Behaviour for Assessing Road Type Quality in OSM

2021 ◽  
Vol 10 (7) ◽  
pp. 436
Author(s):  
Amerah Alghanim ◽  
Musfira Jilani ◽  
Michela Bertolotto ◽  
Gavin McArdle
Keyword(s):  
Machine Learning ◽  
Spatial Data ◽  
Classification Accuracy ◽  
Supervised Machine Learning ◽  
Machine Learning Techniques ◽  
Data Set ◽  
Semantic Inference ◽  
Road Type ◽  
The Impact

Volunteered Geographic Information (VGI) is often collected by non-expert users. This raises concerns about the quality and veracity of such data. There has been much effort to understand and quantify the quality of VGI. Extrinsic measures which compare VGI to authoritative data sources such as National Mapping Agencies are common but the cost and slow update frequency of such data hinder the task. On the other hand, intrinsic measures which compare the data to heuristics or models built from the VGI data are becoming increasingly popular. Supervised machine learning techniques are particularly suitable for intrinsic measures of quality where they can infer and predict the properties of spatial data. In this article we are interested in assessing the quality of semantic information, such as the road type, associated with data in OpenStreetMap (OSM). We have developed a machine learning approach which utilises new intrinsic input features collected from the VGI dataset. Specifically, using our proposed novel approach we obtained an average classification accuracy of 84.12%. This result outperforms existing techniques on the same semantic inference task. The trustworthiness of the data used for developing and training machine learning models is important. To address this issue we have also developed a new measure for this using direct and indirect characteristics of OSM data such as its edit history along with an assessment of the users who contributed the data. An evaluation of the impact of data determined to be trustworthy within the machine learning model shows that the trusted data collected with the new approach improves the prediction accuracy of our machine learning technique. Specifically, our results demonstrate that the classification accuracy of our developed model is 87.75% when applied to a trusted dataset and 57.98% when applied to an untrusted dataset. Consequently, such results can be used to assess the quality of OSM and suggest improvements to the data set.

EHR-based machine learning modeling for preterm birth prediction: A systematic review (Preprint)

2021 ◽  
Author(s):  
Zahra Sharifiheris ◽  
Juho Laitala ◽  
Antti Airola ◽  
Amir M Rahmani ◽  
Miriam Bender
Keyword(s):  
Machine Learning ◽  
Systematic Review ◽  
Preterm Birth ◽  
Model Performance ◽  
Bibliographic Databases ◽  
Complementary Approach ◽  
Prisma Statement ◽  
Comprehensive Search ◽  
First Time

BACKGROUND Preterm birth (PTB) as a common pregnancy complication is responsible for 35% of the 3.1 million pregnancy-related deaths each year and significantly impacts around 15 million children annually across the world. Conventional approaches to predict PTB may neither be applicable for first-time mothers nor possess reliable predictive power. Recently, machine learning (ML) models have shown the potential as an appropriate complementary approach for PTB prediction. OBJECTIVE In this article we systematically reviewed the literature concerned with PTB prediction using ML modeling. METHODS This systematic review was conducted in accordance with the PRISMA statement. A comprehensive search was performed in seven bibliographic databases up until 15 May 2021. The quality of studies was assessed, and the descriptive information including socio-demographic characteristics, ML modeling processes, and model performance were extracted and reported. RESULTS A total of 732 papers were screened through title and abstract. Of these, 23 studies were screened by full text resulting in 13 papers that met the inclusion criteria. CONCLUSIONS We identified various ML models used for different EHR data resulting in a desirable performance for PTB prediction. However, evaluation metrics, software/package used, data size and type, and selected features, and importantly data management method often varied from study to study threatening the reliability and generalizability of the model. CLINICALTRIAL n.a.

Machine Learning for Neurodegenerative Disorder Diagnosis — Survey of Practices and Launch of Benchmark Dataset

2018 ◽  
Vol 27 (03) ◽  
pp. 1850011 ◽  
Author(s):  
Athanasios Tagaris ◽  
Dimitrios Kollias ◽  
Andreas Stafylopatis ◽  
Georgios Tagaris ◽  
Stefanos Kollias
Keyword(s):  
Machine Learning ◽  
Neurodegenerative Disorder ◽  
Developed Countries ◽  
Machine Learning Techniques ◽  
Network Architectures ◽  
Imaging Data ◽  
Learning Techniques ◽  
Medical Examinations

Neurodegenerative disorders, such as Alzheimer’s and Parkinson’s, constitute a major factor in long-term disability and are becoming more and more a serious concern in developed countries. As there are, at present, no effective therapies, early diagnosis along with avoidance of misdiagnosis seem to be critical in ensuring a good quality of life for patients. In this sense, the adoption of computer-aided-diagnosis tools can offer significant assistance to clinicians. In the present paper, we provide in the first place a comprehensive recording of medical examinations relevant to those disorders. Then, a review is conducted concerning the use of Machine Learning techniques in supporting diagnosis of neurodegenerative diseases, with reference to at times used medical datasets. Special attention has been given to the field of Deep Learning. In addition to that, we communicate the launch of a newly created dataset for Parkinson’s disease, containing epidemiological, clinical and imaging data, which will be publicly available to researchers for benchmarking purposes. To assess the potential of the new dataset, an experimental study in Parkinson’s diagnosis is carried out, based on state-of-the-art Deep Neural Network architectures and yielding very promising accuracy results.

Sign in / Sign up

Export Citation Format

Share Document