scholarly journals Towards CRISP-ML(Q): A Machine Learning Process Model with Quality Assurance Methodology

2021 ◽  
Vol 3 (2) ◽  
pp. 392-413
Author(s):  
Stefan Studer ◽  
Thanh Binh Bui ◽  
Christian Drescher ◽  
Alexander Hanuschkin ◽  
Ludwig Winkler ◽  
...  
Keyword(s):  
Machine Learning ◽  
Quality Assurance ◽  
Process Model ◽  
Practical Experience ◽  
Special Focus ◽  
Close Monitoring ◽  
Machine Learning Applications ◽  
Project Organizations ◽  
Considerable Impact ◽  
Learning Development

Machine learning is an established and frequently used technique in industry and academia, but a standard process model to improve success and efficiency of machine learning applications is still missing. Project organizations and machine learning practitioners face manifold challenges and risks when developing machine learning applications and have a need for guidance to meet business expectations. This paper therefore proposes a process model for the development of machine learning applications, covering six phases from defining the scope to maintaining the deployed machine learning application. Business and data understanding are executed simultaneously in the first phase, as both have considerable impact on the feasibility of the project. The next phases are comprised of data preparation, modeling, evaluation, and deployment. Special focus is applied to the last phase, as a model running in changing real-time environments requires close monitoring and maintenance to reduce the risk of performance degradation over time. With each task of the process, this work proposes quality assurance methodology that is suitable to address challenges in machine learning development that are identified in the form of risks. The methodology is drawn from practical experience and scientific literature, and has proven to be general and stable. The process model expands on CRISP-DM, a data mining process model that enjoys strong industry support, but fails to address machine learning specific tasks. The presented work proposes an industry- and application-neutral process model tailored for machine learning applications with a focus on technical tasks for quality assurance.

scholarly journals Towards CRISP-ML(Q): A Machine Learning Process Model with Quality Assurance Methodology

2021 ◽  
Author(s):  
Stefan Studer ◽  
Thanh Bui ◽  
Christian Drescher ◽  
Alexander Hanuschkin ◽  
Ludwig Winkler ◽  
...  
Keyword(s):  
Machine Learning ◽  
Quality Assurance ◽  
Process Model ◽  
Scientific Literature ◽  
State Of The Art ◽  
Practical Experience ◽  
Data Availability ◽  
Machine Learning Applications ◽  
Project Organizations ◽  
Learning Development

Machine learning is an established and frequently used technique in industry and academia but a standard process model to improve success and efficiency of machine learning applications is still missing. Project organizations and machine learning practitioners have a need for guidance throughout the life cycle of a machine learning application to meet business expectations. We therefore propose a process model for the development of machine learning applications, that covers six phases from defining the scope to maintaining the deployed machine learning application. The first phase combines business and data understanding as data availability oftentimes affects the feasibility of the project. The sixth phase covers state-of-the-art approaches for monitoring and maintenance of a machine learning applications, as the risk of model degradation in a changing environment is eminent. With each task of the process, we propose quality assurance methodology that is suitable to address challenges in machine learning development that we identify in form of risks. The methodology is drawn from practical experience and scientific literature and has proven to be general and stable. The process model expands on CRISP-DM, a data mining process model that enjoys strong industry support but lacks to address machine learning specific tasks. Our work proposes an industry and application neutral process model tailored for machine learning applications with focus on technical tasks for quality assurance.

scholarly journals A Holistic Quality Assurance Approach for Machine Learning Applications in Cyber-Physical Production Systems

2021 ◽  
Vol 11 (20) ◽  
pp. 9590
Author(s):  
Hajo Wiemer ◽  
Alexander Dementyev ◽  
Steffen Ihlenfeldt
Keyword(s):  
Machine Learning ◽  
Quality Assurance ◽  
Process Model ◽  
Production Systems ◽  
Machine Learning Techniques ◽  
Learning Techniques ◽  
Monitoring Process ◽  
Machine Learning Applications ◽  
Cyber Physical Production Systems ◽  
Automation Technology

With the trend of increasing sensors implementation in production systems and comprehensive networking, essential preconditions are becoming required to be established for the successful application of data-driven methods of equipment monitoring, process optimization, and other relevant automation tasks. As a protocol, these tasks should be performed by engineers. Engineers usually do not have enough experience with data mining or machine learning techniques and are often skeptical about the world of artificial intelligence (AI). Quality assurance of AI results and transparency throughout the IT chain are essential for the acceptance and low-risk dissemination of AI applications in production and automation technology. This article presents a conceptual method of the stepwise and level-wise control and improvement of data quality as one of the most important sources of AI failures. The appropriate process model (V-model for quality assurance) forms the basis for this.

Exploring the Applications of Machine Learning in Healthcare

2020 ◽  
Vol 10 (4) ◽  
pp. 458-472
Author(s):  
Tausifa Jan Saleem ◽  
Mohammad Ahsan Chishti
Keyword(s):  
Machine Learning ◽  
Disease Risk ◽  
Disease Diagnosis ◽  
Machine Intelligence ◽  
Healthcare Applications ◽  
Comprehensive Overview ◽  
Machine Learning Applications ◽  
Remote Healthcare ◽  
Healthcare Monitoring ◽  
Applications Of Machine Learning

The rapid progress in domains like machine learning, and big data has created plenty of opportunities in data-driven applications particularly healthcare. Incorporating machine intelligence in healthcare can result in breakthroughs like precise disease diagnosis, novel methods of treatment, remote healthcare monitoring, drug discovery, and curtailment in healthcare costs. The implementation of machine intelligence algorithms on the massive healthcare datasets is computationally expensive. However, consequential progress in computational power during recent years has facilitated the deployment of machine intelligence algorithms in healthcare applications. Motivated to explore these applications, this paper presents a review of research works dedicated to the implementation of machine learning on healthcare datasets. The studies that were conducted have been categorized into following groups (a) disease diagnosis and detection, (b) disease risk prediction, (c) health monitoring, (d) healthcare related discoveries, and (e) epidemic outbreak prediction. The objective of the research is to help the researchers in this field to get a comprehensive overview of the machine learning applications in healthcare. Apart from revealing the potential of machine learning in healthcare, this paper will serve as a motivation to foster advanced research in the domain of machine intelligence-driven healthcare.

ANAAC AND HIGHER EDUCATION IN, INDIA

2018 ◽  
Vol 6 (26) ◽  
Author(s):  
Seema Singh
Keyword(s):  
Higher Education ◽  
Quality Assurance ◽  
Manufacturing Industry ◽  
Practical Experience ◽  
Individual Autonomy ◽  
Economic Activities ◽  
Quality Of Higher Education ◽  
National Quality ◽  
Education In India

Quality, as we know so far, was originally developed in the manufacturing industry. In the area of higher education, the adoption of quality control has been superficial and diluted by the exercise of academic . Further, the prevailing culture of universities is often based on individual autonomy, which is zealously guarded. Thus, it is usually difficult to apply the features of quality to higher education considering the fact that quality requires. However, the quality of higher education is very important for its stakeholders. Notably, providers (funding bodies and the community at large), students, staff and employers of graduates are. The most commonly grouped dimensions of quality are product, software and service. In the changing context marked by expansion of higher education and globalization of economic activities, education has become a national concern with an international dimension. To cope with this changing context, countries have been pressurized to ensure and assure quality of higher education at a nationally comparable and internationally acceptable standard. Consequently, many countries initiated “national quality assurance mechanisms” and many more are in the process of evolving a suitable strategy. Most of the quality assurance bodies were established in the nineties and after a few years of practical experience, they are rethinking many issues of quality assurance. At this juncture where countries look for experiences and practices elsewhere, the experience of India has many valuable lessons and this report is an attempt to share those developments..

Learning and control

2018 ◽  
Author(s):  
Ivan Herreros
Keyword(s):  
Machine Learning ◽  
Reinforcement Learning ◽  
Brain Function ◽  
Control Strategies ◽  
Learning Problems ◽  
Animal Learning ◽  
Feed Forward Control ◽  
Machine Learning Applications ◽  
And Control

This chapter discusses basic concepts from control theory and machine learning to facilitate a formal understanding of animal learning and motor control. It first distinguishes between feedback and feed-forward control strategies, and later introduces the classification of machine learning applications into supervised, unsupervised, and reinforcement learning problems. Next, it links these concepts with their counterparts in the domain of the psychology of animal learning, highlighting the analogies between supervised learning and classical conditioning, reinforcement learning and operant conditioning, and between unsupervised and perceptual learning. Additionally, it interprets innate and acquired actions from the standpoint of feedback vs anticipatory and adaptive control. Finally, it argues how this framework of translating knowledge between formal and biological disciplines can serve us to not only structure and advance our understanding of brain function but also enrich engineering solutions at the level of robot learning and control with insights coming from biology.

scholarly journals How Do Machines Learn? Artificial Intelligence as a New Era in Medicine

2021 ◽  
Vol 11 (1) ◽  
pp. 32
Author(s):  
Oliwia Koteluk ◽  
Adrian Wartecki ◽  
Sylwia Mazurek ◽  
Iga Kołodziejczak ◽  
Andrzej Mackiewicz
Keyword(s):  
Artificial Intelligence ◽  
Machine Learning ◽  
Health Care ◽  
Medical Data ◽  
General Process ◽  
New Era ◽  
Automated Evaluation ◽  
Machine Learning Applications ◽  
And Training ◽  
Current Standards

With an increased number of medical data generated every day, there is a strong need for reliable, automated evaluation tools. With high hopes and expectations, machine learning has the potential to revolutionize many fields of medicine, helping to make faster and more correct decisions and improving current standards of treatment. Today, machines can analyze, learn, communicate, and understand processed data and are used in health care increasingly. This review explains different models and the general process of machine learning and training the algorithms. Furthermore, it summarizes the most useful machine learning applications and tools in different branches of medicine and health care (radiology, pathology, pharmacology, infectious diseases, personalized decision making, and many others). The review also addresses the futuristic prospects and threats of applying artificial intelligence as an advanced, automated medicine tool.

scholarly journals A top-level model of case-based argumentation for explanation: Formalisation and experiments

2021 ◽  
pp. 1-36
Author(s):  
Henry Prakken ◽  
Rosa Ratsma
Keyword(s):  
Machine Learning ◽  
Decision Making ◽  
Linear Models ◽  
Evaluation Studies ◽  
Data Sets ◽  
Machine Learning Applications ◽  
Level Model ◽  
Similarities And Differences ◽  
Further Development ◽  
Case Based

This paper proposes a formal top-level model of explaining the outputs of machine-learning-based decision-making applications and evaluates it experimentally with three data sets. The model draws on AI & law research on argumentation with cases, which models how lawyers draw analogies to past cases and discuss their relevant similarities and differences in terms of relevant factors and dimensions in the problem domain. A case-based approach is natural since the input data of machine-learning applications can be seen as cases. While the approach is motivated by legal decision making, it also applies to other kinds of decision making, such as commercial decisions about loan applications or employee hiring, as long as the outcome is binary and the input conforms to this paper’s factor- or dimension format. The model is top-level in that it can be extended with more refined accounts of similarities and differences between cases. It is shown to overcome several limitations of similar argumentation-based explanation models, which only have binary features and do not represent the tendency of features towards particular outcomes. The results of the experimental evaluation studies indicate that the model may be feasible in practice, but that further development and experimentation is needed to confirm its usefulness as an explanation model. Main challenges here are selecting from a large number of possible explanations, reducing the number of features in the explanations and adding more meaningful information to them. It also remains to be investigated how suitable our approach is for explaining non-linear models.

Sign in / Sign up

Export Citation Format

Share Document