scholarly journals Turning 30: New Ideas in Inductive Logic Programming

2020 ◽  
Author(s):  
Andrew Cropper ◽  
Sebastijan Dumančić ◽  
Stephen H. Muggleton
Keyword(s):  
Machine Learning ◽  
Logic Programming ◽  
Inductive Logic Programming ◽  
Inductive Logic ◽  
Background Knowledge ◽  
Training Data ◽  
Future Research ◽  
Logic Programs ◽  
Recursive Programs ◽  
New Ideas

Common criticisms of state-of-the-art machine learning include poor generalisation, a lack of interpretability, and a need for large amounts of training data. We survey recent work in inductive logic programming (ILP), a form of machine learning that induces logic programs from data, which has shown promise at addressing these limitations. We focus on new methods for learning recursive programs that generalise from few examples, a shift from using hand-crafted background knowledge to learning background knowledge, and the use of different technologies, notably answer set programming and neural networks. As ILP approaches 30, we also discuss directions for future research.

scholarly journals Inductive logic programming at 30

2021 ◽  
Author(s):  
Andrew Cropper ◽  
Sebastijan Dumančić ◽  
Richard Evans ◽  
Stephen H. Muggleton
Keyword(s):  
Machine Learning ◽  
Logic Programming ◽  
Inductive Logic Programming ◽  
Logic Program ◽  
Inductive Logic ◽  
Future Research ◽  
Predicate Invention ◽  
Meta Level ◽  
Recursive Programs ◽  
Training Examples

AbstractInductive logic programming (ILP) is a form of logic-based machine learning. The goal is to induce a hypothesis (a logic program) that generalises given training examples and background knowledge. As ILP turns 30, we review the last decade of research. We focus on (i) new meta-level search methods, (ii) techniques for learning recursive programs, (iii) new approaches for predicate invention, and (iv) the use of different technologies. We conclude by discussing current limitations of ILP and directions for future research.

scholarly journals Forgetting to Learn Logic Programs

2020 ◽  
Vol 34 (04) ◽  
pp. 3676-3683
Author(s):  
Andrew Cropper
Keyword(s):  
Logic Programming ◽  
Inductive Logic Programming ◽  
Inductive Logic ◽  
Background Knowledge ◽  
Experimental Results ◽  
Learning Performance ◽  
Sample Complexity ◽  
Logic Programs ◽  
Hypothesis Space ◽  
Alternative Approaches

Most program induction approaches require predefined, often hand-engineered, background knowledge (BK). To overcome this limitation, we explore methods to automatically acquire BK through multi-task learning. In this approach, a learner adds learned programs to its BK so that they can be reused to help learn other programs. To improve learning performance, we explore the idea of forgetting, where a learner can additionally remove programs from its BK. We consider forgetting in an inductive logic programming (ILP) setting. We show that forgetting can significantly reduce both the size of the hypothesis space and the sample complexity of an ILP learner. We introduce Forgetgol, a multi-task ILP learner which supports forgetting. We experimentally compare Forgetgol against approaches that either remember or forget everything. Our experimental results show that Forgetgol outperforms the alternative approaches when learning from over 10,000 tasks.

scholarly journals Learning Large Logic Programs By Going Beyond Entailment

2020 ◽  
Author(s):  
Andrew Cropper ◽  
Sebastijan Dumančic
Keyword(s):  
Logic Programming ◽  
Loss Function ◽  
Inductive Logic Programming ◽  
State Of The Art ◽  
Inductive Logic ◽  
Program Synthesis ◽  
Loss Functions ◽  
Logic Programs ◽  
Binary Decision ◽  
Best First Search

A major challenge in inductive logic programming (ILP) is learning large programs. We argue that a key limitation of existing systems is that they use entailment to guide the hypothesis search. This approach is limited because entailment is a binary decision: a hypothesis either entails an example or does not, and there is no intermediate position. To address this limitation, we go beyond entailment and use 'example-dependent' loss functions to guide the search, where a hypothesis can partially cover an example. We implement our idea in Brute, a new ILP system which uses best-first search, guided by an example-dependent loss function, to incrementally build programs. Our experiments on three diverse program synthesis domains (robot planning, string transformations, and ASCII art), show that Brute can substantially outperform existing ILP systems, both in terms of predictive accuracies and learning times, and can learn programs 20 times larger than state-of-the-art systems.

An Analysis of Motion Transition in Subtle Errors using Inductive Logic Programming

2018 ◽  
Vol 10 (1) ◽  
pp. 27-37
Author(s):  
Niken Prasasti Martono ◽  
Keisuke Abe ◽  
Takehiko Yamaguchi ◽  
Hayato Ohwada
Keyword(s):  
Logic Programming ◽  
Inductive Logic Programming ◽  
Inductive Logic ◽  
Training Data ◽  
Classification Rule ◽  
Leap Motion ◽  
Induction Technique ◽  
Finger Motion ◽  
Logical Programming ◽  
The Difference

This article seeks to utilize the data collected from virtual reality (VR)-based software and a leap-motion device used for learning of subtle errors in mild cognitive impairment (MCI) cases to enable early detection of MCI by analyzing the classification rules for errors (action slips) based on finger-action transitions when performing instrumental activities of daily living (IADL). Finger motion was recorded as a time-series database. An induction technique known as Inductive-Logic Programming (ILP), which uses logical and clausal language to represent the training data, was then used to discover a concise classification rule using logical programming. The content within this article was able to generate rules on how action transitions of the finger in the experiments were related to the pattern of micro-errors that indicate the difference of error regarding the length of the no-motion state of the finger.

Discovering and organizing noun-verb collocations in specialized corpora using inductive logic programming

2006 ◽  
Vol 11 (2) ◽  
pp. 209-243 ◽  
Author(s):  
Vincent Claveau ◽  
Marie-Claude L'Homme
Keyword(s):  
Machine Learning ◽  
Logic Programming ◽  
Inductive Logic Programming ◽  
Inductive Logic ◽  
Success Rates ◽  
Machine Learning Technique ◽  
Acquisition Process ◽  
Semantic Relationships ◽  
Learning Technique ◽  
French Corpus

This article presents a method for discovering and organizing noun-verb (N-V) combinations found in a French corpus on computing. Our aim is to find N-V combinations in which verbs convey a “realization meaning” as defined in the framework of lexical functions (Mel’čuk 1996, 1998). Our approach, chiefly corpus-based, uses a machine learning technique, namely Inductive Logic Programming (ILP). The whole acquisition process is divided into three steps: (1) isolating contexts in which specific N-V pairs occur; (2) inferring linguistically-motivated rules that reflect the behaviour of realization N-V pairs; (3) projecting these rules on corpora to find other valid N-V pairs. This technique is evaluated in terms of the relevance of the rules inferred and in terms of the quality (recall and precision) of the results. Results obtained show that our approach is able to find these very specific semantic relationships (the realization N-V pairs) with very good success rates.

scholarly journals Induction of Non-Monotonic Logic Programs to Explain Boosted Tree Models Using LIME

2019 ◽  
Vol 33 ◽  
pp. 3052-3059 ◽  
Author(s):  
Farhad Shakerin ◽  
Gopal Gupta
Keyword(s):  
Logic Programming ◽  
Inductive Logic Programming ◽  
State Of The Art ◽  
Inductive Logic ◽  
Nonmonotonic Logic ◽  
Global Behavior ◽  
Logic Programs ◽  
Tree Models ◽  
Boosted Tree ◽  
Classification Evaluation

We present a heuristic based algorithm to induce nonmonotonic logic programs that will explain the behavior of XGBoost trained classifiers. We use the technique based on the LIME approach to locally select the most important features contributing to the classification decision. Then, in order to explain the model’s global behavior, we propose the LIME-FOLD algorithm —a heuristic-based inductive logic programming (ILP) algorithm capable of learning nonmonotonic logic programs—that we apply to a transformed dataset produced by LIME. Our proposed approach is agnostic to the choice of the ILP algorithm. Our experiments with UCI standard benchmarks suggest a significant improvement in terms of classification evaluation metrics. Meanwhile, the number of induced rules dramatically decreases compared to ALEPH, a state-of-the-art ILP system.

ILP Applications to Software Engineering

2011 ◽  
pp. 74-102
Author(s):  
Daniele Gunetti
Keyword(s):  
Software Engineering ◽  
Logic Programming ◽  
Inductive Logic Programming ◽  
Inductive Logic ◽  
Logic Programs ◽  
Automatic Synthesis ◽  
Integrated Framework ◽  
Testing And Debugging ◽  
True Logic

Though inductive logic programming (ILP for short) should mean the “induction of logic programs”, most research and applications of this area are only loosely related to logic programming. In fact, the automatic synthesis of “true” logic programs is a difficult task, since it cannot be done without a lot of information on the sought programs, and without the ability to describe in a simple way well-restricted searching spaces. In this chapter, we argue that, if such knowledge is available, inductive logic programming can be used as a valid tool for software engineering, and we propose an integrated framework for the development, maintenance, reuse, testing, and debugging of logic programs.

Inductive logic programming applied for knowledge representation in computer music/ Programação lógica indutiva aplicada para representação do conhecimento em música computacional

2021 ◽  
Vol 5 (4) ◽  
pp. 1840-1857
Author(s):  
Clenio B. Gonçalves Junior ◽  
Murillo Rodrigo Petrucelli Homem
Keyword(s):  
Machine Learning ◽  
Systematic Review ◽  
Knowledge Representation ◽  
Logic Programming ◽  
Inductive Logic Programming ◽  
Computer Music ◽  
Inductive Logic ◽  
Essential Element ◽  
Research Field ◽  
Musical Knowledge

 In Computer Music, the knowledge representation process is an essential element for the development of systems. Methods have been applied to provide the computer with the ability to generate conclusions based on previously established experience and definitions. In this sense, Inductive Logic Programming presents itself as a research field that incorporates concepts of Logic Programming and Machine Learning, its declarative character allows musical knowledge to be presented to non-specialist users in a naturally understandable way. The present work performs a systematic review based on approaches that use Inductive Logic Programming in the representation of musical knowledge. Questions that these studies seek to address were raised, as well as identifying characteristic aspects related to their application.

Sign in / Sign up

Export Citation Format

Share Document