Logic learning machine

Machine learning and data mining

Problems Classification Clustering Regression Anomaly detection Association rules Reinforcement learning Structured prediction Feature engineering Feature learning Online learning Semi-supervised learning Unsupervised learning Learning to rank Grammar induction
Supervised learning (classification • regression) Decision trees Ensembles (Bagging, Boosting, Random forest) k-NN Linear regression Naive Bayes Neural networks Logistic regression Perceptron Relevance vector machine (RVM) Support vector machine (SVM)
Clustering BIRCH Hierarchical k-means Expectation-maximization (EM) DBSCAN OPTICS Mean-shift
Dimensionality reduction Factor analysis CCA ICA LDA NMF PCA t-SNE
Structured prediction Graphical models (Bayes net, CRF, HMM)
Anomaly detection k-NN Local outlier factor
Neural nets Autoencoder Deep learning Multilayer perceptron RNN Restricted Boltzmann machine SOM Convolutional neural network
Reinforcement Learning Q-Learning SARSA Temporal Difference (TD)
Theory Bias-variance dilemma Computational learning theory Empirical risk minimization Occam learning PAC learning Statistical learning VC theory
Machine learning venues NIPS ICML ML JMLR ArXiv:cs.LG
Related articles List of datasets for machine learning research Outline of machine learning
Machine learning portal

Logic Learning Machine (LLM) is a machine learning method based on the generation of intelligible rules. LLM is an efficient implementation of the Switching Neural Network (SNN) paradigm,^[1] developed by Marco Muselli, Senior Researcher at the Italian National Research Council CNR-IEIIT in Genoa. Logic Learning Machine is implemented in the Rulex suite.

LLM has been employed in different fields, including orthopaedic patient classification,^[2] DNA microarray analysis ^[3] and Clinical Decision Support System.^[4]

History

The Switching Neural Network approach was developed in the 1990s to overcome the drawbacks of the most commonly used machine learning methods. In particular, black box methods, such as multilayer perceptron and support vector machine, had good accuracy but could not provide deep insight into the studied phenomenon. On the other hand, decision trees were able to describe the phenomenon but often lacked accuracy. Switching Neural Networks made use of Boolean algebra to build sets of intelligible rules able to obtain very good performance. In 2014, an efficient version of Switching Neural Network was developed and implemented in the Rulex suite with the name Logic Learning Machine.^[5] Also a LLM version devoted to regression problems was developed.

General

Like other machine learning methods, LLM uses data to build a model able to perform a good forecast about future behaviors. LLM starts from a table including a target variable (output) and some inputs and generates a set of rules that return the output value $y$ corresponding to a given configuration of inputs. A rule is written in the form:

{\textbf {if}}{\text{ }}premise{\text{ }}{\textbf {then}}{\text{ }}consequence

where consequence contains the output value whereas premise includes one or more conditions on the inputs. According to the input type, conditions can have different forms:

for categorical variables the input value must be in a given subset : $x_{1}\in \{A,B,C,...\}$ .
for ordered variables the condition is written as an inequality or an interval: $x_{2}\leq \alpha$ or $\beta \leq x_{3}\leq \gamma$

A possible rule is therefore in the form

{\textbf {if}}{\text{ }}x_{1}\in \{A,B,C,...\}{\text{ AND }}x_{2}\leq \alpha {\text{ AND }}\beta \leq x_{3}\leq \gamma {\text{ }}{\textbf {then}}{\text{ }}y={\bar {y}}

Types

According to the output type, different versions of Logic Learning Machine have been developed:

Logic Learning Machine for classification, when the output is a categorical variable, which can assume values in a finite set
Logic Learning Machine for regression, when the output is an integer or real number.

References

↑ Muselli, Marco (2006). "Switching Neural Networks:A new connectionist model for classification". WIRN 2005 and NAIS 2005, Lecture Notes on Computer Science. 3931: 23–30.
↑ Mordenti, M.; Ferrari, E.; Pedrini, E.; Fabbri, N.; Campanacci, L.; Muselli, M.; Sangiorgi, L. (2013). "Validation of a New Multiple Osteochondromas Classification Through Switching Neural Networks". American Journal of Medical Genetics Part A. 161: 556–560. PMID 23401177. doi:10.1002/ajmg.a.35819.
↑ Cangelosi, D.; Muselli, M.; Blengio, F.; Becherini, P.; Versteeg, R.; Conte, M.; Varesio, L. (2013). "Use of Attribute Driven Incremental Discretization and Logic Learning Machine to build a prognostic classifier for neuroblastoma patients". BITS2013.
↑ Parodi, S.; Filiberti, R.; Marroni, P.; Montani, E.; Muselli, M. (2014). "Differential diagnosis of pleural mesothelioma using Logic Learning Machine". BITS2014.
↑ "Rulex: a software for knowledge extraction from data". Italian National Research Council. Retrieved 7 March 2015.

External links

Rulex official site

This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.