Rule-based machine learning

Machine learning and data mining
Part of a series on
Paradigms Supervised learning Unsupervised learning Semi-supervised learning Self-supervised learning Reinforcement learning Transfer learning Meta-learning Few-shot learning Zero-shot learning Online learning Batch learning Curriculum learning Rule-based learning Neuro-symbolic AI Neuromorphic engineering Quantum machine learning
Problems Classification Generative modeling Regression Clustering Dimensionality reduction Density estimation Anomaly detection Data cleaning AutoML Association rules Semantic analysis Structured prediction Feature engineering Feature learning Learning to rank Grammar induction Ontology learning Multimodal learning
Supervised learning (classification • regression) Apprenticeship learning Decision trees Ensembles Bagging Boosting Random forest k-NN Linear regression Naive Bayes Artificial neural networks Logistic regression Perceptron Relevance vector machine (RVM) Support vector machine (SVM)
Clustering BIRCH CURE Hierarchical k-means Fuzzy Expectation–maximization (EM) DBSCAN OPTICS Mean shift
Dimensionality reduction Factor analysis Exploratory CCA ICA LDA NMF PCA PGD t-SNE SDL
Structured prediction Graphical models Bayes net Conditional random field Hidden Markov
Anomaly detection RANSAC k-NN Local outlier factor Isolation forest
Neural networks Autoencoder Deep learning Feedforward neural network Recurrent neural network LSTM GRU ESN reservoir computing Boltzmann machine Restricted GAN Diffusion model SOM Convolutional neural network U-Net LeNet AlexNet DeepDream Neural field Neural radiance field Physics-informed neural networks Transformer Vision Mamba Spiking neural network Memtransistor Electrochemical RAM (ECRAM)
Reinforcement learning Q-learning Policy gradient SARSA Temporal difference (TD) Multi-agent Self-play
Learning with humans Active learning Crowdsourcing Human-in-the-loop Mechanistic interpretability RLHF
Model diagnostics Coefficient of determination Confusion matrix Learning curve ROC curve
Mathematical foundations Kernel machines Bias–variance tradeoff Computational learning theory Empirical risk minimization Occam learning PAC learning Statistical learning VC theory Topological deep learning
Journals and conferences AAAI CVPR ECCV ECML PKDD EMNLP ICCV NeurIPS ICML ICLR IJCAI ML JMLR
Related articles Glossary of artificial intelligence List of datasets for machine-learning research List of datasets in computer vision and image processing Outline of machine learning
v t e

Rule-based machine learning (RBML) is a term in computer science intended to encompass any machine learning method that identifies, learns, or evolves 'rules' to store, manipulate or apply.^[1]^[2]^[3] The defining characteristic of a rule-based machine learner is the identification and utilization of a set of relational rules that collectively represent the knowledge captured by the system.

Rule-based machine learning approaches include knowledge extraction,^[4] learning classifier systems,^[5] association rule learning,^[6] artificial immune systems,^[7] and any other method that relies on a set of rules, each covering contextual knowledge.

While rule-based machine learning is conceptually a type of rule-based system, it is distinct from traditional rule-based systems, which are often hand-crafted, and other rule-based decision makers. This is because rule-based machine learning applies some form of learning algorithm such as Rough sets theory^[8] to identify and minimise the set of features and to automatically identify useful rules, rather than a human needing to apply prior domain knowledge to manually construct rules and curate a rule set.

Rules

The output of rule-based machine learning consists of decision rules, which typically take the form of an '{IF:THEN} expression', (e.g. {IF 'condition' THEN 'result'}, or as a more specific example, {IF 'red' AND 'octagon' THEN 'stop-sign}). An individual decision rule is not in itself a model, since the rule is only applicable when its condition is satisfied. Therefore rule-based machine learning methods typically comprise a set of rules, or knowledge base, that collectively make up the prediction model usually known as decision algorithm. Rules can also be interpreted in various ways depending on the domain knowledge, data types(discrete or continuous) and in combinations.

RIPPER

Repeated incremental pruning to produce error reduction (RIPPER) is a propositional rule learner proposed by William W. Cohen as an optimized version of IREP.^[9]

R.ROSETTA

R.ROSETTA^[10] is an implementation of rough set theory^[11] framework that gathers combinatorial statistics and provides results in the form of IF-THEN classification rules. For example, IF Gene A = elevated and Gene B = suppressed THEN decision = Cancer. These rules are generated through Boolean reasoning^[12], where the IF part consists of conjuncts, referred to as descriptors (predecessors or left-hand side), and the THEN part represents the decision (successor or right-hand side).

References

↑ Bassel, George W.; Glaab, Enrico; Marquez, Julietta; Holdsworth, Michael J.; Bacardit, Jaume (2011-09-01). "Functional Network Construction in Arabidopsis Using Rule-Based Machine Learning on Large-Scale Data Sets". The Plant Cell. 23 (9): 3101–3116. Bibcode:2011PlanC..23.3101B. doi:10.1105/tpc.111.088153. ISSN 1532-298X. PMC 3203449. PMID 21896882.
↑ M., Weiss, S.; N., Indurkhya (1995-01-01). "Rule-based Machine Learning Methods for Functional Prediction". Journal of Artificial Intelligence Research. 3 (1995): 383–403. arXiv:cs/9512107. Bibcode:1995cs.......12107W. doi:10.1613/jair.199. S2CID 1588466.{{cite journal}}: CS1 maint: multiple names: authors list (link)
↑ "GECCO 2016 | Tutorials". GECCO 2016. Retrieved 2016-10-14.
↑ Komorowski, Jan; Øhrn, Aleksander (February 1999). "Modelling prognostic power of cardiac tests using rough sets". Artificial Intelligence in Medicine. 15 (2): 167–191. doi:10.1016/s0933-3657(98)00051-7. ISSN 0933-3657. PMID 10082180.
↑ Urbanowicz, Ryan J.; Moore, Jason H. (2009-09-22). "Learning Classifier Systems: A Complete Introduction, Review, and Roadmap". Journal of Artificial Evolution and Applications. 2009: 1–25. doi:10.1155/2009/736398. ISSN 1687-6229.
↑ Zhang, C. and Zhang, S., 2002. Association rule mining: models and algorithms. Springer-Verlag.
↑ De Castro, Leandro Nunes, and Jonathan Timmis. Artificial immune systems: a new computational intelligence approach. Springer Science & Business Media, 2002.
↑ ISBN 978-0-7923-1472-1.
↑ Agah, Arvin (2013). Medical Applications of Artificial Intelligence. CRC Press. ISBN 9781439884331. Retrieved 13 August 2017.
↑ Garbulowski, Mateusz; Diamanti, Klev; Smolińska, Karolina; Baltzer, Nicholas; Stoll, Patricia; Bornelöv, Susanne; Øhrn, Aleksander; Feuk, Lars; Komorowski, Jan (2021-03-06). "R.ROSETTA: an interpretable machine learning framework". BMC Bioinformatics. 22 (1): 110. doi:10.1186/s12859-021-04049-z. ISSN 1471-2105. PMC 7937228. PMID 33676405.
↑ Pawlak, Zdzisław (1982-10-01). "Rough sets". International Journal of Computer & Information Sciences. 11 (5): 341–356. doi:10.1007/BF01001956. ISSN 1573-7640.
↑ Brown, Frank M. (1990). Boolean Reasoning: The Logic of Boolean Equations. New York, NY: Springer. ISBN 978-1-4757-2078-5.

Rules

RIPPER

R.ROSETTA

See also

References

Related Essays & Commentary

Cargo Cult Science

The Human Engine Inside the Efficiency Machine

The first post, built on a secure new foundation.

Why We Don’t Let Migrant Workers Drive