Machine Learning is the study of methods for programming computers to learn. Computers are applied to a wide range of tasks, and for most of these it is relatively easy for programmers to design and implement the necessary software. However, there are many tasks for which this is difficult or impossible. These can be divided into four general categories. First, there are problems for which there exist no human experts. For example, in modern automated manufacturing facilities, there is a need to predict machine failures before they occur by analyzing sensor readings. Because the machines are new, there are no human experts who can be interviewed by a programmer to provide the knowledge necessary to build a computer system. A machine learning system can study recorded data and subsequent machine failures and learn prediction rules. Second, there are problems where human experts exist, but where they are unable to explain their expertise. This is the case in many perceptual tasks, such as speech recognition, hand-writing recognition, and natural language understanding. Virtually all humans exhibit expert-level abilities on these tasks, but none of them can describe the detailed steps that they follow as they perform them. Fortunately, humans can provide machines with examples of the inputs and correct outputs for these tasks, so machine learning algorithms can learn to map the inputs to the outputs. Third, there are problems where phenomena are changing rapidly. In finance, for example, people would like to predict the future behavior of the stock market, of consumer purchases, or of exchange rates. These behaviors change frequently, so that even if a programmer could construct a good predictive computer program, it would need to be rewritten frequently. A learning program can relieve the programmer of this burden by constantly modifying and tuning a set of learned prediction rules. Fourth, there are applications that need to be customized for each computer user separately. Consider, for example, a program to filter unwanted electronic mail messages. Different users will need different filters. It is unreasonable to expect each user to program his or her own rules, and it is infeasible to provide every user with a software engineer to keep the rules up-to-date. A machine learning system can learn which mail messages the user rejects and maintain the filtering rules automatically. Machine learning addresses many of the same research questions as the fields of statistics, data mining, and psychology, but with differences of emphasis. Statistics focuses on understanding the phenomena that have generated the data, often with the goal of testing different hypotheses about those phenomena. Data mining seeks to find patterns in the data that are understandable by people. Psychological studies of human learning aspire to understand the mechanisms underlying the various learning behaviors exhibited by people (concept learning, skill acquisition, strategy change, etc.).

Machine learning

Data Mining - Concepts and Techniques.

Intrusion detection based upon computational intelligence is currently attracting considerable interest from the research community. Characteristics of computational intelligence (CI) systems, such as adaptation, fault tolerance, high computational speed and error resilience in the face of noisy information, fit the requirements of building a good intrusion detection model. Here we want to provide an overview of the research progress in applying CI methods to the problem of intrusion detection. The scope of this review will encompass core methods of CI, including artificial neural networks, fuzzy systems, evolutionary computation, artificial immune systems, swarm intelligence, and soft computing. The research contributions in each field are systematically summarized and compared, allowing us to clearly define existing research challenges, and to highlight promising new research directions. The findings of this review should provide useful insights into the current IDS literature and be a good source for anyone who is interested in the application of CI approaches to IDSs or related fields.

/pdf/review-the-use-of-computational-intelligence-in-intrusion-1r8rwmtm1h.pdf

Review: The use of computational intelligence in intrusion detection systems: A review

Diabetes mellitus is a chronic disease characterized by hyperglycemia. It may cause many complications. According to the growing morbidity in recent years, in 2040, the world's diabetic patients will reach 642 million, which means that one of the ten adults in the future is suffering from diabetes. There is no doubt that this alarming figure needs great attention. With the rapid development of machine learning, machine learning has been applied to many aspects of medical health. In this study, we used decision tree, random forest and neural network to predict diabetes mellitus. The dataset is the hospital physical examination data in Luzhou, China. It contains 14 attributes. In this study, five-fold cross validation was used to examine the models. In order to verity the universal applicability of the methods, we chose some methods that have the better performance to conduct independent test experiments. We randomly selected 68994 healthy people and diabetic patients' data, respectively as training set. Due to the data unbalance, we randomly extracted 5 times data. And the result is the average of these five experiments. In this study, we used principal component analysis (PCA) and minimum redundancy maximum relevance (mRMR) to reduce the dimensionality. The results showed that prediction with random forest could reach the highest accuracy (ACC = 0.8084) when all the attributes were used.

/pdf/predicting-diabetes-mellitus-with-machine-learning-1nnh9wy811.pdf

Predicting Diabetes Mellitus With Machine Learning Techniques.

The Self-Organizing Map (SOM) algorithm has attracted a great deal of interest among researches and practitioners in a wide variety of fields. The SOM has been analyzed extensively, a number of variants have been developed and, perhaps most notably, it has been applied extensively within fields ranging from engineering sciences to medicine, biology, and economics. We have collected a comprehensive list of 5384 scientific papers that use the algorithms, have benefited from them, or contain analyses of them. The list is intended to serve as a source for literature surveys. The present addendum contains 2092 new articles, mainly from the years 1998-2002. We have provided a keyword index to help finding articles of interest, and additionally a modern automatically constructed variant of a thematic index: a WEBSOM interface to the whole article collection of years 1981-2000. The SOM of SOMs is available at http://websom.hut.fi/websom/somref/search.cgi for browsing and searching the collection.

Bibliography of Self-Organizing Map SOM) Papers: 1998-2001 Addendum

This paper presents the inception and subsequent revisions of an immune-inspired supervised learning algorithm, Artificial Immune Recognition System (AIRS). It presents the immunological components that inspired the algorithm and describes the initial algorithm in detail. The discussion then moves to revisions of the basic algorithm that remove certain unnecessary complications of the original version. Experimental results for both versions of the algorithm are discussed and these results indicate that the revisions to the algorithm do not sacrifice accuracy while increasing the data reduction capabilities of AIRS.

/pdf/artificial-immune-recognition-system-airs-an-immune-inspired-1794j43k2z.pdf

Artificial Immune Recognition System (AIRS): An Immune-Inspired Supervised Learning Algorithm

This paper presents a new supervised learning paradigm inspired by mechanisms exhibited in immune systems. This work provides an explication of a resource limited artificial immune classification algorithm, named AIRS (Artificial Immune Recognition System), and provides results on simulated data sets to demonstrate the fundamental behavior of the algorithm.

/pdf/a-resource-limited-artificial-immune-classifier-1ps86eqe1h.pdf

A resource limited artificial immune classifier

This paper revisits the Artificial Immmune Recognition System (AIRS) that has been developed as an immune-inspired supervised learning algorithm. Certain unnecessary complications of the original algorithm are discussed and means of overcomming these complexities are proposed. Experimental evidence is presented to support these revisions which do not sacrifice the accuracy of the original algorihtm but, rather, maintain accuracy whilst increasing the simplicity and data reduction capabilities of AIRS.

Artificial Immune Recognition System (AIRS): Revisions and Refinements

This paper presents a new tool for supervised learning, modeled on resource limited Artificial Immune Systems. A supervised learning system, it is self-regulatory, efficient, and stable under a wide range of user-set parameters. Its performance is comparable to well-established classifiers on a variety of testbeds, including the iris data, the diabetes classification problem, the ionosphere problem, and the rock/metal classification problem for mine detection.

/pdf/a-new-classifier-based-on-resource-limited-artificial-immune-1wd3wf15ry.pdf

A new classifier based on resource limited artificial immune systems

The mammalian immune system is a highly complex, inherently parallel, distributed system. The field of Artificial Immune Systems (AIS) has developed a wide variety of algorithms inspired by the immune system, few of which appear to capitalize on the parallel nature of the system from which inspiration was taken. The work in this paper presents the first steps at realizing a parallel artificial immune system for classification. A simple parallel version of the classification algorithm Artificial Immune Recognition System (AIRS) is presented. Initial results indicate that a decrease in overall runtime can be achieved through fairly naive techniques. The need for more theoretical models of the behavior of the algorithm is discussed.

/pdf/exploiting-parallelism-inherent-in-airs-an-artificial-immune-4vz3l2jsa8.pdf

Andrew Watkins

Papers

Artificial Immune Recognition System (AIRS): An Immune-Inspired Supervised Learning Algorithm

A resource limited artificial immune classifier

Artificial Immune Recognition System (AIRS): Revisions and Refinements

A new classifier based on resource limited artificial immune systems

Exploiting Parallelism Inherent in AIRS, an Artificial Immune Classifier