Machine Learning is the study of methods for programming computers to learn. Computers are applied to a wide range of tasks, and for most of these it is relatively easy for programmers to design and implement the necessary software. However, there are many tasks for which this is difficult or impossible. These can be divided into four general categories. First, there are problems for which there exist no human experts. For example, in modern automated manufacturing facilities, there is a need to predict machine failures before they occur by analyzing sensor readings. Because the machines are new, there are no human experts who can be interviewed by a programmer to provide the knowledge necessary to build a computer system. A machine learning system can study recorded data and subsequent machine failures and learn prediction rules. Second, there are problems where human experts exist, but where they are unable to explain their expertise. This is the case in many perceptual tasks, such as speech recognition, hand-writing recognition, and natural language understanding. Virtually all humans exhibit expert-level abilities on these tasks, but none of them can describe the detailed steps that they follow as they perform them. Fortunately, humans can provide machines with examples of the inputs and correct outputs for these tasks, so machine learning algorithms can learn to map the inputs to the outputs. Third, there are problems where phenomena are changing rapidly. In finance, for example, people would like to predict the future behavior of the stock market, of consumer purchases, or of exchange rates. These behaviors change frequently, so that even if a programmer could construct a good predictive computer program, it would need to be rewritten frequently. A learning program can relieve the programmer of this burden by constantly modifying and tuning a set of learned prediction rules. Fourth, there are applications that need to be customized for each computer user separately. Consider, for example, a program to filter unwanted electronic mail messages. Different users will need different filters. It is unreasonable to expect each user to program his or her own rules, and it is infeasible to provide every user with a software engineer to keep the rules up-to-date. A machine learning system can learn which mail messages the user rejects and maintain the filtering rules automatically. Machine learning addresses many of the same research questions as the fields of statistics, data mining, and psychology, but with differences of emphasis. Statistics focuses on understanding the phenomena that have generated the data, often with the goal of testing different hypotheses about those phenomena. Data mining seeks to find patterns in the data that are understandable by people. Psychological studies of human learning aspire to understand the mechanisms underlying the various learning behaviors exhibited by people (concept learning, skill acquisition, strategy change, etc.).

Machine learning

Grey Wolf Optimizer

The Whale Optimization Algorithm

An overview of the self-organizing map algorithm, on which the papers in this issue are based, is presented in this article.

The Self-Organizing Map

International Journal of Computer and Applications

A natural river often finds good paths among lots of possible paths in its ways from the source to destination. These near optimal or optimal paths are obtained by the actions and reactions that occur among the water drops and the water drops with the riverbeds. The intelligent water drops (IWD) algorithm is a new swarm-based optimisation algorithm inspired from observing natural water drops that flow in rivers. In this paper, the IWD algorithm is tested to find solutions of the n-queen puzzle with a simple local heuristic. The travelling salesman problem (TSP) is also solved with a modified IWD algorithm. Moreover, the IWD algorithm is tested with some more multiple knapsack problems (MKP) in which near-optimal or optimal solutions are obtained.

The intelligent water drops algorithm: a nature-inspired swarm-based optimization algorithm

In this paper, the principal components analysis (PCA) is formulated as a continuous optimisation problem. Then, a novel metaheuristic inspired from nature is employed to explore the search space for the optimum solution to the PCA problem. The new metaheuristic is called 'galaxy-based search algorithm' or 'GbSA'. The GbSA imitates the spiral arm of spiral galaxies to search its surrounding. This spiral movement is enhanced by chaos to escape from local optimums. A local search algorithm is also utilised to adjust the solution obtained by the spiral movement of the GbSA. Experimental results demonstrate that the proposed GbSA for the PCA or GbSA-PCA is a promising tool for the PCA estimation.

Principal components analysis by the galaxy-based search algorithm: a novel metaheuristic for continuous optimisation

Purpose – The purpose of this paper is to test the capability of a new population‐based optimization algorithm for solving an NP‐hard problem, called “Multiple Knapsack Problem”, or MKP.Design/methodology/approach – Here, the intelligent water drops (IWD) algorithm, which is a population‐based optimization algorithm, is modified to include a suitable local heuristic for the MKP. Then, the proposed algorithm is used to solve the MKP.Findings – The proposed IWD algorithm for the MKP is tested by standard problems and the results demonstrate that the proposed IWD‐MKP algorithm is trustable and promising in finding the optimal or near‐optimal solutions. It is proved that the IWD algorithm has the property of the convergence in value.Originality/value – This paper introduces the new optimization algorithm, IWD, to be used for the first time for the MKP and shows that the IWD is applicable for this NP‐hard problem. This research paves the way to modify the IWD for other optimization problems. Moreover, it opens...

Intelligent water drops algorithm: A new optimization method for solving the multiple knapsack problem

A novel fuzzy facial expression recognition system based on facial feature extraction from color face images

Scientists are beginning to realize more and more that nature is a great source for inspiration in order to develop intelligent systems and algorithms. In the field of Computational Intelligence, especially Evolutionary Computation and Swarm-based systems, the degree of imitation from nature is surprisingly high and we are at the edge of developing and proposing new algorithms and/or systems, which partially or fully follow nature and the actions and reactions that happen in a specific natural system or species. Among the most recent nature-inspired swarm-based optimization algorithms is the Intelligent Water Drops (IWD) algorithm. IWD algorithms imitate some of the processes that happen in nature between the water drops of a river and the soil of the river bed. The IWD algorithm was first introduced in (Shah-Hosseini, 2007) in which the IWDs are used to solve the Travelling Salesman Problem (TSP). The IWD algorithm has also been successfully applied to the Multidimensional Knapsack Problem (MKP) (Shah-Hosseini, 2008a), n-queen puzzle (Shah-Hosseini, 2008b), and Robot Path Planning (Duan et al., 2008). Here, the IWD algorithm and its versions are specified for the TSP, the n-queen puzzle, the MKP, and for the first time, the AMT (Automatic Multilevel Thresholding). Some theoretical findings have also been reviewed for the IWD algorithm. Next section reviews briefly the related works. Section 3 examines natural water drops. Section 4 states about Intelligent Water Drops (IWDs). Section 5 specifies the Intelligent Water Drops (IWD) algorithm. Next section, reviews the convergence properties of the IWD algorithm. Section 7 includes experiments with the IWD and its versions for the four mentioned problems. Final section includes the concluding remarks.

/pdf/optimization-with-the-nature-inspired-intelligent-water-2iid7ckx26.pdf

Hamed Shah-Hosseini

Papers

The intelligent water drops algorithm: a nature-inspired swarm-based optimization algorithm

Principal components analysis by the galaxy-based search algorithm: a novel metaheuristic for continuous optimisation

Intelligent water drops algorithm: A new optimization method for solving the multiple knapsack problem

A novel fuzzy facial expression recognition system based on facial feature extraction from color face images

Optimization with the Nature-Inspired Intelligent Water Drops Algorithm