Machine Learning is the study of methods for programming computers to learn. Computers are applied to a wide range of tasks, and for most of these it is relatively easy for programmers to design and implement the necessary software. However, there are many tasks for which this is difficult or impossible. These can be divided into four general categories. First, there are problems for which there exist no human experts. For example, in modern automated manufacturing facilities, there is a need to predict machine failures before they occur by analyzing sensor readings. Because the machines are new, there are no human experts who can be interviewed by a programmer to provide the knowledge necessary to build a computer system. A machine learning system can study recorded data and subsequent machine failures and learn prediction rules. Second, there are problems where human experts exist, but where they are unable to explain their expertise. This is the case in many perceptual tasks, such as speech recognition, hand-writing recognition, and natural language understanding. Virtually all humans exhibit expert-level abilities on these tasks, but none of them can describe the detailed steps that they follow as they perform them. Fortunately, humans can provide machines with examples of the inputs and correct outputs for these tasks, so machine learning algorithms can learn to map the inputs to the outputs. Third, there are problems where phenomena are changing rapidly. In finance, for example, people would like to predict the future behavior of the stock market, of consumer purchases, or of exchange rates. These behaviors change frequently, so that even if a programmer could construct a good predictive computer program, it would need to be rewritten frequently. A learning program can relieve the programmer of this burden by constantly modifying and tuning a set of learned prediction rules. Fourth, there are applications that need to be customized for each computer user separately. Consider, for example, a program to filter unwanted electronic mail messages. Different users will need different filters. It is unreasonable to expect each user to program his or her own rules, and it is infeasible to provide every user with a software engineer to keep the rules up-to-date. A machine learning system can learn which mail messages the user rejects and maintain the filtering rules automatically. Machine learning addresses many of the same research questions as the fields of statistics, data mining, and psychology, but with differences of emphasis. Statistics focuses on understanding the phenomena that have generated the data, often with the goal of testing different hypotheses about those phenomena. Data mining seeks to find patterns in the data that are understandable by people. Psychological studies of human learning aspire to understand the mechanisms underlying the various learning behaviors exhibited by people (concept learning, skill acquisition, strategy change, etc.).

Machine learning

Data analysis plays an indispensable role for understanding various phenomena. Cluster analysis, primitive exploration with little or no prior knowledge, consists of research developed across a wide variety of communities. The diversity, on one hand, equips us with many tools. On the other hand, the profusion of options causes confusion. We survey clustering algorithms for data sets appearing in statistics, computer science, and machine learning, and illustrate their applications in some benchmark data sets, the traveling salesman problem, and bioinformatics, a new field attracting intensive efforts. Several tightly related topics, proximity measure, and cluster validation, are also discussed.

/pdf/survey-of-clustering-algorithms-6zezqhbjyo.pdf

Survey of clustering algorithms

Wireless indoor positioning systems have become very popular in recent years. These systems have been successfully used in many applications such as asset tracking and inventory management. This paper provides an overview of the existing wireless indoor positioning solutions and attempts to classify different techniques and systems. Three typical location estimation schemes of triangulation, scene analysis, and proximity are analyzed. We also discuss location fingerprinting in detail since it is used in most current system or solutions. We then examine a set of properties by which location systems are evaluated, and apply this evaluation method to survey a number of existing systems. Comprehensive performance comparisons including accuracy, precision, complexity, scalability, robustness, and cost are presented.

Survey of Wireless Indoor Positioning Techniques and Systems

25. Multiple Imputation for Nonresponse in Surveys. By D. B. Rubin. ISBN 0 471 08705 X. Wiley, Chichester, 1987. 258 pp. £30.25.

Multiple Imputation for Nonresponse in Surveys

http://www.eecs.northwestern.edu/~peters/references/LocalizationTechniquesMaoAustralia.pdf

Wireless sensor network localization techniques

We estimate the location of a WLAN user based on radio signal strength measurements performed by the user’s mobile terminal. In our approach the physical properties of the signal propagation are not taken into account directly. Instead the location estimation is regarded as a machine learning problem in which the task is to model how the signal strengths are distributed in different geographical areas based on a sample of measurements collected at several known locations. We present a probabilistic framework for solving the location estimation problem. In the empirical part of the paper we demonstrate the feasibility of this approach by reporting results of field tests in which a probabilistic location estimation method is validated in a real-world indoor environment.

/pdf/a-probabilistic-approach-to-wlan-user-location-estimation-30le1u55mz.pdf

A Probabilistic Approach to WLAN User Location Estimation

Some location estimation methods, such as the GPS satellite navigation system, require nonstandard features either in the mobile terminal or the network. Solutions based on generic technologies not intended for location estimation purposes, such as the cell-ID method in GSM/GPRS cellular networks, are usually problematic due to their inadequate location estimation accuracy. In order to enable accurate location estimation when only inaccurate measurements are available, we present an approach to location estimation that is different from the prevailing geometric one. We call our approach the statistical modeling approach. As an example application of the proposed statistical modeling framework, we present a location estimation method based on a statistical signal power model. We also present encouraging empirical results from simulated experiments supported by real-world field tests.

/pdf/a-statistical-modeling-approach-to-location-estimation-1t2krr6d5b.pdf

A statistical modeling approach to location estimation

A method for estimating a receiver's location (X) in a wireless communication environment (RN) having several channels. Each channel has at least one signal parameter (V) that varies with location (X) differently from the other channels. A set of calibration data (CD) is determined for each calibration point, each set comprising the location (X) and at least one measured signal parameter (V) for each of several channels. The calibration data (CD) serve as a basis for a statistical model (SM) of the signal parameters (V) versus a receiver's location. A set of observed signal parameters (CO) is determined, the set comprising at least one signal parameter (V) for each of several channels at the receiver's location (X). A location estimate (LE) approximating the location (X) of the receiver (R) is determined on the basis of the statistical model (SM) and the set of observed signal parameters (CO).

Location estimation in wireless telecommunication networks

Mobile networking is developing and proliferating at a high speed. Many estimates say that the number of mobile telecom subscribers will exceed 1 billion in the year 2003. Among the terminals deployed, there will be hundreds of millions of Internet-enabled ones making Mobile Internet a reality for the big masses. The terminals and/or the mobile networks are now able to determine the position of the terminal on the earth with more and more precision. This is the basis for the new class of services called Location-Based Services (LBS). The paper discusses this new emerging application area that some people consider the central novel application class of Mobile Internet. The main topic of the paper is the question, how Geographic Information Systems (GIS) and the data hosted currently by them could be used in the context of LBS. We analyze their properties and relate them with the needs of LBS. We also present our LBS pilot system that is using XML-based vector formal for city maps and runs on Java-enabled mobile terminals, PDAs and smartphones.

Developing GIS-supported location-based services

B-Course is a free web-based online data analysis tool, which allows the users to analyze their data for multivariate probabilistic dependencies. These dependencies are represented as Bayesian network models. In addition to this, B-Course also offers facilities for inferring certain type of causal dependencies from the data. The software uses a novel "tutorial stylerdquo; user-friendly interface which intertwines the steps in the data analysis with support material that gives an informal introduction to the Bayesian approach adopted. Although the analysis methods, modeling assumptions and restrictions are totally transparent to the user, this transparency is not achieved at the expense of analysis power: with the restrictions stated in the support material, B-Course is a powerful analysis tool exploiting several theoretically elaborate results developed recently in the fields of Bayesian and causal modeling. B-Course can be used with most web-browsers (even Lynx), and the facilities include features such as automatic missing data handling and discretization, a flexible graphical interface for probabilistic inference on the constructed Bayesian network models (for Java enabled browsers), automatic prettyHyphen;printed layout for the networks, exportation of the models, and analysis of the importance of the derived dependencies. In this paper we discuss both the theoretical design principles underlying the B-Course tool, and the pragmatic methods adopted in the implementation of the software.

/pdf/b-course-a-web-based-tool-for-bayesian-and-causal-data-1k8bye6p0l.pdf

Henry Tirri

Papers

A Probabilistic Approach to WLAN User Location Estimation

A statistical modeling approach to location estimation

Location estimation in wireless telecommunication networks

Developing GIS-supported location-based services

B-course: a web-based tool for bayesian and causal data analysis