With the continuous expansion of data availability in many large-scale, complex, and networked systems, such as surveillance, security, Internet, and finance, it becomes critical to advance the fundamental understanding of knowledge discovery and analysis from raw data to support decision-making processes. Although existing knowledge discovery and data engineering techniques have shown great success in many real-world applications, the problem of learning from imbalanced data (the imbalanced learning problem) is a relatively new challenge that has attracted growing attention from both academia and industry. The imbalanced learning problem is concerned with the performance of learning algorithms in the presence of underrepresented data and severe class distribution skews. Due to the inherent complex characteristics of imbalanced data sets, learning from such data requires new understandings, principles, algorithms, and tools to transform vast amounts of raw data efficiently into information and knowledge representation. In this paper, we provide a comprehensive review of the development of research in learning from imbalanced data. Our focus is to provide a critical review of the nature of the problem, the state-of-the-art technologies, and the current assessment metrics used to evaluate learning performance under the imbalanced learning scenario. Furthermore, in order to stimulate future research in this field, we also highlight the major opportunities and challenges, as well as potential important research directions for learning from imbalanced data.

Learning from Imbalanced Data

From the Publisher: 
The accessible presentation of this book gives both a general view of the entire computer vision enterprise and also offers sufficient detail to be able to build useful applications. Users learn techniques that have proven to be useful by first-hand experience and a wide range of mathematical methods. A CD-ROM with every copy of the text contains source code for programming practice, color images, and illustrative movies. Comprehensive and up-to-date, this book includes essential topics that either reflect practical significance or are of theoretical importance. Topics are discussed in substantial and increasing depth. Application surveys describe numerous important application areas such as image based rendering and digital libraries. Many important algorithms broken down and illustrated in pseudo code. Appropriate for use by engineers as a comprehensive reference to the computer vision enterprise.

Computer vision : a modern approach = 计算机视觉 : 一种现代的方法

Training a deep convolutional neural network (CNN) from scratch is difficult because it requires a large amount of labeled training data and a great deal of expertise to ensure proper convergence. A promising alternative is to fine-tune a CNN that has been pre-trained using, for instance, a large set of labeled natural images. However, the substantial differences between natural and medical images may advise against such knowledge transfer. In this paper, we seek to answer the following central question in the context of medical image analysis: Can the use of pre-trained deep CNNs with sufficient fine-tuning eliminate the need for training a deep CNN from scratch? To address this question, we considered four distinct medical imaging applications in three specialties (radiology, cardiology, and gastroenterology) involving classification, detection, and segmentation from three different imaging modalities, and investigated how the performance of deep CNNs trained from scratch compared with the pre-trained CNNs fine-tuned in a layer-wise manner. Our experiments consistently demonstrated that 1) the use of a pre-trained CNN with adequate fine-tuning outperformed or, in the worst case, performed as well as a CNN trained from scratch; 2) fine-tuned CNNs were more robust to the size of training sets than CNNs trained from scratch; 3) neither shallow tuning nor deep tuning was the optimal choice for a particular application; and 4) our layer-wise fine-tuning scheme could offer a practical way to reach the best performance for the application at hand based on the amount of available data.

Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning?

eMedicine创建于1996年，由近万名临床医师作为作者或编辑参与此临床医学知识库的建设，其中编辑均是来自美国哈佛、耶鲁、斯坦福、芝加哥、德克萨斯、加州大学等各分校医学院的教授或副教授。

eMedicine

Over the past few years, there has been an increased interest in automatic facial behavior analysis and understanding. We present OpenFace — an open source tool intended for computer vision and machine learning researchers, affective computing community and people interested in building interactive applications based on facial behavior analysis. OpenFace is the first open source tool capable of facial landmark detection, head pose estimation, facial action unit recognition, and eye-gaze estimation. The computer vision algorithms which represent the core of OpenFace demonstrate state-of-the-art results in all of the above mentioned tasks. Furthermore, our tool is capable of real-time performance and is able to run from a simple webcam without any specialist hardware. Finally, OpenFace allows for easy integration with other applications and devices through a lightweight messaging system.

/pdf/openface-an-open-source-facial-behavior-analysis-toolkit-2hh0r51fvm.pdf

OpenFace: An open source facial behavior analysis toolkit

http://refbase.cvc.uab.es/files/BSF2015.pdf

WM-DOVA maps for accurate polyp highlighting in colonoscopy: Validation vs. saliency maps from physicians

http://refbase.cvc.uab.es/files/BSV2012a.pdf

Towards automatic polyp detection with a polyp appearance model

Colonoscopy is one of the best methods for screening colon cancer. A variety of research groups have proposed methods for automatic detection of polyps in colonoscopic images to support the doctors during examination. However, the problem can still not be assumed as solved. The major drawback of many approaches is the amount and quality of images used for classifier training and evaluation. Our database consists of more than four hours of high resolution video from colonoscopies which were examined and labeled by medical experts. We applied four methods of texture feature extraction based on Grey-Level-Co-occurence and Local-Binary-Patterns. Using this data, we achieved classification results with an area under the ROC-curve of up to 0.96.

Texture-Based Polyp Detection in Colonoscopy

Wireless capsule video endoscopy is a novel and challenging clinical technique, whose major reported drawback relates to the high amount of time needed for video visualization. In this paper, we propose a method for the rejection of the parts of the video resulting not valid for analysis by means of automatic detection of intestinal juices. We applied Gabor filters for the characterization of the bubble-like shape of intestinal juices in fasting patients. Our method achieves a significant reduction in visualization time, with no relevant loss of valid frames. The proposed approach is easily extensible to other image analysis scenarios where the described pattern of bubbles can be found.

/pdf/automatic-detection-of-intestinal-juices-in-wireless-capsule-1fvo8sl47m.pdf

Automatic Detection of Intestinal Juices in Wireless Capsule Video Endoscopy

This paper is concerned with the three-dimensional (3-D) reconstruction of coronary vessel centerlines and with how distortion of X-ray angiographic images affects it. Angiographies suffer from pincushion and other geometrical distortions, caused by the peripheral concavity of the image intensifier (II) and the nonlinearity of electronic acquisition devices. In routine clinical practice, where a field-of-view (FOV) of 17-23 cm is commonly used for the acquisition of coronary vessels, this distortion introduces a positional error of up to 7 pixels for an image matrix size of 512/spl times/512 and an FOV of 17 cm. This error increases with the size of the FOV. Geometrical distortions have a significant effect on the validity of the 3-D reconstruction of vessels from these images. We show how this effect can be reduced by integrating a predictive model of (un)distortion into the biplane snakes formulation for 3-D reconstruction. First, we prove that the distortion can be accurately modeled using a polynomial for each view. Also, we show that the estimated polynomial is independent of focal length, but not of changes in anatomical angles, as the II is influenced by the Earth's magnetic field. Thus, we decompose the polynomial into two components: the steady and the orientation-dependent component. We determine the optimal polynomial degree for each component, which is empirically determined to be five for the steady component and three for the orientation-dependent component. This fact simplifies the prediction of the orientation-dependent polynomial, since the number of polynomial coefficients to be predicted is lower. The integration of this model into the biplane snakes formulation enables us to avoid image unwarping, which deteriorates image quality and therefore complicates vessel centerline feature extraction. Moreover, we improve the biplane snake behavior when dealing with wavy vessels, by means of using generalized gradient vector flow. Our experiments show that the proposed methods in this paper decrease up to 88% the reconstruction error obtained when geometrical distortion effects are ignored. Tests on imaged phantoms and real cardiac images are presented as well.

Fernando Vilariño

Papers

WM-DOVA maps for accurate polyp highlighting in colonoscopy: Validation vs. saliency maps from physicians

Towards automatic polyp detection with a polyp appearance model

Texture-Based Polyp Detection in Colonoscopy

Automatic Detection of Intestinal Juices in Wireless Capsule Video Endoscopy

Predictive (un)distortion model and 3-D reconstruction by biplane snakes