Comparative Analysis of Detection Algorithms for Corner and Blob Features in Image Processing
 Author: Xiong Xing, Choi ByungJae
 Organization: Xiong Xing; Choi ByungJae
 Publish: International Journal of Fuzzy Logic and Intelligent Systems Volume 13, Issue4, p284~290, 25 Dec 2013

ABSTRACT
Feature detection is very important to image processing area. In this paper we compare and analyze some characteristics of image processing algorithms for corner and blob feature detection. We also analyze the simulation results through image matching process. We show that how these algorithms work and how fast they execute. The simulation results are shown for helping us to select an algorithm or several algorithms extracting corner and blob feature.

KEYWORD
Features from accelerated segment test , Laplacian of the Gaussian , Difference of Gaussian , Corner , Blob , Interest point , Image feature

1. Introduction
In computer vision, a feature can be defined as an interesting part or point of an image, as in [1]. A feature contains some information which apart from its neighborhood. It means that the feature is considered distinctiveness within a certain range. These features could be shape, texture, color, edge, corner and blob etc. Features have high informative contents and appear over and over again in different images. They may be described by the shape, edge or color of objects, or the correlations between two or more images or objects. Until now, many image processing algorithms are based on image feature such as photo stitching, selflocalization of robot, objects recognition, object tracking and 3D reconstruction.
In [1], image feature detection refers to methods to compute abstraction of image. Tuytelaars and Mikolajczyk [2] addressed an overview of invariant interest point detectors, how they evolved over time, how they work, and what their respective strengths and weaknesses are. The three robust feature detection methods scale invariant feature transform (SIFT), principal component analysisSIFT and speeded up robust features (SURF) were summarized in [3]. In [4], blob feature detection is defined as one of feature detection. The blob detection is a mathematical method which detects regions or points in a digital image. The regions or points have noticeable difference with their neighborhood. Additionally, a blob is a region or point in which some properties are invariant within a prescribed range of values. Kim and Seo [5] introduced genetic programming based corner detectors for an image processing. In [68], some applications for image processing were presented.
In this paper, we present that how some existed corner and blob feature detection algorithms work and how long they execute for an analysis of some different algorithms. And we also discover the application context for each algorithm. The related works are presented in Section 2. In Section 3, the overview of the corner and blob feature detection algorithms are discussed. Some experiments and simulation results are shown in Section 4. We describe some discussions and future works in Section 5. We here see that Harris corner detection can detect a large number of interest points, but they contain less information for interest point region. Difference of Gaussian (DoG) and determinant of the Hessian (DoH) have similar results in interest point detection, but DoH has faster than that of DoG.
2. Some Algorithms for Feature Detection
In 1988, Harris and Stephens [9] proposed a method to detect a corner of an image, which is later called Harris Corner Detector. The method is based on the eigenvalues of the secondmoment matrix. The Harris Corner can detect robust corner of an image. However, the algorithm only detects the location of corner, and avoids the interest points which not belong to the corner.
In 1997, a new algorithm called features from accelerated segment test (FAST) was proposed for corner detection. The most contribution of FAST is its computational efficiency. Comparing with other wellknown feature detection algorithms such as Harris Detector, smallest univalue segment assimilating nucleus and DoG, it is so faster. So, FAST has been applied in many real time applications such as cleaning robot.
Laplacian of the Gaussian (LoG) is one of the first and also most common blob detectors. The blob feature can be detected from different scale. In comparison with corner algorithms, the scalespace theory is leaded into for detecting interest point of image and a blob contains more information than a corner feature. It means that the point can be described by its neighborhood around it. The feature detection is performed to blob detection from corner detection. In 1999, Lowe used DoG to replace LoG for detecting the interest point with rapid calculation.
Because Hessian matrix has a good performance in accuracy, DoH was also used for detection of the blob feature. In 2006, Bay and Tuytelaars used the scalenormalized DoH from Haar wavelets to detect the interest point. From their experiment results, DoH has similar effect in the interest point detection with DoG, but it is three times faster than that of DoG.
In order to detect image features which are invariant through image affine transformation, Mikolajczyk and Schmid [10] proposed Harris affine detector in. Harris affine detector identifies initial blob using HarrisLaplace detector and then normalizes the blob using affine shape adaption. And the blob is estimated iteratively. The algorithm can identify similar regions between images. However, the algorithm expends a great of time.
3. Blob Feature Detection
For the comparison of several algorithms, we describe the implementation of the detection methodology by step
3.1 Harris Corner Detector
Let the image be given by
I ,where
H stands for a Harris matrix, Wis weighted window,I_{x} andI_{y} is the partial derivatives ofI , andG (x ,y ,σ ) is Gaussian matrix and expressed in Eq. (5).For each pixel, Harris and Stephens used Eq. (2) to compute corner response for the computational efficiency,
where
k is a tunable sensitivity parameter. If theM_{c} of the point is greater than the given threshold, the point is considered to be a corner.Kanade and Tomasi [11] computed directly the
M_{c} by Eq. (3):where λ_{1} and λ_{2} are the eigenvalues of
H .A large number of experiments have approved that the method is better results because the corner is more stable for tracking.
3.2 FAST
The FAST uses a circle of 16 pixels to determine whether the center of circle is a corner, like Figure 1.
1) Assume that the intensity of the center of the circle is Ip. Set a threshold intensity value T.2) For fast computing, Ip is first compared to the intensity of pixels I1, I5, I9, and I13. If at least three pixels of these four pixels are all brighter than Ip + T or darker than Ip − T, the corner will exist. If not, it will be quit.3) If a set of N contiguous pixels out of the 16 needs to be either above or below Ip by the value T, then Ip is a corner.
3.3 LoG
The Laplacian is a 2D isotropic measure of the second order derivative of an image. The Laplacian
L (x ,y ) of the original imageI is given as follows.Because the original image is represented as a set of discrete pixels, the Laplacian can be approximated by using a discrete convolution kernel as shown in Figure 2.
Because the Laplacian filter is very sensitive to a noise, it is common to smooth image using a Gaussian kernel of Eq. (5) before applying the Laplacian filter.
So, the twostep process is called LoG operation. The overall process for LoG is as follows:
In order to detect the blob features which are invariant in different environment, a multiscale
σ is used to filter the original image. A scalenormalized approach is necessary to obtain a multiscale blob detector with automatic scale selection as the following Eq. (7).The points are considered as the interest points (blob feature) which are local maxima or minima of
3.4 DoG
Similar to LoG, the image I is first smoothed by convolution with Gaussian kernel of a certain width
σ . Then a different Gaussian kernelσ + ∆σ is used to smooth the original image again. The difference of these two Gaussian smoothed images is called DoG, as the following Eq. (9).In fact, DoG is a bandpass filter, which can remove high frequency components representing noise and some low frequency components representing the homogeneous areas.
The DoG is one of applicants for edge detection and blob detection in image processing algorithm. The best known application is a keypoint detection proposed by Lowe [12] in 2004.
For fast computing in [12], DoG is deﬁned as an operator or a convolution kernel like the following Eq. (10).
3.5 DoH
The Hessian matrix is a square matrix of the second partial derivatives of the function and it could be described by the local curvature of an image as mentioned in [13].
Similar to LoG, DoH considers scalespace to detect the interest points.
The interest points are selected using the following function to ﬁnd maxima in scalespace.
DoH was used in SURF [10], the detection effect of the interest points is similar with SIFT. However, the detection time is three times faster than that of the SIFT through integral image used.
3.6 Harris Affine Region Detector
According to afﬁneinvariant theory and multiscale Harris corner points detection theory, Harris afﬁne detector uses following iterative methods to detect interest points.
1) Initialize the search space through HarrisLaplace detector. U(0) = Identity Matrix E2) Normalize ellipsoid region to circle region using the shape adaptation matrix which generated in pervious iteration U(k−1), center in = U(k−1)−1X(k−1) 3) Select the integration scale, . The is determined as the scale that maximizes the LoG.4) Select the derivation scale, . The derivation scale is taken to be related to the integration scale through a constant factor: , where s ∈ [0.5, ··· , 0.75], and
where µis the second moment matrix, and λmin and λmax are the Maximum and Minimum eigenvalues of the matrix µ, respectively. µ is also defined as
5) Spatial localization: select the point that computes the Harris corner measure (cornerness) within an 8point neighborhood around . Find the maximum in the neighborhood, is as follows:
where the window W() is the set of 8nearest neighborhood of the pervious point.
Compute the location of interest point X(k)
6) Update the shape adaptation transformation matrix U.
where
7) Compute the stopping criterion. Suficiently close implies the following stopping condition.Mikolajczyk and Schmid had good result with εc = 0.05.
Meanwhile, a detection algorithm called Harris afﬁne region detector are proposed. The Harris afﬁne detector relies on the combination of corner points detected thorough Harris corner detection, Gaussian scale space, and afﬁne shape adaptation algorithm. And like the Harris afﬁne algorithm, the Hessian afﬁne replaces Harris matrix using Hessian matrix for detecting afﬁne interest points.
4. Simulation and Analysis
In this Section, some simulation results of corner and blob detection algorithm will be presented. For comparison, two sets of images are selected for simulation. The images were captured in different view perspectives as shown in Figure 3.
4.1 Harris Corner Detector
According to the method in Section 3, we use four images for the simulation. The simulation results are shown as followings.
From two set of images in Figure 4, a large number of corners are detected. In the same position of two images, the same corners were detected.
4.2 LoG
Scalespace has been led to detect interest points. The interest point not only contains the coordinate, but also the scale which descripts an effect of interest point to its neighbor.
From Figure 5, the detected interest points are less than that of Harris corner detection algorithm and its computation speed is also slower.
4.3 HarrisLaplace
Because of similar results between LoG and DoG, the scalespace has been used for Harr corner detection, which is called Harris Laplace detection.
From Figure 6, the results have a smller number of interest points. The computing time is similar to that of LoG.
4.4 DoH
In DoH, integral image has been led to fast detection of interest points. The computing time is also three times faster than that of LoG.
The ﬁgure 7 shows interest points detected by DoH algorithm. The great advantage of DoH is computing time. If scalespace is not particularly large, DoH can be used for realtime interest points detection.
4.5 Harris Af？ne Region Detection
For the afﬁne transformation and denser descript object, afﬁne shape adaptation is used. The feature of images is not descripted by a circle such as those of LoG and DoH, but an ellipse.
From Figure 8, each interest point contains an ellipse region. We could see that the ellipses have similar pixels and similar orientations by the comparison of two sets of images. This provides great convenience for more accurate matching in two images. However, the iterative time for learning is equally vast.
5. Conclusion
In this paper, a comparative analysis for some corner and blob detection algorithms has been done. Harris corner detection can detect a large number of interest points and has good performance in interest point’s robust and computing time. These points can reﬂect texture of objects. However, these points contain less information for interest point region. Through scalespace has led to detect interest points of image, the interest points have been replaced by blobs. The blob is easier to reﬂect the feature of interest point region in different environment change such as illumination, rotation and scale of images. For simulation results in DoG and DoH, both have similar result in interest point detection, but DoH has faster than that of DoG. Harris affine region detection algorithm added affine shape adaptation for region normalization. The blob detection satisfies image affine transformation. However, the computing time and complexity are much increased by the iteration.
Con？ict of Interest
No potential conﬂict of interest relevant to this article was reported.

[]

[]

[]

[Figure 1.] Set of N contiguous pixels to be determined as a corner (using FAST). p is a center of circle. FAST, features from accelerated segment test.

[]

[Figure 2.] Discrete approximations to the Laplacian filter.

[]

[]

[]

[]

[]

[]

[]

[]

[]

[]

[]

[]

[]

[]

[Figure 3.] Capture images in different viewpoints.

[Figure 4.] Simulation results of Harris corner detection algorithm.

[Figure 5.] Interest points by Laplacian of the Gaussian detection algorithm.

[Figure 6.] Interest points by HarrisLaplace detection algorithm.

[Figure 7.] Interest points by DoH detection algorithm.

[Figure 8.] Simulation results of Harris affine detection algorithm.