검색 전체 메뉴
PDF
맨 위로
OA 학술지
Automatic Intelligent Asymmetry Detection Using Digital Infrared Imaging with K-Means Clustering
  • 비영리 CC BY-NC
  • 비영리 CC BY-NC
ABSTRACT
Automatic Intelligent Asymmetry Detection Using Digital Infrared Imaging with K-Means Clustering
KEYWORD
Digital infrared thermal imaging , YCbCr color model , K-means clustering , Asymmetry analysis , Object labeling
  • 1. Introduction

    Digital infrared thermal imaging (DITI) is a fast, passive, non-contact, and non-invasive alternative to conventional clinical thermometers for monitoring body temperature [1]. DITI has been used in many areas of medical science as well as in the field of non-destructive testing (NDT). In the field of NDT, it is mainly used for surface defect detection and online monitoring of processes [2-4].

    The usefulness of thermograms for the diagnosis of physical illnesses was reported as early as 1963 [5]. Over several decades, with rapidly developing computer technology and artificial intelligence, DITI has been extensively studied in many fields of medical science, such as diabetic neuropathy [6], vascular disorders [7], fever screening [8], dry eye syndrome diagnosis [9], and breast cancer detection [10-13], and even as a pre-screening tool for the detection of canine bone cancer [14]. For example, it has been reported that when state-of-the-art infrared technology was combined with advanced computer hardware and software technology, the sensitivity for breast cancer detection was 97% in 92 patients undergoing breast biopsy [15]. Further, a system with an artificial neural network for breast cancer detection with DITI showed particularly low sensitivity and was useful for women under the age of 50 years [11].

    For a DITI analysis in medical science, the power of such pre-screening or detection of extraordinary conditions comes from an asymmetry analysis in which temperature differences between the diseased and the contralateral healthy body parts are analyzed [1]. Since cancer cells with their higher metabolic rate are hotter than normal cells, which makes cancerous tumors appear as hotspots in DIT images, this technique is particularly useful in female breast imaging [13]. While higher-order statistics such as variance, skewness, kurtosis, and joint entropy are effective measures of asymmetry [13], there are other technical methodologies to develop an automatic asymmetry analysis system, such as independent component analysis [12], Hough transform-aided image segmentation and pattern classification [16], and fuzzy logic [17].

    In this study, we focus on asymmetry detection using DITI with different color models and propose a method based on the well-known K-means clustering algorithm [18]. The YCbCr color model that we have used in this study is a way of encoding RGB information and successfully applying it to a human skin model for face detection [19]. As illustrated in Figure 1, we first extract the blue and red regions from the YCbCr space-transferred DITI and then apply K-means to form the object clusters. Then, we search the center of gravity among the extracted objects and form a circle to define the magnitude of the red/blue objects. Thereafter, the degree of asymmetry can be easily analyzed.

    2. Automatic Asymmetry Detection

       2.1 Object Extraction by K-Means Clustering

    As one can see from Figure 2, the spectrum of colors indicates an increase or decrease in the amount of infrared radiation being emitted from the body surface in a DIT image; here, red denotes a relatively high temperature and blue, a relatively low temperature. In order to effectively separate the red and blue regions, we transfer the usual RGB color model to the YCrCb color model. The idea of such color model transfer is based on the fact that humans are more sensitive to brightness than to a color itself; thus, brightness contrast is a more reliable measure. In the YCrCb color model, Y denotes the luminance, and Cb and Cr represent the blue-difference and the red-difference chroma components. Thus, the red region and the blue region are extracted on the basis of such Cb and Cr values, as shown in Figure 3.

    The next step is to make clusters by K-means [18] and extract regions using region labeling. K-means is a well-known unsupervised learning algorithm to form K clusters from data with iterative updates of k centers so that the within-cluster sum of squares is minimized.

    After clustering, we apply a region labeling method [20] to connect the related pixels in order to form an object of concern. We adopt repetitive region labeling. The effect of K-means clustering and region labeling are shown in Figure 4.

    In order to analyze the extracted red and blue regions, we set the center of gravity points Center(x, y) according to equation (1).

    image

    where k denotes the number of pixels and xi, yi represent the coordinates of pixel P(xi, yi) in the target object.

    Using these center points, we draw circles that contain all the target regions, as shown in Figure 5.

       2.2 DITI Diagnosis

    Using DITI, medical experts judge whether a subject has an unhealthy status on the basis of the degree of asymmetry in the body temperature distribution. Figure 6 shows some typical DIT images that represent healthy and unhealthy subjects.

    As one can see from Figure 6(a), a healthy subject has a balanced distribution of body temperature and shows a high degree of left–right symmetry. Furthermore, there exist highly contrasted regions of high temperature (popliteal, cubital fossa, flesh, and breast) and of low temperature (elbow, heel, and knee). However, an unhealthy subject does not show such characteristic features in DITI, as shown in Figure 6(b).

    Thus, we can easily provide some quantitative measures of such asymmetry in the form of blue/red distribution statistics and left–right imbalance. If there is a highly skewed distribution of the red region, it is a sign of unhealthiness due to high body temperature. In contrast, if the blue region is overwhelming in the lower body or hands/feet, the subject may be suffering from hypothermia or circulatory disturbances.

    Figure 7 illustrates how to measure the left–right symmetry in the proposed method. As explained in the previous section, we draw circles from the center points decided by K-means clustering and compare the left part and the right part. Typical asymmetries are found when a subject has a herniated cervical (lumbar) disc, chronic shoulder pain (upper body) or spinal disk disorder, rheumatoid arthritis, or knee arthralgia (lower body).

    3. Experiment

    The proposed method was implemented with a Microsoft Visual Studio 2010 tool, and experiments were performed on an IBM-compatible PC with Intel Core i7-2600 CPU @ 3.40 GHz and 4-GB RAM. A typical snapshot of the software is shown in Figure 8.

    Our software was tested by medical experts from the medical school of Pusan National University, Korea, and the typical outputs of the healthy and unhealthy subjects are shown in Figure 9. It was tested more than 20 times, and multiple medical experts verified the efficacy of the software.

    4. Conclusions

    In this paper, we propose a method to analyze DIT images automatically by using K-means unsupervised clustering and region labeling on the YCrCb color model. Since human vision is more sensitive to the brightness contrast than to a color itself, the YCrCb color model helps to extract more salient red/blue regions with respect to the body temperature, and the distribution statistics and the asymmetry degree are crucial for the diagnosis of a subject as healthy or unhealthy. In the experiment, the implemented software reacts appropriately to real data. In the future, we intend to study certain related research themes such as a clinical evaluation of the statistical parameters and specific-disease-related color–body part pattern detection.

참고문헌
  • 1. Lahiri B. B., Bagavathiappan S., Jayakumar T., Philip J. 2012 “Medical applications of infrared thermography: a review,” [Infrared Physics & Technology] Vol.55 P.221-235 google cross ref
  • 2. Maldague X. 2001 “Theory and Practice of Infrared Technology for Nondestructive Testing,” google
  • 3. Lahiri B. B., Bagavathiappan S., Reshmi P. R., Philip J., Jayakumar T., Raj B. 2012 “Quantification of defects in composites and rubber materials using active thermography,” [Infrared Physics & Technology] Vol.55 P.191-199 google cross ref
  • 4. Chou Y. C., Yao L. 2009 “Automatic diagnostic system of electrical equipment using infrared thermography,” [Soft Computing and Pattern Recognition 2009. IEEE] P.155-160 google
  • 5. Barnes R. B. 1963 Thermography of the Human body [Science] Vol.140 P.870-877 google cross ref
  • 6. Bagavathiappan S., Philip J., Jayakumar T., Raj B., Rao P. N. S., Varalakshmi M., Mohan V. 2010 “Correlation between plantar foot temperature and diabetic neuropathy: a case study by using an infrared thermal imaging technique,” [Journal of diabetes science and technology] Vol.4 P.1386-1392 google cross ref
  • 7. Bagavathiappan S., Saravanan T., Philip J., Jayakumar T., Raj B., Karunanithi R., Panicker T., Korath M.P., Jagadeesan K. 2009 “Infrared thermal imaging for detection of peripheral vascular disorders,” [Journal of Medical Physics] Vol.34 P.43-47 google cross ref
  • 8. Bitar D., Goubar A., Desenclos J. C. 2009 “International travels and fever screening during epidemics: a literature review on the effectiveness and potential use of non-contact infrared thermometers,” [Eurosurveillance] Vol.14 P.1-5 google
  • 9. Zelichowska B., Rozycki R., Tlustochowicz M., Kujawa A., Kalicki B., Murawski P. 2005 “The usefulness of the thermography in the dry eye syndrome,” [Klinika Oczna] Vol.107 P.483-487 google
  • 10. Amalu W. C., Hobbins W. B., Head J. F., Elliot R. L. 2006 “Infrared imaging of the breast ? an overview,” google
  • 11. Wishart G. C., Campisi M., Boswell M., Chapman D., Shackleton V., Iddles S., Hallett A., Britton P. D. 2010 “The accuracy of digital infrared imaging for breast cancer detection in women undergoing breast biopsy.” [European Journal of Surgical Oncology] Vol.36 P.535-540 google cross ref
  • 12. oquete L. B, Ortega S., Miguel-Jim?nez J. M., Rodr?guez-Ascariz J. M., Blanco R. 2012 “Automated detection of breast cancer in thermal infrared images, based on independent component analysis,” [Journal of medical systems] Vol.36 P.103-111 google cross ref
  • 13. Kuruganti P. T., Qi H. 2002 “Asymmetry analysis in breast cancer detection using thermal infrared images,” [Engineering in Medicine and Biology, 2002. 24th Annual Conference and the Annual Fall Meeting of the Biomedical Engineering Society EMBS/BMES Conference, 2002. Proceedings of the Second Joint. IEEE] Vol.2 P.1155-1156 google
  • 14. Subedi S., Umbaugh S. E., Fu J., Marino D. J., Loughin C. A., Sackman J. 2014 “Thermographic image analysis as a pre-screening tool for the detection of canine bone cancer.” [SPIE Optical Engineering Applications. International Society for Optics and Photonics] P.92171D-92171D google
  • 15. Arora N., Martins D., Ruggerio D., Tousimis E., Swistel A. J., Osborne M. P., Simmons R. M. 2008 “Effectiveness of a noninvasive digital infrared thermal imaging system in the detection of breast cancer,” [The American Journal of Surgery] Vol.196 P.523-526 google cross ref
  • 16. Qi H., Head J. 2001 “Asymmetry analysis using automatic segmentation and classification for breast cancer detection in thermograms,” [Proc. 23rd Annual Int’ Conference of the IEEE EMBS, Turkey] P.2866-2869 google
  • 17. Tan T. Z., Quek C., Ng G. S., Ng E. Y. K. 2007 “A novel cognitive interpretation of breast cancer thermography with complementary learning fuzzy neural memory structure,” [Expert Systems with Applications] Vol.33 P.652-666 google cross ref
  • 18. Duda R. O., Hart P. E. 1973 Pattern Classification and Scene Analysis google
  • 19. Phung S. L., Bouzerdoum A., Chai D. 2002 “A novel skin color model in YCbCr color space and its application to human face detection,” [Image Processing. 2002. Proceedings. 2002 International Conference on. IEEE] Vol.1 P.I-289-I-292 google
  • 20. Fisher B., Perkins S., Walker A., Wolfart E. 1996 Hypermedia Image Processing Reference google
OAK XML 통계
이미지 / 테이블
  • [ Figure 1: ]  Overall process of asymmetry analysis.
    Overall process of asymmetry analysis.
  • [ Figure 2: ]  Example digital infrared thermal image.
    Example digital infrared thermal image.
  • [ Figure 3: ]  Color region extraction based on Cb and Cr: (a) blue region and (b) red region.
    Color region extraction based on Cb and Cr: (a) blue region and (b) red region.
  • [ Figure 4: ]  Effects of object extraction process. (a) After K-means clustering and (b) after region labeling.
    Effects of object extraction process. (a) After K-means clustering and (b) after region labeling.
  • [ ] 
  • [ Figure 5: ]  Maximal regions of target objects.
    Maximal regions of target objects.
  • [ Figure 6: ]  Comparison of (a) healthy and (b) unhealthy subjects by digital infrared thermal imaging.
    Comparison of (a) healthy and (b) unhealthy subjects by digital infrared thermal imaging.
  • [ Figure 7: ]  Asymmetry analysis. (a) Original image, (b) range of left object, (c) range of right object, and (b) symmetry check.
    Asymmetry analysis. (a) Original image, (b) range of left object, (c) range of right object, and (b) symmetry check.
  • [ Figure 8: ]  Example snapshot.
    Example snapshot.
  • [ Figure 9: ]  Application of real data. (a) Healthy object and (b) unhealthy object.
    Application of real data. (a) Healthy object and (b) unhealthy object.
(우)06579 서울시 서초구 반포대로 201(반포동)
Tel. 02-537-6389 | Fax. 02-590-0571 | 문의 : oak2014@korea.kr
Copyright(c) National Library of Korea. All rights reserved.