Improving liver lesions classification on CT/MRI images based on Hounsfield Units attenuation and deep learning

Improving liver lesions classification on CT/MRI images based on Hounsfield Units attenuation and deep learning

Anh-Cang Phan
Vinh Long University Of Technology Education

Email: cangpa@vlute.edu.vn

Hung-Phi Cao
Vinh Long University Of Technology Education

Email: caohungphi@vlute.edu.vn

Thi-Nguu-Huynh Le
Vinh Long University Of Technology Education

Thanh-Ngoan Trieu
Can Tho University and University of Western Brittany, France

Email: ngoan.trieuthanh@etudiant.univ-brest.fr

Thuong-Cang Phan
Can Tho University

Email: ptcang@cit.ctu.edu.vn

IF : 1.488 Scopus (Q3) CiteScore 2.2

Abstract

The early sign detection of liver lesions plays an extremely important role in preventing, diagnosing, and treating liver diseases. In fact, radiologists mainly consider Hounsfield Units to locate liver lesions. However, most studies focus on the analysis of unenhanced computed tomography images without considering an attenuation difference between Hounsfield Units before and after contrast injection. Therefore, the purpose of this work is to develop an improved method for the automatic detection and classification of common liver lesions based on deep learning techniques and the variations of the Hounsfield Units density on computed tomography scans. We design and implement a multi-phase classification model developed on the Faster Region-based Convolutional Neural Networks (Faster R-CNN), Region-based Fully Convolutional Networks (R-FCN), and Single Shot Detector Networks (SSD) with the transfer learning approach. The model considers the variations of the Hounsfield Unit density on computed tomography scans in four phases before and after contrast injection (plain, arterial, venous, and delay). The experiments are conducted on three common types of liver lesions including liver cysts, hemangiomas, and hepatocellular carcinoma. Experimental results show that the proposed method accurately locates and classifies common liver lesions. The liver lesions detection with Hounsfield Units gives high accuracy of 100%. Meanwhile, the lesion classification achieves an accuracy of 95.1%. The promising results show the applicability of the proposed method for automatic liver lesions detection and classification. The proposed method improves the accuracy of liver lesions detection and classification compared with some preceding methods. It is useful for practical systems to assist doctors in the diagnosis of liver lesions. In our further research, an improvement can be made with big data analysis to build real-time processing systems and we expand this study to detect lesions from all parts of the human body, not just the liver.

Introduction

The incidence of liver cancer is rising globally, with it being the 7th most common cancer worldwide, according to GLOBOCAN. In 2020, there were approximately 905,677 new cases and 830,180 deaths. In Vietnam, liver cancer was the most common cancer among men and the fifth among women, with 26,418 new cases. This alarming trend highlights the need for automatic detection and classification of liver lesions for early treatment. Previous studies have mainly focused on liver lesion segmentation and detection, neglecting the importance of HU variations in different phases of contrast-enhanced CT images. Our study aims to classify common liver lesions based on these attenuation variations using deep learning techniques to assist in early detection and treatment.

Types of liver lesions

Figure 1: Illustration of liver lesions.
a) Liver cysts (NAN) ; b) Liver hemangioma (HEM); c) Hepatocellular carcinoma (HCC)

Hounsfield Unit

The HU measurement is a way to describe radiation attenuation in different tissues and thus makes it easier to identify abnormalities.

Liver tumors usually have a higher density (HU > 65), while those with similar density (40 < HU < 60) are harder to distinguish. Lesions with lower density (HU < 40) may be cysts or tumors. In challenging cases with similar or slightly different attenuation, detection and classification are difficult. Doctors rely on CT scans taken at specific phases (arterial, venous, delay) before and after contrast injection, using HU density variations to classify lesions and determine labels.

Proposed Method

Figure 2: The proposed multi-phase model for detection and classification of liver lesions

- Step 1. data pre-preocessing: The process involves equalization, noise removal using a Gauss filter, and normalization of images for accurate liver lesion detection. HU values are computed and used for segmenting and labeling the dataset, with automatic lesion detection supported by medical experts

- Step 2. feature extraction and classification: We propose an improved multi-phase classification model for detecting and classifying liver lesions by utilizing deep learning models based on Faster R-CNN, R-FCN, and SSD, with modifications like ResNet-101 and MobileNet-V2 as backbones. These models extract lesion features across multiple CT phases, enhancing detection accuracy and reducing computation time using transfer learning and pre-trained networks.

Table 3: Scenarios of the proposed model for experiments.

Results

We conduct the training process on CT images before and after contrast injection for the detection and classification of liver lesions. After training, we proceed to the test phase.

Figure 3: Test result of the detection and classification of liver lesions for three scenario.
Figure 4: Comparison of mAP metrics with and without considering the density variation of HU on CT images.

This indicates that scenario 1 is more efficient in extracting, detecting, and classifying liver lesions compared to scenarios 2 and 3.

Table 4: Comparison of the proposed scenarios through evaluation metrics.

Conclusions

In this work, we propose an efficient classification model for automatic detection and classification of liver lesions in CT images across four phases: plain, arterial, venous, and delay. The model leverages advanced deep learning networks (Faster R-CNN, R-FCN, and SSD) with various backbone networks like ResNet-101 and MobileNet-V2 for feature extraction. Incorporating HU attenuation in four-phase CT images enhances classification accuracy by aiding automatic segmentation and labeling of liver lesions. Experiments on multi-phase CT images of liver cysts, hemangiomas, and hepatocellular carcinoma reveal that considering HU density achieves 100% accuracy in lesion detection. Classification accuracy across three scenarios is 95.1%, 94.1%, and 94.9%, respectively, with scenario 1 performing best. The proposed methods outperform previous methods in accuracy, though the training time with large datasets remains a limitation. Future work will focus on optimizing training with parallel processing and expanding the study to include lesions in other body parts.

References

  1. Adam, A., Dixon, A.K., Gillard, J.H., Schaefer-Prokop, C., Grainger, R.G., Allison, D.J., 2014. Grainger & Allison's Diagnostic Radiology E-Book, sixth ed. Elsevier Health Sciences.
  2. Brant, W.E., Helms, C.A., 2012. Fundamentals of Diagnostic Radiology, fourth ed. Lippincott Williams & Wilkins.
  3. Dai, J., Li, Y., He, K., Sun, J., 2016. R-fcn: object detection via region-based fully convolutional networks. In: Advances in Neural Information Processing Systems, Barcelona, Spain, pp. 379–387. December 5-10.
  4. Girshick, R., Donahue, J., Darrell, T., Malik, J., 2014. Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA, pp. 580-587. June 23-28.
  5. Jang, H.J., Kim, T.K., Lim, H.K., Park, S.J., Sim, J.S., Kim, H.Y., Lee, J.H., 2003. Hepatic hemangioma: atypical appearances on ct, mr imaging, and sonography. Am. J. Roentgenol. 180, 135–141.