Skip to main content

Automatic pulmonary fissure detection and lobe segmentation in CT chest images

Abstract

Background

Multi-detector Computed Tomography has become an invaluable tool for the diagnosis of chronic respiratory diseases. Based on CT images, the automatic algorithm to detect the fissures and divide the lung into five lobes will help regionally quantify, amongst others, the lung density, texture, airway and, blood vessel structures, ventilation and perfusion.

Methods

Sagittal adaptive fissure scanning based on the sparseness of the vessels and bronchi is employed to localize the potential fissure region. Following a Hessian matrix based line enhancement filter in the coronal slice, the shortest path is determined by means of Uniform Cost Search. Implicit surface fitting based on Radial Basis Functions is used to extract the fissure surface for lobe segmentation. By three implicit fissure surface functions, the lung is divided into five lobes. The proposed algorithm is tested by 14 datasets. The accuracy is evaluated by the mean (±S.D.), root mean square, and the maximum of the shortest Euclidian distance from the manually-defined fissure surface to that extracted by the algorithm.

Results

Averaged over all datasets, the mean (±S.D.), root mean square, and the maximum of the shortest Euclidian distance are 2.05 ± 1.80, 2.46 and 7.34 mm for the right oblique fissure. The measures are 2.77 ± 2.12, 3.13 and 7.75 mm for the right horizontal fissure, 2.31 ± 1.76, 3.25 and 6.83 mm for the left oblique fissure. The fissure detection works for the data with a small lung nodule nearby the fissure and a small lung subpleural nodule. The volume and emphysema index of each lobe can be calculated. The algorithm is very fast, e.g., to finish the fissure detection and fissure extension for the dataset with 320 slices only takes around 50 seconds.

Conclusions

The sagittal adaptive fissure scanning can localize the potential fissure regions quickly. After the potential region is enhanced by a Hessian based line enhancement filter, Uniform Cost Search can extract the fissures successfully in 2D. Surface fitting is able to obtain three implicit surface functions for each dataset. The current algorithm shows good accuracy, robustness and speed, may help locate the lesions into each lobe and analyze them regionally.

Introduction

Worldwide, chronic respiratory diseases, such as Chronic Obstructive Pulmonary Disease (COPD), are a major cause of premature deaths in adults [1]. COPD alone, accounts for 4 million deaths annually, and is the third leading cause of death in the United States [2]. The early and accurate identification of chronic respiratory diseases is essential for their prevention and control.

Multi-detector Computed Tomography (CT) has become an effective and invaluable tool for the diagnosis of chronic respiratory diseases. Using modern CTs, within one breath hold the lung can be imaged resulting in several hundreds of high-resolution and near-isotropic sections with thicknesses of approximate 0.5 mm [3]. Based on these images, advanced techniques of image processing can quantitatively assess the volumes of the lung [4], the characteristics of lung cancer [5], the structures of airway tree[6, 7] and blood vessel [8], and the size of emphysema-like region [9], and help study human lungs from both structural and functional viewpoints [10].

With the arrival of more precise diagnosis and treatment, it is essential to segment the lung into its constituent regions, or lobes, which are separated by fissures. In non-pathological cases, pulmonary fissures are the double layers of infolded invaginations of visceral pleura, and exit between the different lobes. In the left lung, the oblique fissure separates the lower lobe from the upper lobe, whereas in the right lung, the oblique and horizontal fissures separate the lower lobe from the upper and middle lobes respectively. Once the lobe is extracted accurately, one can regionally characterize and quantify, amongst others, the lung density, texture, airway structure, blood vessel structure, ventilation and perfusion. For the diagnosis of pulmonary emphysema for example, the volume, emphysema volume (EV), emphysema index (EI) and mean density can be specified for each lobe, which facilitates preoperative planning and postoperative evaluation of lung-volume reduction surgery [11].

Segmentation of lung lobes from the chest CT images is a grand challenge for several reasons. First of all, the normal fissures are about 1–3 mm thick, and have a density near that of the soft tissue, which makes it hard to see the full stretch of the fissure. Secondly, the appearances of the fissures exhibit a large range of natural variations, and may be incomplete or even absent and distorted by various diseases. Furthermore, different CT protocols may lead to different appearances of the fissure [12]. For conventional CT, the fissures are visualized as lucent bands devoid of vascularity, whereas they appear as sharp lines for high-resolution CT [13].

The segmentation of the individual lung lobes is an extensively studied topic. Two classes of algorithms are available; the first group only uses the appearances of the fissures, while the other also utilizes further anatomical information from the lung, bronchus, and vessel structures. A brief summary of the model, feature and extraction methods in literature is presented in Table 1, and further details are given below.

Table 1 Selected algorithm and used models, features and extraction scheme

Algorithms based on fissure segmentation

Pu et al. have developed an automated fissure detection scheme using a computational geometry approach. The marching cubes algorithm, Laplacian smoothing and extended Gaussian image pyramids are applied to enhance the surface shaped structure within the lung volume [14]. Finally, implicit surface fitting using Radial Basis Functions (RBF) is adopted to segment the lobes [15]. This scheme reduces the dependence on anatomical knowledge and other underlying assumptions, and is less sensitive to noise. As such the integrity of the pulmonary fissure can be assessed [16]. On the other hand, its primary limitation is that some plane-like structure resulting from diseases may be incorrectly considered as the fissure.

Van Rikxoort et al. on the other hand have presented a pattern recognition approach, using a supervised fissure enhancement filter [17]. In the training stage, 57 features (40 from several Gaussian filters at different scales, and 12 derived from the Hessian matrix) are calculated for each voxel after which a classifier is trained. Next, a multiphase supervised filtering is executed. This approach gives better fissure detection results than the Hessian matrix filter alone, at the cost of higher computational complexity and does not extend well to pathological cases (e.g. fibrosis). Utilizing the fissure appearance of a curvilinear line, Wei et al. have proposed an algorithm including the adaptive fissure sweeping and wavelet transform [18].

An interactive lobe segmentation algorithm has been proposed by Ross et al., in which a handful of points are given by the user, and then thin plate splines (TPS) is employed to interpolate a minimally curved fissure surface [19]. This method is later extended to an automatic method using particles, thin plate splines, and maximum a posteriori estimation [20]. Computational complexity however, makes this solution less practical.

Wang et al. have introduced a curve growing algorithm modeled by a Bayesian network, which is influenced by the image data and prior shapes of the fissure [21]. They replaced the original image by the ridge map in [22]. However, both the approaches require manual initialization.

Algorithms based on anatomical knowledge

At the University of Iowa, several lung lobe segmentation algorithms have been proposed. An atlas-driven method is used to find the oblique fissure, in which a fuzzy reasoning system is employed to search the fissure by the combined information from the ridgeness image intensity, smoothness, and the atlas-based search initialization [23]. The algorithm however often yields incorrect results on subjects with unusual anatomy and pathology. Ukil et al. used information acquired from airway and vascular tree segmentations to get an approximate region of interest for the fissures, which are further refined by 3D optimal surface detection [24]. For incomplete fissures, incorrect initial lobar segmentation may occur in this algorithm.

In the works performed by Van Rikxoort et al., a multi-atlas lobe segmentation algorithm using the lung borders, airways and fissures was proposed to improve the robustness and cope with the incomplete fissures [25–27]. Recently Wei et al. developed a new approach with three stages: (a) texture analysis based on a neural network classifier and gray-level run length matrix texture features to localize the fissure region; (b) fissure region analysis by projections resulting; and finally (c) fissure identification by dynamic programming to get the optimal path [28].

Several methods have been introduced by the team from Fraunhofer MEVIS. After combining the 3D Euclidean distance transform image is derived from the blood vessel mask and the gray-level image, a multi-dimensional Interactive Watershed Transform (IWT) is applied to segment the fissures [29]. Four features including the original data from which the blood vessels are removed, the vasculature, the bronchial tree, and the pulmonary fissures enhanced by Hessian matrix based filters are extracted to calculate a cost image, and the watershed transformation is performed to lobar partitioning and classification [30].

By minimizing a 2D energy function on the sagittal slice based on the intensity of the original image, the distance from the vasculature, the curvature in 2D, and the continuity in 3D, Appia et al. found the global minimal path in each slice to detect the fissure semi-automatically [31]. After dividing the lung into five sections by a Voronoi division algorithm based on the bronchus and vessel segmentation, the initial fissure region is determined and a Laplacian filter is adopted to extract the final fissure [32].

From the above literature review, it can be seen that the fissure appearances are often used as direct features, but one cannot solely rely on these due to the fissures’ incompleteness. Other anatomical information such as lung structure, vessel and bronchus structures can play auxiliary role. In the present work, we adopt an adaptive fissure scanning method in two sagittal slices to localize the fissure region. Next Uniform Cost Search (UCS) with a cost function based on the Hessian matrix filtered image is employed to finish the fissure extraction at coronal slices. Finally RBF based interpolation is conducted to finalize the lobe segmentation.

Methods

Clinical dataset

All CT data sets used in this study are acquired at Shengjing Hospital, China Medical University (Shenyang, Liaoning Province, China) from 2009 to 2014. Data are acquired on a Brilliance 64 CT scanner from Philips Medical Systems (Best, The Netherlands). The transverse images are reconstructed in a 512 × 512 matrix, the in-plane pixel sizes range between 0.6 and 0.8 mm, and the slice thickness is either 0.67 or 1.0 mm. Fourteen subjects (10 normal, 12 male) aged 40–86 years are chosen to evaluate the proposed algorithm. The X-ray tube voltage is set at 120 kV, while the X-ray current ranges 105–378 mA. Reconstruction filters of YB and L are used for 11 and 3 subjects, respectively.

Overview of the automatic segmentation of the lung lobes

In the proposed approach, there are four stages to achieve the automated segmentation of lung lobe, namely (1) lung segmentation, (2) fissure detection, (3) fissure extension and (4) lobe segmentation. Firstly, the lung segmentation is performed to limit the search space. Secondly the points near the fissure surface are detected by using an improved adaptive fissure scanning method. Next an implicit fissure surface function is obtained using RBF interpolation. Depending on the evaluation of fissure surface functions, lung lobes are ultimately segmented.

Lung segmentation

A dual-threshold 3D region growing method is adopted to extract the lung regions [33]. The dual thresholds are empirically set to −650 and −930 HU, respectively. Conservative threshold values are chosen to prevent leakage of the segmented space. Next, a closing operation with 7 × 7 kernel is applied on each transverse slice. Finally the tracheal walls and pulmonary vascular structures are discarded from the lung regions by applying a threshold at −300 HU. Representative results are shown in Figure 1.

Figure 1
figure 1

Lung region segmentation. (a) transverse slice; (b) sagittal slice; (c) coronal slice; (d) 3D volume rendered result.

Fissure detection

Improvement strategy based on lung anatomy

The left lung only has one oblique fissure, while two fissures (horizontal and oblique) can be found in the right lung. The proposed algorithm handles each fissure separately, and the main steps are given as follows.

Step 1 In both lungs two sagittal slices are selected that are sufficiently spaced apart and away from the edge of the lung volume, as shown in (a) of Figure 2. In current algorithm, the two sagittal slices are selected by

x 1 = x min + 0.4 x max − x min
(1)
x 2 = x min + 0.6 x max − x min
(2)

where x min and x max are the minimum and maximum x coordinate of the segmented lung. The value of 0.4 and 0.6 is set empirically.

Figure 2
figure 2

Improved adaptive fissure scanning procedures. (a) coronal CT image; (b) the first sagittal image slice; (c) the second sagittal image slice; (d) coronal CT image with FR super imposed; (e) after Hessian matrix enhancement; (f) the final fissure after UCS.

Step 2 The above slides are then processed using a method named Sagittal Adaptive Fissure Scanning (SAFS) as illustrated in next section, to detect the fissure region (FR).

Step 3 Utilizing a line enhancement filter based on the Hessian Matrix followed by a Uniform Cost Search (UCS), the complete fissure line is extracted from the selected regions as found in Step 2. Results are given in (b) and (c) of Figure 2 as the examples. The line enhancement filter and UCS will be discussed below.

Step 4 At each coronal slice, there are two marker points generated from the fissure lines as obtained in Step 3. Using these two points, the coronal fissure region is interpolated, as shown in (d) of Figure 2. Similarly, Hessian Matrix enhancement and UCS are employed in this region to get the fissure line in each coronal slice, which are given in (e) and (f) of Figure 2. Hence a set of scattered points is available for further surface extension and interpolation.

Sagittal adaptive fissure scanning

It is well known that the fissure region is devoid of blood vessels and bronchi as it is attached to the boundaries of the two adjacent lobes. Based on this anatomical knowledge, an algorithm is implemented to detect the fissure regions. The method is named the Sagittal Adaptive Fissure Scanning (SAFS), and the flow chart for the algorithm is shown in Figure 3. It an extension of adaptive fissure scanning originating from the reference [18]. The aim of SAFS is to find a region of interest (ROI), i.e., the fissure region, which excludes the blood vessels and bronchi, and thereby models the anatomical assumption about the fissures (no vessels and bronchi in the proximity). The taken approach does not require the full segmentation of the vascular and bronchial trees in a separate step, but implicitly steers clear of these anatomical components.

Figure 3
figure 3

Algorithm flowchart of the sagittal adaptive fissure scanning.

The algorithm can be divided into three main steps, which are described as follows.

Step 1 Lines are scanned at angles θ with respect to the horizontal axis, as can be seen in (a) of Figure 4. The scan line is evaluated to be in the fissure region and is stored only if it meets the requirements of R > r and L/R > k, where R is the length of scan line intersecting with the lung region, and r is an empirical value to prevent the selection of lines too short to be part of the fissure, which may occur at the boundary of a lobe. L is the supremum of the continuous lengths of the line segments containing pixels with values lower than −970 HU. k is another predefined constant denoting the importance of contiguous line segments, and as such modifying the sensitivity of vasculature exclusion. The connected fissure lines form connected regions denoted by CR θ (i) for each scan angle θ.

Figure 4
figure 4

Sagittal adaptive fissure scanning. (a) original sagittal CT image; (b) multiple connected regions at θ = 44.22o; (c) connected region CR with the maximum area at θ = 44.22o; (d) CR with the maximum area at θ = 45.62o; (e) CR with the maximum area at θ = 46.95o; (f) The final FR with the maximum P -value.

Step 2 One can determine the potential fissure region (FR θ ) by finding the largest connected region at each angle θ, as shown in (b) and (c) of Figure 4. It means

F R θ = ma x i C R θ i
(3)

Step 3 A score indicating the likelihood of the final FR is calculated for each scan angle, and is defined as

P = w 1 N + w 2 σ R + w 3 R ¯
(4)

where N, σ R and R ¯ represent the total number of scan lines in a fissure region, the standard deviation of length of scan lines, and the average length of scan lines in a fissure region respectively. In addition, w 1, w 2 and w 3 are the associated weight factors for each parameter. The formulation of P is based on the knowledge that the final FR should have many scan lines with longer lengths and lower standard deviations of these lengths. Finally the FR with the maximum P, i.e.,

FR = arg ma x θ P F R θ
(5)

is selected out from the group with different angles θ, as shown in (d-f) of Figure 4. The selected regions together are extended such that they form a volume going through both selected slides, in which the fissures can be found.

Hessian matrix and uniform cost search

The fissures show up as vague lines in the selected regions from the sagittal images, with intensities only slightly higher than the background of the lung. To increase the probability of success, the lines are enhanced using a Hessian based line enhancement filter developed by Frangi et al. [34]. This filter is based on the principle that the eigenvalues of the Hessian matrix denote the curvature of the local image structure. The curvatures on the fissure line are close to zero along the fissure and highly negative perpendicular to the fissure, where the eigenvectors of the Hessian denote the directions of these curvatures.

Using the fissure enhanced image, a cost-function is defined as C = Max(E) − E, where E is the enhanced image. In this cost function, the fissure is given by the shortest path from one side to the other side, and is found using Uniform Cost Search (UCS). UCS is a traditional tree searching algorithm for finding the shortest path between two points in a graph. The image is represented as a graph where all pixels are connected using 8-connectivity, and the cost associated with each edge is given by the value of the destination pixel in the cost function. A point on the inner edge of the candidate region is chosen as a root point, while all points on the edge of the candidate region on the outer side are considered destination nodes. The shortest path is found by continuously expanding those nodes with the lowest cost, keeping track of the direction to go for the lowest cost movement. This process is continued until a destination node is found. After traversing all points on the inner edge, the shortest path between inner and outer edges is obtained finally.

Fissure interpolation

The proposed algorithm applies Radial Basis Functions (RBF) to do fissure interpolation based on the point set that was found above. Below, the procedure is explained in detail.

Scattered point set construction

  1. (a)

    Surface points

After UCS on each of the sagittal slices, a large set of potential fissure points, PFP, is generated. It is infeasible to use the whole set for the interpolation of the fissure surface due to its size. From PFP a subset PFP sub is selected in which the points are spaced at least 30 pixels apart in both x and y directions.

A cube with size of 11 × 11 × 11 is resampled around each point in PFP sub . If the number of potential fissure points in this cube is larger than 80, the point is stored for further processing. As shown in (a) of Figure 5, the left point is discarded for its cube contains too few scattered points and it may be not reliable. The final PFP sub is illustrated as in (b) of Figure 5.

Figure 5
figure 5

Illustration of each step in the fissure extension. (a) surface point verification; (b) surface points; (c) surface points and off-surface points; (d) surface extension.

  1. (b)

    Off-surface point

For each point in PFP sub , a normal vector can be calculated for the plane spanned by two arbitrary points in the cube and its center point. From the set of all possible normal vectors in this cube, an average normal vector is computed. Finally an off-surface point is determined along the average normal vector at distance d = 10 pixels away from the center point. All off-surface points are stored in the set OSP, as shown in (c) of Figure 5.

Implicit fissure surface function

Implicit fissure surface fitting follows the methods introduced by Pu et al. [15]. For completeness, the idea and main steps are briefly presented here. The surface can be estimated using RBF

F x = ∑ i = 1 n λ i Φ x − x i + P x
(6)

where Φ is the RBF, λ i are real number coefficients, P is a low degree polynomial, and {x i } are the scattered points. Here a tri-harmonic spline is selected to be RBF, Φ = |x|3. P(x) is represented in a linear form, P(x) = c 0 + c 1 x + c 2 y + c 3 z. For the PFP sub with n points, F(x i ) = 0; for the OSP with k points, F(x i ) = d.

Hence, Equation (6) can be rewritten as

Φ 11 Φ 12 ⋯ Φ 1 m Φ 21 Φ 21 ⋯ Φ 21 ⋮ ⋮ ⋯ ⋮ Φ m 1 Φ m 2 ⋯ Φ mm 1 1 ⋯ 1 x 1 x 1 ⋯ x m y 1 y 2 ⋯ y m z 1 z 2 ⋯ z m 1 x 1 y 1 z 1 1 x 2 y 2 z 2 ⋮ ⋮ ⋮ ⋮ 1 x m y m z m 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 λ 1 λ 2 ⋮ λ m c 0 c 1 c 2 c 3 = v 1 v 2 ⋮ v m 0 0 0 0
(7)

where Φ ij can be determined by

Φ ij = Φ x i − x j = x i − x j 2 + y i − y j 2 + z i − z j 2 3 / 2
(8)

with i, j ∈ [1, m],  m = n + k.

Through Doolittle decomposition [35], Equation (7) can be solved, and the parameters λ and c are obtained. An example of a reconstructed surface is illustrated in (d) of Figure 5.

Finally, three implicit surface functions, F 1(X) for the oblique fissure in the left lung, F 2(X) for the oblique fissure in the right lung, and F 3(X) for the transverse fissure in the right lung are constructed.

Lung lobe segmentation

After the three implicit fissure surface functions are reconstructed through RBF extension, all points in each of the lungs will be classified using these functions to determine which lobe they belong to. The criteria are shown in Table 2.

Table 2 Conditions for determining lobe membership

Accuracy evaluation of lung fissure extraction

To quantitatively evaluate the accuracy of the algorithm, the surface pattern evaluate method, i.e., the shortest Euclidian distance, is adopted. The shortest Euclidian distance from pixel i on the manually-defined surface to the surface defined by the algorithm can be computed as

d i = min j x j A − x i M 2 + y j A − y i M 2 + z j A − z i M 2
(9)

where x j A , y j A , z j A and x i M , y i M , z i M are the coordinates of the voxel on the fissure surfaces obtained by the algorithm and manual tracing, respectively. Correspondingly the mean, standard deviation and the maximum value of d i can be determined. Moreover, the root mean square (RMS) of d i is also given as

d RMS = ∑ i = 1 l d i 2 l
(10)

where l is the total number of voxels on the fissure surface by manual tracing.

For each dataset, the fissure contours are drawn by one experienced radiologist slice by slice using the free software of ImageJ. They form the manually-defined surface used as the reference of accuracy evaluation.

Results

Fissure detection

The proposed algorithm can detect the fissure surfaces successfully for the 14 cases in the dataset. As an example, representative results for one heath subject are presented in Figure 6. For the left lung, the detected fissure curves are accurate in axial, sagittal and coronal views, while the oblique fissure appears continuous and smooth. For the right lung, transverse fissure can be extracted precisely, which traditionally is a difficult task. It can be seen that the transverse and oblique fissures crossover is identified accurately.

Figure 6
figure 6

Fissure detection results. (a) axial view for left lung. (b) sagittal view for left lung; (c) coronal view for left lung; (d) 3D view for left lung; (e) axial view for right lung; (f) sagittal view for right lung; (g) coronal view for right lung; (h) 3D view for right lung.

Moreover, the current algorithm is used to some cases with lung pathologies. As shown in (a) of Figure 7, the fissure can be acquired for the data with a small lung nodule nearby the fissure. Even with a small lung subpleural nodule illustrated in (b) of Figure 7, the algorithm works well for the RBF interpolation can correct some small errors in fissure detection. Two clinical data sets with mild emphysema are used to assess the proposed method, and the results are given in (c) and (d) of Figure 7. It can be seen the fissures are obtained successfully since the mild emphysema does not change the feature of fissures.

Figure 7
figure 7

Fissure detection results for four datasets with lung pathologies (indicated by the arrows). (a) with a small lung nodule nearby the fissure; (b) with a small lung subpleural nodule; (c) with centrilobular emphysema with tuberculosis in both apexes; (d) with centrilobular emphysema.

The calculated evaluation measures including the mean, standard deviation, RMS and the maximum value of d i are given in Table 3. For the right oblique fissure, the mean (±S.D.), RMS, and the maximum averaged over all 14 datasets are 2.05 ± 1.80, 2.46 and 7.34 mm, respectively. The measures are 2.77 ± 2.12, 3.13 and 7.75 mm for the right horizontal fissure, 2.31 ± 1.76, 3.25 and 6.83 mm for the left oblique fissure. For the accuracy of the algorithm, there is no significant difference between the 10 health datasets and 4 pathological.

Table 3 The accuracy of fissure detection

Lung lobe segmentation

For each patient, the five lobes are accurately segmented by three implicit fissure surface functions. Figure 8 shows one example in which the lobes are marked with different colors.

Figure 8
figure 8

Results of automatic lung lobes segmentation. (a) coronal view; (b) axial view; (c) sagittal view; (d) the second sagittal view; (e-h) four cases shown in 3D surface rendering.

The volume of each lobe (cm3) and its ratio to total lung volume can be easily calculated according to the segmentation, as summarized in Table 4. This algorithm may be used to do morphometric analysis or functional assessment for the individual lobes [36].

Table 4 Volume of lung lobe (cm 3 ) and the percentage of the volume of each lobe in the whole lung volume (%)

After the lobe segmentation, we set the threshold cut-off for emphysema as −950 HU [9], and calculated the percentage of low attenuation area (LAA%) to total lung volume (at −600 HU threshold), i.e., emphysema index, for each lobe in the datasets 13 and 14. For dataset 13, it is 3.14% (the left upper), 0.49% (the left lower), 8.33% (the right upper), 0.66% (the right intermediate) and 0.48% (the right lower). For dataset 14, it is 7.97%, 8.67%, 2.61%, 1.49% and 0.16%, respectively. The potential application is to clinically assess emphysema heterogeneity, find predominantly emphysema lobe and help plan the lung-volume–reduction surgery [11].

Advantages

One of important advantages of the proposed algorithm is its high speed. Using a desktop PC running Intel Core2 Duo CPU E7500 at 2.0 GHz and 2 GB of memory, to finish the process of lung segmentation, fissure detection, and fissure extension for the dataset with 320 slices of 512 × 512 pixels only takes around 50 seconds. Comparing to the running time of 2.35 minutes [22], 6–8 minutes [23, 25], and about 40 minutes [20, 32], the current algorithm shows high calculation efficiency. The robustness of the algorithm is preliminarily proved for it works well for the 14 datasets, including two clinical datasets with small nodules and two with mild emphysema.

Discussions

Adaptive fissure scanning was introduced by Wei et al. [18]. In the present study, the idea of adaptive fissure scanning is adopted, but manipulation processes are different. The most important difference in this work is the application of anatomical knowledge to extract the potential fissure regions in lungs. Hence, the scanning only occurs twice to provide the candidate points for the coronal fissure regions determination, which makes the whole algorithm more efficient. At the same time, it also reduces potential fissure incompleteness near the boundaries which often occurs in adaptive fissure scanning.

At the axial sections, the shape of horizontal fissure in the right lung varies significantly, which makes the fissure detection very difficult. For example, the horizontal fissure looks like a circle in (a) of Figure 9. Hence the present algorithm conducts the fissure scanning at the sagittal view. The fissures are more regular than those within the axial sections, as shown in (b) of Figure 9. Takahashi et al. [13] consider the assessment of fissure using sagittal images to be more accurate than using axial images. Ukil et al. [24] trace the horizontal fissure on the sagittal view for it gives the best contrast. Moreover the work done by Lassen et al. also shows that the best segmentation can be achieved in sagittal orientation [30].

Figure 9
figure 9

Determination of the fissure scanning section. (a) axial view; (b) sagittal view.

Because fissures are often incomplete and barely visible in CT images, fissure interpolation is required. Surface fitting based on RBFs using tri-harmonic splines, is used here. One of the advantages of RBF surface interpolation is its high speed, taking less than a second in the present implementation. The quality of the lobe segmentation is strongly influenced by the number of the input points obtained from fissure detection.

For accuracy evaluation of fissure detection algorithm, the measures based on the shortest Euclidian distance have been adopted by most references [14, 17–25, 31, 32, 36]. The mean (±S.D.), RMS, and the maximum are 2.77 ± 2.12, 3.13 and 7.75 mm for the right horizontal fissure in present study. Given different datasets, current accuracy reaches the same level as the state-of-art works. For example, RMS (±S.D.) is 2.04 ± 3.88 [14], 2.23 ± 2.52 [20], 1.96 ± 0.71 [23] and 2.5 mm [31].

Current algorithm shows good robustness for the 14 datasets, including two clinical datasets with small nodules and two with mild emphysema. Hence, the potential applications of the proposed algorithm might include but not limited to the morphometric analysis for the lung lobe volume, functional assessment of the individual lobe [36], locating the lung nodules into the lobe [25] embedded into computed aided detection system of lung cancer, and quantitative assessment of emphysema index for each lobe [9, 11], etc.

Our study has several limitations. Due to the dependence on the anatomical knowledge, the present algorithm works well for the regular major fissures, but is not well suited for the accessory fissures. At the same time it also does not deal well with the irregular fissure morphologies, especially circular fissure. Furthermore, the accuracy of fissure detection is rather low for the regions near the lobe edges for two reasons. Firstly, straight lines are used to approximately determine the fissure region, which results in missing parts of the fissure lines. Secondly, some unreliable scattered points may lead to a wrong implicit surface function.

Only 14 datasets are tested for our methods. Two datasets with small nodules and two with mild emphysema are too few to prove the robustness fully. The current method cannot cope with the lung with heavy diseases, such as the advanced tumor and interstitial lung disease, for the fissures appear very irregular. The interactive operations must be followed.

As far as the authors know, there is no open-source code for the fissure detection and lobe segmentation. Due to time limitations we were unable to implement the other methods, but instead have chosen to compare the performance of our method to previously proposed methods in literature [14, 17–25, 31, 32, 36]. In general, more validation and comparison will be conducted in the future working.

Though the adaptive strategy is employed, a few parameters have to be determined empirically, and might be not suitable for other datasets. For example, two sagittal fissures are determined by Equations (1) and (2), which is essential to the success of the present algorithm. Any incorrect detection will cause the failure of the lung lobe segmentation. In SAFS, r is set as 30–80, the optimal value is 50. k can range from 0.4 to 0.7, the optimal value is 0.6, which works well for all 14 subjects in the present study. SAFS is the vital step in the algorithm, and to verify its results before continuing other parts is recommended. Fortunately, it is easy to judge for only two sagittal slices are involved. For radial basis interpolation, the point space is 30 voxels, and the threshold of 80 potential fissure points within a 11 × 11 × 11 cube is adopted to ensure the resampled point is reliable. The distance between the center point and the off-surface point d is set to be 10. Because of the interpolation, these parameters are not very sensitive to the accuracy of algorithm.

The simplified lung segmentation in current study may not work for the other data with severe lesions. Considering the main goal of this paper is to detect the fissure and extract each lobe, we did not implement more sophisticated methods, but more advanced methods [37, 38] can be used to replace the existing method.

Conclusions

An automatic fissure detection and lobe segmentation algorithm is developed and evaluated on fourteen CT scans. It is found that sagittal adaptive fissure scanning can localize the potential fissure regions quickly, using knowledge on the density of blood vessels and bronchi. Once the potential region is enhanced by a Hessian based line enhancement filter, Uniform Cost Search (UCS) can extract the fissures successfully in 2D. Furthermore, surface fitting based on RBFs is able to obtain three implicit surface functions for each dataset. The current algorithm shows good accuracy, speed and robustness through evaluation by 14 datasets including two with small lung nodules and two with mild emphysema. For example, averaged over all datasets, the mean (±S.D.), RMS, and the maximum of the shortest Euclidian distance are 2.05 ± 1.80, 2.46 and 7.34 mm for the right oblique fissure. Lung anatomical knowledge is applied to localize the potential fissure regions, which makes the algorithm fast. The complete segmentation procedure takes less than one minute on a modest desktop PC. The algorithm is robust, enables to deal with the 14 experimental datasets successfully, and may help locate the lesions into each lobe and analyze them regionally.

Authors’ information

Shouliang Qi and Han JW van Triest share first authorship.

Abbreviations

CT:

Computed tomography

COPD:

Chronic obstructive pulmonary disease

EV:

Emphysema volume

EI:

Emphysema index

RBF:

Radial basis functions

TPS:

Thin plate splines

IWT:

Interactive watershed transform

UCS:

Uniform cost search

SAFS:

Sagittal adaptive fissure scanning

RMS:

root mean square.

References

  1. Jean B, Nikolai K: Global surveillance, prevention and control of chronic respiratory diseases - comprehensive approach. Geneva: World Health Organization; 2007.

    Google Scholar 

  2. What Is COPD http://www.nhlbi.nih.gov/health/health-topics/topics/copd/

  3. Naidich DP, Webb WR, Harkin TJ, Gefter WB: Imaging of the airways: functional and radiologic correlations. Philadelphia: Lippincott Williams & Wilkins/Wolters Kluwer Health Inc; 2005.

    Google Scholar 

  4. Hu S, Hoffman EA, Reinhardt JM: Automatic lung segmentation for accurate quantitation of volumetric X-ray CT images. IEEE Trans Med Imag 2001,20(6):490–498. 10.1109/42.929615

    Article  Google Scholar 

  5. El-Baz A, Beache GM, Gimel’farb G, Suzuki K, Okada K, Elnakib A, Soliman A, Abdollahi B: Computer-aided diagnosis systems for lung cancer: challenges and methodologies. International Journal of Biomedical Imaging 2013, 2013: 1–46.

    Google Scholar 

  6. Graham MW, Gibbs JD, Cornish DC, Higgins WE: Robust 3-D airway tree segmentation for image-guided peripheral bronchoscopy. IEEE Trans Med Imag 2010,29(4):982–997.

    Article  Google Scholar 

  7. Zhu CK, Qi SL, Yue Y, Triest HV, Wang SJ, Kang Y: Automatic 3D segmentation of human airway tree in CT image. In Proceedings of the 3rd International Conference on Biomedical Engineering and Informatics: 16–18 October 2010; Yantai, China. Edited by: Yu WC, Zhang M, Wang LP, Song YB. New York: the Institute of Electrical and Electronics Engineers; 2010:132–136.

    Chapter  Google Scholar 

  8. Shikata H, McLennan G, Hoffman EA, Sonka M: Segmentation of pulmonary vascular tree from thoracic 3D CT images. Int J Biomed Imag 2009, 2009: Article ID 636240. 11 pages

    Article  Google Scholar 

  9. Ley S, Weinheimer O, Iliyushenko S, Erdugan S, Eberhardt R, Fuxa A, Mews J, Kauczor HU: Quantitative analysis of emphysema in 3D using MDCT: influence of different reconstruction algorithms. Eur J Radiol 2008,65(2):228–234. 10.1016/j.ejrad.2007.03.034

    Article  Google Scholar 

  10. Hoffman EA, Simon BA, McLennan G: A structural and functional assessment of the lung via multidetector-row Computed Tomography - phenotyping chronic obstructive pulmonary disease. Proc Am Thorac Soc 2006,3(6):519–532. 10.1513/pats.200603-086MS

    Article  Google Scholar 

  11. Fishman A, Martinez F, Naunheim K, Piantadosi S, Wise R, Ries A, Weinmann G, Wood DE: A randomized trial comparing lung-volume reduction surgery with medical therapy for severe emphysema. New Engl J Med 2003,348(21):2059–2073.

    Article  Google Scholar 

  12. Takahashi K, Thompson B, Stanford W, Sato Y, Nagasawa K, Sato H, Kubota M, Kashiba A, Sugimori H: Visualization of normal pulmonary fissures on sagittal multiplanar reconstruction MDCT. Am J Roentgenol 2006,187(2):389–397.

    Article  Google Scholar 

  13. Hayashi K, Aziz A, Ashizawa K, Hayashi H, Nagaoki K, Otsuji H: Radiographic and CT appearances of the major fissures. RadioGraphics 2001,21(4):861–874. 10.1148/radiographics.21.4.g01jl24861

    Article  Google Scholar 

  14. Pu J, Leader JK, Zheng B, Knollmann F, Fuhrman C, Sciurba FC, Gur D: A computational geometry approach to automated pulmonary fissure segmentation in CT examinations. IEEE Trans Med Imag 2009,28(5):710–719.

    Article  Google Scholar 

  15. Pu J, Zheng B, Leader JK, Fuhrman C, Knollmann F, Klym A, Gur D: Pulmonary lobe segmentation in CT examinations using implicit surface fitting. IEEE Trans Med Imag 2009,28(12):1986–1996.

    Article  Google Scholar 

  16. Pu J, Fuhrman C, Durick J, Leader JK, Klym A, Sciurba FC, Gur D: Computerized assessment of pulmonary fissure integrity using high resolution CT. Med Phys 2010,37(9):4661–4672. 10.1118/1.3475937

    Article  Google Scholar 

  17. van Rikxoort EM, van Ginneken B, Klik M, Prokop M: Supervised enhancement filters: Application to fissure detection in chest CT scans. IEEE Trans Med Imag 2008,27(1):1–10.

    Article  Google Scholar 

  18. Wei Q, Hu Y, Gelfand G, Macgregor JH: Segmentation of lung lobes in high-resolution isotropic CT images. IEEE Trans Biomed Eng 2009,56(5):1382–1393.

    Google Scholar 

  19. Ross JC, Estepar RS, Diaz A, Westin CF, Kikinis R, Silverman EK, Washko GR: Lung extraction, lobe segmentation and hierarchical region assessment for quantitative analysis on high resolution computed tomography images. In the 12th International Conference on Medical Image Computing and Computer Assisted Intervention: 20–24 September 2009; London. Edited by: Yang GZ. Berlin Heidelberg: Springer; 12(Pt 2); 690–698.

  20. Ross JC, San Jose Estepar R, Kindlmann G, Diaz A, Westin CF, Silverman EK, Washko GR: Automatic lung lobe segmentation using particles, thin plate splines, and maximum of posteriori estimation. In the 13th International Conference on Medical Image Computing and Computer Assisted Intervention: 20–24 September 2010; Beijing. Berlin Heidelberg: Springer; 13(Pt 3); 163–171.

  21. Wang J, Betke M, Ko JP: Shaped-based curve growing model and adaptive regularization for pulmonary fissure segmentation in CT. Lect Notes Comput Sc 2004, 3216: 541–548. 10.1007/978-3-540-30135-6_66

    Article  Google Scholar 

  22. Wang J, Betke M, Ko JP: Pulmonary fissure segmentation on CT. Medical Image Anal 2006,10(4):530–547. 10.1016/j.media.2006.05.003

    Article  Google Scholar 

  23. Zhang L, Hoffman EA, Reinhardt JM: Atlas-driven lung lobe segmentation in volumetric X-Ray CT images. IEEE Trans Med Imag 2006,25(1):1–16.

    Article  Google Scholar 

  24. Ukil S, Reinhardt JM: Anatomy-guided lung lobe segmentation in X-Ray CT images. IEEE Trans Med Imag 2009,28(2):202–214.

    Article  Google Scholar 

  25. van Rikxoort EM, de Hoop B, van de Vorst S, Prokop M, van Ginneken B: Automatic segmentation of pulmonary segments from volumetric chest CT scans. IEEE Trans Med Imag 2009,28(4):621–630.

    Article  Google Scholar 

  26. van Rikxoort EM, Prokop M, de Hoop B, Viergever MA, Pluim JP, van Ginneken B: Automatic segmentation of the pulmonary lobes from fissures, airways, and lung borders: evaluation of robustness against missing data. In the 12th International Conference on Medical Image Computing and Computer Assisted Intervention: 20–24 September 2009; London. Edited by: Yang GZ. Berlin Heidelberg: Springer; 12(Pt 1); 263–271.

  27. van Rikxoort EM, Goldin JG, Galperin-Aizenberg M, Abtin F, Kim HJ, Lu P, van Ginneken B, Shaw G, Brown MS: A method for the automatic quantification of the completeness of pulmonary fissures: evaluation in a database of subjects with severe emphysema. Eur Radiol 2012,22(2):302–309. 10.1007/s00330-011-2278-0

    Article  Google Scholar 

  28. Wei Q, Hu Y, MacGregor JH, Gelfand G: Automatic recognition of major fissures in human lungs. Int J Comput Assist Radiol Surg 2012,7(1):111–123. 10.1007/s11548-011-0632-y

    Article  Google Scholar 

  29. Kuhnigk JM, Hahn H, Hindennach M, Dicken V, Krass S, Peitgen HO: Pulmonary lobe segmentation by anatomy-guided 3-D watershed transform. In Proc SPIE Medical Imaging 2003: 15 February 2003; San Diego. Edited by: Sonka M, Fitzpatrick JM. Bellingham: SPIE; 5032; 1482–1490.

  30. Lassen B, Kuhnigk J, Schmidt M, Krass S, Peitgen HO: Lung and lung lobe segmentation methods at Fraunhofer MEVIS. In Proc of the Fourth International Workshop on Pulmonary Image Analysis: 18 September 2011; Toronto. Edited by: Reinhard B. Berlin Heidelberg: Springer; 2011:185–199.

    Google Scholar 

  31. Appia V, Patil U, Das B: Lung fissure detection in CT images using global minimal paths. In Proc SPIE 7623, Med Imag 2010: Imaging Processing: 12 March 2010; San Diego. Edited by: Benoit MD. Bellingham: SPIE; 7623; 76231P1–P8.

  32. Zhou X, Hayashi T, Hara T, Fujita H, Yokoyama R, Kiryu T, Hoshi H: Automatic segmentation and recognition of anatomical lung structures from high-resolution chest CT images. Comput Med Imaging Graph 2006,30(5):299–313. 10.1016/j.compmedimag.2006.06.002

    Article  Google Scholar 

  33. Si GL, Qi SL, Yue Y, van Trist HJW, Yan K: Automatic segmentation of lung parenchyma from thoracic CT based on image resampling. Beijing Biomed Eng 2012,31(4):349–355.

    Google Scholar 

  34. Frangi AF, Niessen WJ, Vincken KL, Viergever MA: Multiscale vessel enhancement filtering. Lect Notes Comput Sc 1998, 1496: 130–137. 10.1007/BFb0056195

    Article  Google Scholar 

  35. Doolittle Decomposition of a Matrix ~thompson/hPage/CourseMat/Tutorials/CompMethods/doolittle.pdf http://www.engr.colostate.edu/

  36. Kobashi S, Kuramoto K, Hata Y: Functional assessment of individual lung lobes with MDCT images. In Theory and Applications of CT Imaging and Analysis. Edited by: Noriyasu H. Rijeka: InTech; 2011:95–106.

    Google Scholar 

  37. Soliman A, Khalifa F, Alansary A, Gimel’farb G, El-Baz A: Segmentation of lung region based on using parallel implementation of joint MGRF: validation on 3D realistic lung phantoms. In Proc IEEE International Symposium on Biomedical Imaging: From Nano to Macro: 7–11 April 2013; San Francisco. Edited by: Bahram P. Piscataway: IEEE; 2013:864–867.

    Chapter  Google Scholar 

  38. El-Baz A, Gimel’farb G: Robust medical images segmentation using learned shape and appearance models. Pt 1. In the 12th International Conference on Medical Image Computing and Computer Assisted Intervention: 20–24 September 2009; London, 12. Edited by: Yang GZ. Berlin Heidelberg: Springer; 281–288.

Download references

Acknowledgments

This work was financially supported by the Natural Science Foundation of Liaoning Province (No. 2013020219), the Scientific Research Fund of Liaoning Provincial Education Department (L2012080), and the Fundamental Research Funds for the Central Universities (N130219001).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Shouliang Qi.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

SQ: proposed the idea, performed experiments, analyzed the data, made discussions and composed the manuscript together with HJWT, MX. YY: provided CT images, segmented the lobes manually, and made the discussions. YK: directed the experiments and made discussions. All authors read and approved the final manuscript.

Shouliang Qi contributed equally to this work.

Authors’ original submitted files for images

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Qi, S., van Triest, H.J.W., Yue, Y. et al. Automatic pulmonary fissure detection and lobe segmentation in CT chest images. BioMed Eng OnLine 13, 59 (2014). https://doi.org/10.1186/1475-925X-13-59

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1475-925X-13-59

Keywords