Skip to main content

Multiresolution generalized N dimension PCA for ultrasound image denoising

Abstract

Background

Ultrasound images are usually affected by speckle noise, which is a type of random multiplicative noise. Thus, reducing speckle and improving image visual quality are vital to obtaining better diagnosis.

Method

In this paper, a novel noise reduction method for medical ultrasound images, called multiresolution generalized N dimension PCA (MR-GND-PCA), is presented. In this method, the Gaussian pyramid and multiscale image stacks on each level are built first. GND-PCA as a multilinear subspace learning method is used for denoising. Each level is combined to achieve the final denoised image based on Laplacian pyramids.

Results

The proposed method is tested with synthetically speckled and real ultrasound images, and quality evaluation metrics, including MSE, SNR and PSNR, are used to evaluate its performance.

Conclusion

Experimental results show that the proposed method achieved the lowest noise interference and improved image quality by reducing noise and preserving the structure. Our method is also robust for the image with a much higher level of speckle noise. For clinical images, the results show that MR-GND-PCA can reduce speckle and preserve resolvable details.

Introduction

An accurate anatomical display of organs plays a very important role in current-day medical diagnosis. Among a diverse set of medical imaging modalities, the use of ultrasound has increased rapidly because of its non-invasive nature, hardware portability, inexpensiveness, and real-time imaging. However, ultrasound images have much more noise than other medical imaging modalities, such as computer tomography (CT) and magnetic resonance imaging (MRI). The primary source of ultrasound imaging noise is considered as speckle noise, which deteriorates image quality, degrades fine details and edge definition, and limits contrast resolution [1]. Consequently, reducing speckle noise while preserving anatomic information is necessary to reliably delineate the regions of interest and increase the diagnostic potential of ultrasounds.

Extensive work using various techniques has been conducted to reduce speckle noise. These techniques can be classified into two categories according to the moment when speckle reduction is produced, namely, compounding approach and post-processing approach [2]. Compounding approach modifies the data acquisition procedure to produce several images of the same region and then combine them to form a single image. This approach is beyond the scope of this paper. Post-processing approach processes ultrasound images after being generated. Most studies have focused on this approach, in which filtering methods are developed to be applied directly to the original image. Based on the assumption that speckle is essentially a multiplicative noise [3], filtering methods composed of many fixed and adaptive filters have been proposed, such as L2-mean filter [4], adaptive filter reduction [5], adaptive weighted median filter [6], nonlinear diffusion [7], Map estimation [8], and so on.

Although techniques for processing multiplicative noise exist, they are not as well developed as the techniques for additive noise. Generally, the multiplicative nature of speckle noise formation can be converted into an additive noise through the application of logarithmic transformation to a speckled image. Subsequently, various types of state-of-the-art denoising algorithms can be utilized for ultrasound despeckling. State-of-the-art algorithms are mainly divided into three categories: (1) algorithms applied in the frequency domain, (2) algorithms applied in the spatial domain, and (3) algorithms applied in both spatial and frequency domains. Wavelet-based filters implement denoising in the frequency domain, such as Bayesian least squares (BLS) Gaussian scald mixture (GSM) wavelet denoising method [9]. This method transforms the image into the wavelet domain, assumes the GSM model on neighborhoods, and denoises using BLS estimation. However, a rich amount of different local structures are contained in medical images, and these structures cannot be well represented by only one fixed wavelet basis. Thus, numerous visual artifacts can be introduced through wavelet-based methods. Using the temporal perspective, spatial denoising methods are proposed to discover redundancies in a single image, such as non-local mean-based methods [10, 11]. These methods extract the commonalities and use a weighted average based on similarity. Recently, denoising methods implemented in both spatial and frequency domains, such as K-SVD method [12], non-local collaborative filtering [13], and principle component analysis (PCA)-based methods [14, 15], have attracted attention. The core idea of these denoising methods is the use of sparser representation instead of a spatial weighted average [16, 17].

Recent studies have shown that PCA-based methods can obtain impressive achievements. Bags of patches extracted from the noisy image are processed by PCA to reduce the redundancy between data. PCA is a linear subspace learning method that has been applied widely for dimensionality reduction by searching for the maximum variance directions. However, conventional PCA was originally proposed to process one-dimensional vectors, which require all input data to first be unfolded into a vector in order to fit the nature of the PCA. For similar patches extracted to reduce redundancy, vectorization destroys the structure of the input patches, resulting in the overfitting problem because the dimension of the vectorized data may be larger than that of the sample number.

This paper proposes a novel multiresolution generalized N dimension PCA for ultrasound image denoising called the MR-GND-PCA. The issue of noise for ultrasound images can be reduced with higher frequency imaging, but this would limit the depth of ultrasound penetration. Thus, the noise is decided by the different penetrations. An intuitive justification is that ultrasound images are equally likely to be viewed from different distances. Our proposed method assumes that the statistics of ultrasound images are invariant to changes in the spatial scale. Additionally, the larger scale structure is lost when the image is decomposed into small patches. This case can be avoided by employing the multiresolution/multiscale approach. Instead of traditional PCA, a multilinear subspace learning method called GND-PCA is also utilized to preserve useful information and noise suppression. The proposed method has three stages. First, a Gaussian pyramid for the input noisy image is built with a multiresolution scheme. The noise in the ultrasound image is gradually smoothed and computational time is reduced when computing in higher pyramid levels. The stacks are then built with multiscale images produced from each pyramid level. Second, dense patches (two-way array) with the same size are extracted, and similar patches are grouped together in three-way arrays in different stacks. GND-PCA is directly used to filter the three-dimensional array with its original structure in order to overcome the drawbacks of conventional PCA, as well as to consider the interrelationship among different modes of each patch to maintain useful information and remove noise. Denoised patches are then placed back into their original positions. Third, after obtaining the representative images in each stack, a combination motivated by Laplacian pyramids is obtained. And then, the denoising image is yielded from the combined image with exponential transformation and sharpen procedure.

The organization of the paper is as follows. Section Related work provides a brief introduction of related work. The proposed MR-GND-PCA denoising method is outlined in Section Methodology. The experimental design is presented and results are discussed in Section Experiments and results. Finally, Section Discussion and conclusions concludes the work.

Related work

Generalized N dimension PCA (GND-PCA) is the main related work of our proposed method. For more details please refer to [18]. The GND-PCA is briefly presented as follows.

Traditional PCA [19] is one of the fundamental linear subspace learning techniques for data analysis. The main purpose of PCA is to reduce data dimension and retain information that characterizes the variation of data as much as possible. Thus, PCA can be widely used in noise reduction, i.e., to keep useful information and eliminate high-frequency noise. However, the data must be unfolded into one-dimensional vectors to fit with the PCA processing. For a two-dimensional image or N-way array, this unfolding process destroys the structure of the input data. PCA also suffers from a generalization problem because the calculated bases with PCA cannot represent data very well if the number of samples is much smaller than the dimension of the unfolded vector.

Xu et al. [18] proposed a multilinear subspace learning method called generalized N dimension PCA (GND-PCA) to overcome these insufficiencies. GND-PCA is proposed by extending the conventional linear PCA based on multilinear algebra. In multilinear algebra, higher-dimensional data are treated as higher-order tensors that are N-way array [20]. The order of a tensor is equal to the number of ways, which are known as modes. GND-PCA directly analyzes the N-way array on the sub-mode spaces. This step not only retains the structure of the data, but also overcomes the generalization problem that occurs when the dimension of the unfolded data is much larger than the number of samples.

The bases are calculated on each mode subspace in order to provide a compact representation of the tensors. An iteration algorithm is utilized to obtain the optimal base matrices for each mode. Next, the core tensor containing all principal components is attained with the optimal bases. In this paper, we denote scalars by lower-case letters (x, y, …), vectors (one-way array) by boldface letters (x, y, …), matrices (two-way array) by boldface capital letters (X, Y, …), and third-order tensor (three-way array) by calligraphic capital letters (X,Y,).

GND-PCA was originally proposed for the construction of statistical appearance models. According to the intrinsic algorithm that lower-rank tensors are found to approximate the original tensors with more compact and meaningful form, we can utilize GND-PCA to retain useful information while suppressing redundancy, that is, image denoising. The next section will introduce our proposed noise reduction method in detail.

Methodology

Motivated in part by image pyramids and GND-PCA, we propose a novel ultrasound image denoising method, called multiresolution Generalized N Dimension PCA (MR-GND-PCA). Figure 1 shows the proposed MR-GND-PCA algorithm with its three stages.

Figure 1
figure 1

Flowchart of the proposed MR-GND-PCA.

  1. (1)

    In the multiresolution decomposition stage, logarithmical transformation is first used to convert the multiplicative speckle noise to an additive noise. Then, a Gaussian pyramid for the noisy image is built using the multiresolution scheme. Multiscale image stacks on each level are built for each Gaussian pyramid.

  2. (2)

    In the noise reduction stage, similar patches (two-way array) are extracted in each stack and grouped into several categories (three-way array). GND-PCA is directly utilized for three-way arrays to suppress the noise. The denoised patches are put back in the original places to obtain clean multiscale image stacks.

  3. (3)

    In the multiresolution combination stage, the representative image on each level can be accessed by image averaging. The combination of representative images followed by exponential transformation and sharpen procedure will yield the noise reduction ultrasound image.

The above stages will be formulated in detail in the following subsection.

Multiresulution decomposition

A reliable model of speckle noise is presented in [21, 22]

g or x , y = S or x , y η mu or x , y + η ad or x , y
(1)

where Sor(x, y) is a noise-free original gray-valued image, gor(x, y) is an observed noisy gray-valued image, η mu or x , y is multiplicative noise (coherent interfering), η ad or x , y is additive noise (such as sensor noise), and x and y are variables of spatial locations, (x, y) R2. We could approximate the Eq. 1 as Eq. 2, since the effect of additive noise is much smaller than that of multiplicative noise.

g or x , y S or x , y η mu or x , y
(2)

Logarithmic transformation can be executed on both sides of Eq. 2 to separate the noise from the original image.

log g or x , y log S or x , y +log η mu or x , y
(3)

We simplify Eq. 3 as Eq. 4 without modifying the definition:

g x , y S x , y +η x , y
(4)

Therefore, multiplicative speckle noise is converted to additive noise with logarithmical transformation. This step is more reasonable for the proposed MR-GND-PCA as applied to ultrasound image denoising.

The Gaussian pyramid for the noisy image in the logarithmic space and the multiscale image stacks on each pyramid level are built successively because only the possible scale-space kernel is a Gaussian function [23]. The scale space of the image g is produced from the convolution of variable-scale Gaussian filters f(σ, (x, y)) with the input image:

T g =f σ , x , y g x , y
(5)

where “*” is the convolution operation in x and y, and σ denotes the scale parameter, and

f σ , x , y = 1 2 π σ 2 e x 2 + y 2 / 2 σ 2
(6)

In our paper, an associated Gaussian pyramid G a,0, 0 ≤ a ≤ A is composed of a set of different resolutions of g. Here, A + 1 is the number of total levels and G 0,0 = g. G a,0 are created by applying the Gaussian filter and successive downsampling. Both operations are combined in the “Reduce” operation, and shown on the first line in Figure 2,

Reduce G a , 0 = 2 f 1 G a , 0
(7)
Figure 2
figure 2

The algorithm of MR-GND-PCA.

where f 1 denotes a linear low-pass Gaussian filter, and (2 ↓) denotes downsampling that discards every data element with an odd index and is applied to each dimension of the image.

Multiscale image stacks on each pyramid level are subsequently constructed. Assume G a,0 as the basic image of the ath stack at each level of the Gaussian pyramid. G a,b , 0 ≤ b ≤ B are a series of different corresponding scales of G a,0; B + 1 is the number of scales on each level. The multiscale image stacks G a,b , 0 ≤ b ≤ B are created by applying the low-pass Gaussian filter f 2. Thus, we have

G a , b = G a , 0 , Num = 0 Num f 2 G a , 0 , 1 Num B
(8)

where (Num) denotes the number of f 2 convolutions with G a,0. Both Gaussian filters f 1 and f 2 are defined in 5 × 5 sliding windows.

Noise reduction

GND-PCA as a multilinear subspace method is utilized for denoising the images of each stack on the pyramid level to reduce noise for the entire image. Take the first stack, G 0,b , 0 ≤ b ≤ B, for example. Q overlapping dense patches, X q 0 R I 1 × I 2 ,q=1,2,,Q, are extracted from all images in this stack. Here, I 1 × I 2 is the size of the patch, and the superiors “(0)” denotes that all the extracted patches are in the first stack. Organizing the patches into sensible groupings is a fundamental process for GND-PCA denoising. Cluster analysis, which consists of hard and soft clustering, implements groupings according to measured intrinsic characteristics or similarities. Loosely speaking, hard clustering assigns the data point to one and only one cluster. In contrast, soft clustering assigns the data point to all clusters with different weights whose sum equals one. Clustering is unsupervised learning due to the absence of category information. Despite the fact that thousands of clustering algorithms have been published, we adopt the most popular and simple clustering algorithm, K-means [24], for our research. As the discussion of diversified clustering algorithms is beyond our scope, please refer to [25] for more details on data clustering.

The advantage of containing the original measured quantities and easy implementation allows for pixel intensity values instead of patch features to be employed for clustering. The overlapping dense patches on the first stack are unfolded as the set of Q (I 1 × I 2) -dimensional points x ^ 1 0 , x ^ 2 0 , , x ^ Q 0 ,q=1,2,,Q that will be clustered into K clusters. Nevertheless, massive noise existing in the patches decreases the reliability of the characteristic structure and eliminates the performance of the clustering algorithm. In consideration of computational effectiveness, (I 1 × I 2) -dimensional points are projected into the lower dimensional space by PCA to characterize the intrinsic variation of the data. After projection, (I 1 × I 2) -dimensional points x ^ 1 0 , x ^ 2 0 , , x ^ Q 0 is converted into J dimensional points x 1 0 , x 2 0 , , x Q 0 .

Assume C 0 = c 1 0 , c 2 0 , , c k 0 , , c K 0 ,k=1,2,,K denotes K clusters and μ k 0 denotes the mean of cluster c k . A partition of the patches can be found by minimizing the squared error between the grouping means and the points:

cluster C 0 = arg min μ k 0 k = 1 K x q 0 c k 0 x q 0 μ k 0 2
(9)

After clustering in one multiscale image stack, the corresponding patches that exhibit high correlation are grouped into K three-way arrays X i 0 R I 1 × I 2 × I 3 ,i=1,2,,K, with I 3 denoting the number of similar images in the group. Three-way arrays are processed precisely by GND-PCA to suppress noise without destroying the internal connection of patch similarities.

A three-way array X i 0 R I 1 × I 2 × I 3 ,i=1,2,,K can be unfolded into three matrices along each mode space and represented by X i 1 0 R I 1 × I 2 I 3 , X i 2 0 R I 2 × I 3 I 1 , and X i 3 0 R I 3 × I 1 I 2 ,i=1,2,,K. The unfolding procedures, called mode matricization of a third-order tensor, are visualized in Figure 3. For each unfolded matrix, the eigenvector matrix U i n 0 = u i n 1 0 , u i n 2 0 , , u i n D i n 0 associated with the first D i n 0 largest eigenvalues (number of mode-subspace bases) can be calculated from the covariance matrix C X i n 0 =E X i n 0 X i n 0 T , where, n = 1, 2, 3. Generally, the number of D i(n) are decided by the experience and application. A simple determination procedure proposed in [26] can also be used. In each mode, this method decides the dimension by the variation ratio to be kept by eigenvalues. The order of the eigenvectors, u i n 1 0 , u i n 2 0 ,, u i n D i n 0 , satisfies the corresponding eigenvalues λ i n 1 0 λ i n 2 0 λ i n D i n 0 . Dimension reduction is completed in each mode for denoising, and thus, the calculated U i n 0 are not the optimal bases for the entire three-way array. The optimal bases for the three-way array and denoised patches can be obtained by utilizing the above U i n 0 as the initialization. Then, an iteration algorithm, which calculates one matrix if the others are fixed, is used to determine all optimal matrices to satisfy the following energy function:

e= arg min U i n 0 , n = 1 , 2 , 3 X i 0 Y i 0 × 1 U i 1 0 × 2 U i 2 0 × 3 U i 3 0 2
(10)
Figure 3
figure 3

Mode matricization of a three-way array and calculation of eigenvector matrices.

where Y i 0 R D i 1 0 × D i 2 0 × I 3 are core tensors. Note that the dimension of the third mode is retained without reduction. The reconstructed three-way array shown in Eq. 11 is the denoised grouping. Figure 4 illustrates the dimension reduction of GND-PCA with a three-way array.

X ^ i 0 = Y ^ i 0 × 1 U ^ i 1 0 × 2 U ^ i 2 0 × 3 U ^ i 3 0
(11)
Figure 4
figure 4

Dimension reduction of GND-PCA with a three-way array.

After all the three-way arrays on the same level are denoised with GND-PCA, we place them back into their original positions. With the overlapping patches extracted, more than one patch estimation in the denoised three-way arrays can be located at exactly the same coordinate. An accumulation is performed by averaging the overlapping pixel positions. Take the example on G 0,0, which denotes the first level image with no Gaussian filter. The denoised estimation G ^ 0 , 0 of G 0,0 is computed by an average of the patch estimates Y ^ p 0 R I 1 × I 2 ,p=1,2,,P in the first stack. Here, Y ^ p 0 Y ^ q 0 ,PQ. We have

G ^ 0 , 0 = p 1 , P x R Y ^ p 0 , x R p 1 , P x R E x R
(12)

where E has the same size as Y ^ p 0 and all elements of E are one, and x R is the coordinate iterated in patches. The denoised estimations for all stacks are denoted by G ^ a , b ,0aA,0bB.

Multiresolution combination

All images on the same stack are added up to become one representative image, as shown in Eq. 13.

G a = 1 B + 1 b = 0 B G ^ a , b
(13)

The denoised image is obtained by combining the representative images G a , a = 0, 1, 2, …, A at each level. The corresponding pyramids with levels L a contain the differences of high-frequency components between G a and G a + 1. Differences G a  − G a + 1, a = 0, 1, …, A − 1 cannot be calculated directly because G a + 1 contains fewer samples than G a . For this reason, the number of samples in G a + 1 is increased to match G a by interpolating the missing samples and the interpolation filter. Both operations are combined in the “Expand” operation,

Expand G a = f 3 2 G a
(14)

where (2 ↑) denotes upsampling by inserting a zero between adjacent data elements and f 3 denotes the linear interpolation filter. The output image g ^ can be reconstructed from L a by,

G ^ a = L a : a = A L a + Expand G a + 1 : 0 a A 1
(15)

and then,

g ^ = G ^ 0
(16)

In the reconstructed process, the low-frequency information of G a is discarded and replaced by G a + 1. Finally, the de-speckled image in log-domain is converted into spatial domain through exponential transformation. The complete MR-GND-PCA method is shown as a diagrammatic sketch in Figure 2.

Experiments and results

The proposed MR-GND-PCA was used as an application to denoise an ultrasound image corrupted by speckle noise. The quantitative performance of the proposed method was investigated by using three different kinds of images, including a synthetic image with artificial speckle noise, phantom data, and a common carotid artery scanned by commercial ultrasonic scanners.

Synthetic image investigation

The efficiency of the proposed MR-GND-PCA was tested by using a generated noisy image with artificial speckle noise. Equation 2 shows that we degraded the original test image by multiplying it with unit mean random fields to obtain the test speckle image. The spatially correlated speckle noise was produced by low-pass filtering a complex Gaussian random field and taking the magnitude of the filtered output [27]. Low-pass filtering was performed by averaging the complex values of the size three sliding window. This short-term correlation allowed the noise correlation to taper gradually to zero, as well as the correlation length of the speckle to be controlled by appropriately setting the size of the kernel used to introduce correlation to the underlying Gaussian noise. The size of the synthetic image is 141 × 141. Two distinct levels of speckle noise were generated by changing the variance of the underlying complex Gaussian random field. The purely synthetic image shown in Figure 5 is invoked as a reference noise-free image and is available at [34]. The image is comprised of regions with uniform intensity, sharp edges, and strong scatters.

Figure 5
figure 5

Original purely synthetic image.

The performance of the proposed MR-GND-PCA method was compared with traditional despeckling methods (Median filter, Fourier ideal filtering, Fourier Butterworth filter, Wavelet filter) as well as state-of-the-art algorithms (Bilateral filter [28], KSVD [12], Non-local means [29], BM3DPCA [13], PGPCA [14], LPGPCA [15]). All despeckling methods were implemented on the images with high, middle and low levels of speckle noise.

We used four well-known metrics as quantitative performance measures to assess quality image, including mean-square error (MSE), signal-to-noise ratio (SNR), peak signal-to-noise ratio (PSNR), and the structural similarity (SSIM). MSE evaluates the noise variance and is given by

MSE= 1 MN x = 1 M y = 1 N g ^ x , y S x , y 2
(17)

where g ^ x , y is the denoised image and S(x, y) is the purely synthetic image. SNR is defined as

SNR=10 log 10 P s MSE
(18)

where P s is the variance of the noise-free reference image as

P s = 1 MN x = 1 M y = 1 N g ^ x , y 2
(19)

PSNR is defined by

PSNR=10 log 10 N max MSE
(20)

where N max is the maximum fluctuation in the input image.

And SSIM is given by

SSIM= 2 μ g ^ x , y μ S x , y + C 1 2 σ g ^ x , y S x , y + C 2 μ g ^ x , y 2 + μ S x , y 2 + C 1 σ g ^ x , y 2 + σ S x , y 2 + C 2
(21)

where μ g ^ x , y , μ S(x,y), σ g ^ x , y , σ S(x,y), and σ g ^ x , y S x , y are the mean of g ^ x , y , the mean of S(x, y), the variance of g ^ x , y , the variance of S(x, y), and the covariance of g ^ x , y and S(x, y), respectively; C 1 and C 2 are small constants.

Multiple parameter selection

In MR-GND-PCA, the parameters: number of mode-subspace bases D i(1) × D i(2) , number of clusters (K), and the Gaussian scale (σ) are crucial for restoration results. In order to determine the best parameters of MR-GND-PCA, we investigate the variation trends of MSE, SNR, PSNR and SSIM when D i(1), D i(2) [1, 5], K = 50 ~ 90, and σ= 1 / 2 ,1, 3 / 2 . The comparison results are illustrated in Figures 6, 7, 8 and 9. It is clear in Figures 6, 7 and 8 that the lowest MSE, the highest SNR and PSNR can be obtained when D i(1) × D i(2) = 1 × 1, K = 80 and σ= 3 / 2 , which are also considered as the best parameters in the following experiments, though SSIM is a little bit higher with σ = 1 than that with σ= 3 / 2 in Figure 9.

Figure 6
figure 6

Variation trends of MSE with different number of clusters, number of mode-subspace bases and Gaussian scales.

Figure 7
figure 7

Variation trends of SSIM with different number of clusters, number of mode-subspace bases and Gaussian scales.

Figure 8
figure 8

Variation trends of SNR with different number of clusters, number of mode-subspace bases and Gaussian scales.

Figure 9
figure 9

Variation trends of PSNR with different number of clusters, number of mode-subspace bases and Gaussian scales.

Comparison of MR-PCA and MR-GND-PCA

In order to illustrate the effectiveness of GND-PCA for image denoising, we substitute GND-PCA for PCA in the proposed MR-GND-PCA framework, which is called MR-PCA. The restoration results for low-, middle-, and high-level noise are shown in Figure 10. All the parameters in MR-PCA are set completely same as those in MR-GND-PCA. The first row ((a), (c) and (e)) presents the restoration results obtained with MR-GND-PCA, and the second row ((b), (d) and (f)) presents the restoration results obtained with MR-PCA. The calculated MSE, SNR, PSNR and SSIM related to the original image are also given in the captions below the figure. We can see that MR-GND-PCA gives better overall performance in terms of both noise suppression and detail preservation. However, MR-PCA produces artifacts around the edges of each objects, which is a potential influence of the accurate diagnosis.

Figure 10
figure 10

Restoration results for low-, middle-, and high-level noise with MR-GND-PCA and MR-PCA: (a) Restoration result for low-level noise with MR-GND-PCA (MSE = 298.77, SNR = 58.04, PSNR = 23.38, SSIM = 0.8452) (b) Restoration result for low-level noise with MR-PCA (MSE = 820.8849, SNR = 53.65, PSNR = 18.99, SSIM = 0.7359), (c) Restoration result for middle-level noise with MR-GND-PCA (MSE = 532.83, SNR = 55.53, PSNR = 20.86, SSIM = 0.7738), (d) Restoration result for middle-level noise with MR-PCA(MSE = 1422.50, SNR = 51.26, PSNR = 16.60, SSIM = 0.6606), (e) Restoration result for high-level noise with MR-GND-PCA (MSE = 985.93, SNR = 52.85, PSNR = 18.19, SSIM = 0.6775), (f) Restoration result for high-level noise with MR-PCA (MSE = 1423.3, SNR = 51.2604, PSNR = 16.60, SSIM = 0.6484).

Comparison of multiple denoising methods

The values of MSE, SNR, PSNR and SSIM obtained for the corresponding test image with all the methods are summed up in Tables 1, 2 and 3.

Table 1 Metrics obtained when applying denoising methods to the image with low-level of speckle noise
Table 2 Metrics obtained when applying denoising methods to the image with middle-level speckle noise
Table 3 Metrics obtained when applying denoising methods to the image with high-level speckle noise

Tables 1, 2 and 3 clearly show that the proposed MR-GND-PCA can obtain the lowest MSE, as well as the highest SNR and PSNR. Moreover, the SSIMs of the proposed method are nearest to one among all the denoising filters. Thus, the MR-GND-PCA is an effective denoising method for reducing the noise as well as preserving the details. Comparisons of Figures 11, 12 and 13 show that the proposed MR-GND-PCA can obtain more impressive denoising results for the image with high level noise. Although there are still some artifacts in the smoothed images with all the denoising methods, such as upper right object, the proposed MR-GND-PCA is the most reliable process algorithm because of suppressing the majority noise keeping the details in the source image. The result confirms that the multiresolution created for GND-PCA performance is an appropriate combination for ultrasound images with massive noise compare to the state-of-art methods.

Figure 11
figure 11

Images after applying different denoising methods for purely synthetic image with low-level speckle noise.

Figure 12
figure 12

Images after the application of different denoising methods for the purely synthetic image with middle-level speckle noise.

Figure 13
figure 13

Images after the application of different denoising methods for the purely synthetic image with high-level speckle noise.

Phantom data validation

Phantom data called CIRS MODEL 057A are available at http://www.cirsinc.com/. The B-scan image of these phantom data was obtained from a commercial ultrasonic scanner with a 3.5 MHz phased array probe. The 470 × 620 regions of interest of the original and processed images are shown in Figures 14(a) and (b). The highlighted lines in Figures 14(a) and (b) indicate the 340th rows in the images. The pixel values in these rows from the original and denoised images are compared in Figures 14(c) and (d) respectively. Our proposed method suppresses speckle noise effectively. Most of the stray mottles in the original image are smoothed.

Figure 14
figure 14

Results on phantom data: (a) original image, (b) denoised image, (c) profile row phantom data, (d) profile row denoised image.

Clinical data verification

Clinical images of common carotid artery (CCA) are available for free on the Signal Processing Laboratory website. The B-scans were acquired with a Sonix OP ultrasound scanner with a different set-up of depth, gain, time gain compensation (TGC) curve, and different linear array transducers. Figure 15 shows one of the CCA images with size of 330 × 528, in which three highlighted areas marked by the yellow arrows can be fully identified and preserved. Figure 16 illustrates the results processed before and after using MR-GND-PCA. The highlighted areas in Figures 16(c) and (d) show that the denoised image in Figure 16(b) displays significant improvement and recovers discontinuities well.

Figure 15
figure 15

Original CCA image. The three yellow arrows point to the focus locations.

Figure 16
figure 16

Results on CCA image: (a) original image, (b) denoised image, (c) profile row CCA image, (d) profile row denoised image.

Discussion and conclusions

In this paper, we introduced MR-GND-PCA for noise suppression in ultrasound images. Our approach consists of three stages. First, after the ultrasound image is converted by logarithmical transformation, the Gaussian pyramid with multiscale image stacks on each level is built. Second, similar patches are grouped to be directly denoised by GND-PCA in the same pyramid level and then placed on the original location to form clean pyramid levels. Third, the representative images obtained from each level are combined to obtain the noise reduction ultrasound image.

The first and third stages create a multiresolution framework that utilizes all frequency bands. Downscaling has a denoising effect that contributes to better denoising. The second stage uses GND-PCA to maintain the structure of the data and to consider the correlation of all modes of the proposed data.

Experiments were carried out on synthetic images with three distinctive level speckles and two clinical images. Quantitative measures were used to compare 11 denoising filters for the synthetic images. Experimental results show that our proposed method achieved the lowest noise interference. Our method is also robust for the image with a much higher level of speckle noise. For clinical images, the results show that MR-GND-PCA can reduce speckle and preserve resolvable details. Further work on speeding up the method and enhancing the edge of the objects will be pursued in the future.

References

  1. Tay PC, Garson CD, Acton ST, Hossack JA: Ultrasound despeckling for contrast enhancement. IEEE Trans Image Process 2010,19(7):1847–1860.

    MathSciNet  Google Scholar 

  2. Adam D, Beilin-Nissan S, Friedman Z, Behar V: The combined effect of spatial compounding and nonlinear filtering on the speckle reduction in ultrasound images. Ultrasonics 2006,44(2):166–181. 10.1016/j.ultras.2005.10.003

    Google Scholar 

  3. Xavier FP, de Fontes GAB, Coupé P, Hellier P: Real time ultrasound image denoising. J Real-Time Image Process 2011,6(1):15–22. 10.1007/s11554-010-0158-5

    Google Scholar 

  4. Kotropoulos C, Pitas I: Optimum nonlinear signal detection and estimation in the presence of ultrasonic speckle. Ultrason Imaging 1992,14(3):249–275. 10.1177/016173469201400303

    Google Scholar 

  5. Bernstein R: Adaptive nonlinear filters for simultaneous removal of different kind of noise in images. IEEE Trans Circuits Syst 1987,34(11):1275–1291. 10.1109/TCS.1987.1086066

    Google Scholar 

  6. Karaman M, Kutay MA, Bozdagi G: An adaptive speckle suppression filter for medical ultrasonic imaging. IEEE Trans Med Imaging 1995,14(2):283–292. 10.1109/42.387710

    Google Scholar 

  7. Yu Y, Acton ST: Speckle reducing anisotropic diffusion. IEEE Trans Med Imaging 2002,11(11):1260–1270.

    MathSciNet  Google Scholar 

  8. Sanches JM, Marques JS: A MAP estimation algorithm with Gibbs prior using an IIR filter. energy minimization methods in computer vision and pattern recognition. Lect Notes Comput Sci 2003, 2683: 436–449. 10.1007/978-3-540-45063-4_28

    Google Scholar 

  9. Portilla J, Strela V, Wainwright MJ, Simoncelli EP: Image denoising using scale mixtures of gaussians in the wavelet domain. IEEE Trans Image Process 2003,12(11):1338–1351. 10.1109/TIP.2003.818640

    MathSciNet  Google Scholar 

  10. Buades A, Coll B, Morel JM: A review of image denoising algorithms, with a new one. Multiscale Model Simul 2005,4(2):490–530. 10.1137/040616024

    MathSciNet  Google Scholar 

  11. Foi A, Boracchi G: Foveated self-similarity in nonlocal image filtering. In Proc. SPIE Electronic Imaging 2012. Burlingame (CA), USA: Human Vision and Electronic Imaging; 2012:8232–8291.

    Google Scholar 

  12. Aharon M, Elad M, Bruckstein AM: The K-SVD: an algorithm for designing of overcomplete dictionaries for sparse representation. IEEE Trans Signal Process 2006,54(11):4311–4322.

    Google Scholar 

  13. Dabov K, Foi A, Katkovnik V, Egiazarian K: BM3D Image Denoising with Shape - Adaptive Principal Component Analysis. In Proc. Workshop on Signal Processing with Adaptive Sparse Structured Representations (SPARS'09). Saint-Malo, France; 2009.

    Google Scholar 

  14. Zhang L, Dong W, Zhang D, Shi G: Two-stage image denoising by principal component analysis with local pixel grouping. Pattern Recognit 2010, 43: 1531–1549. 10.1016/j.patcog.2009.09.023

    Google Scholar 

  15. Deledalle C-A, Salmon J, Dalalyan A Proceedings of the British Machine Vision Conference. In Image denoising with patch based PCA: local versus global. Dundee, UK: BMVA Press; 2011:1–10.

    Google Scholar 

  16. Chen YW, Han X, Nozaki S: ICA-domain filtering for penumbral imaging. Rev Sci Instrum 2004, 75: 3977–3979. 10.1063/1.1787932

    Google Scholar 

  17. Han X-H, Chen Y-W: A robust method based on ICA and mixture sparsity for edge detection in medical images for edge detection in medical images. Signal Image Video Process 2011,5(1):39–47. 10.1007/s11760-009-0140-5

    Google Scholar 

  18. Xu R, Chen YW: Generalized N -dimensional principal component analysis (GND-PCA) and its application on construction of statistical appearance models for medical volumes with fewer samples. Neurocomputing 2009, 72: 10–12.

    Google Scholar 

  19. Jolliffe IT: Principal Component Analysis. Springer-Verlag; 1986:487. doi:10.1007/b98835

    Google Scholar 

  20. Kolda TG, Bader BW: Tensor decompositions and applications. SIAM Rev 2009,51(3):455–500. 10.1137/07070111X

    MathSciNet  Google Scholar 

  21. Jain AK: Fundamental of Digital Image Processing. Englewood Cliffs, NJ: Prentice-Hall; 1989.

    Google Scholar 

  22. Zong X1, Laine AF, Geiser EA: Speckle reduction and contrast enhancement of echocardiograms via multiscale nonlinear processing. IEEE Trans Med Imaging 1998,17(4):532–540. 10.1109/42.730398

    Google Scholar 

  23. Lowe DG: Distinctive image features from scale-invariant keypoints. Int J Comput Vis 2004,60(2):91–110.

    Google Scholar 

  24. Kanungo T, Mount DM, Netanyahu NS, Piatko CD, Silverman R, Wu AY: An efficient k-means clustering algorithm: analysis and implementation. IEEE Trans Pattern Anal Mach Intell 2002,24(7):881–892. 10.1109/TPAMI.2002.1017616

    Google Scholar 

  25. Jain AK: Data clustering: 50 years beyond K-means. Pattern Recognit Lett 2010,31(8):651–666. 10.1016/j.patrec.2009.09.011

    Google Scholar 

  26. Lu H, Plataniotis KN, Venetsanopoulos AN: MPCA: Multilinear Principal Component Analysis of tensor objects, IEEE Trans. Neural Netw 2008,19(1):18–39.

    Google Scholar 

  27. Piˇzurica A, Philips W, Lemahieu I, Acheroy M: A versatile wavelet domain noise filtration technique for medical imaging. IEEE Trans Med Imaging 2003,22(3):323–331. 10.1109/TMI.2003.809588

    Google Scholar 

  28. Tomasi C, Manduchi R: Bilateral filtering for gray and color images. Bombay: Sixth International Conference on Computer Vision; 1998:839–846.

    Google Scholar 

  29. Manj’on J, Carbonell-Caballero J, Lull J, Garc’ıa-Mart’ı G, Mart’ı-Bonmat’ı L, Robles M: MRI denoising using non-local means. Med Image Anal 2008,12(4):514–523. 10.1016/j.media.2008.02.004

    Google Scholar 

Download references

Acknowledgements

This work was supported by the National Basic Research Program of China (2010CB732505, 2013CB328806), the Key Projects in the National Science & Technology Pillar Program (2013BAI01B01), the National Hi-Tech Research and Development Program (2013AA013703) and the National Science Foundation Program of China (61179020).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jian Yang.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

ADN suggested the algorithm for images denoising, implemented it and drafted the manuscript. YJ conceived of the study, and participated in its design and coordination and helped to draft the manuscript. CY performed the acquisition of the ultrasound images and expressed opinions on the evaluation metric of the denoised results. CWJ and FJF participated in the design of the study, drew a part of figures and performed the image analysis. WYT helped to draft the manuscript and expressed opinions on the overall framework of the manuscript. All authors have read and approved the final manuscript.

Authors’ original submitted files for images

Rights and permissions

Open Access  This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made.

The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.

To view a copy of this licence, visit https://creativecommons.org/licenses/by/4.0/.

The Creative Commons Public Domain Dedication waiver (https://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ai, D., Yang, J., Chen, Y. et al. Multiresolution generalized N dimension PCA for ultrasound image denoising. BioMed Eng OnLine 13, 112 (2014). https://doi.org/10.1186/1475-925X-13-112

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1475-925X-13-112

Keywords