In this paper, we present a method to detect the position of a 3D object in scattering media by using the axially distributed sensing (ADS) method. Due to the scattering noise of the elemental images recorded by the ADS method, we apply a statistical image processing algorithm where the scattering elemental images are converted into scatter-reduced ones. With the scatter-reduced elemental images, we reconstruct the 3D images using the digital reconstruction algorithm based on ray back-projection. The reconstructed images are used for the position detection of a 3D object in the scattering medium. We perform the preliminary experiments and present experimental results.
Visualization and detection of a 3D object in optically scattering media is a challenging problem. An improved visualization method of scattered images can be applied to various applications such as imaging in fog, underwater, security, and medical diagnostics [1-7]. Some 3D multiperspective approaches including integral imaging and axially distributed sensing (ADS) have been studied for visualizing objects in the scattering media [8-9]. Among them, the ADS scheme can provide simple recording architecture by translating a camera along its optical axis. The recorded high-resolution elemental images generate the clear 3D plane images for the partially occluded 3D objects.
In this paper, we present a position detection method for a 3D object in scattering media by using the ADS method [10-12]. In the proposed method, we introduce the statistical signal processing to reduce the scattering effect in elemental images and the position detection process with non-linear correlation operation is newly applied to the scattered images in ADS. The proposed method is divided into four parts: (1) pickup (2) statistical image processing (3) digital reconstruction and (4) position detection. In the pickup part using the ADS method, the camera is moved along a common optical axis and multiple longitudinal 2D images of the scene are recorded. The recorded multiple 2D images of the 3D object in the scattering media are referred to as scattering elemental images. In the second statistical processing part, to reduce the scattering effects of the recorded elemental images, a statistical image processing technique is applied to the scattering elemental images. Then, the statistically processed elemental images are used to reconstruct the 3D plane images using the digital reconstruction algorithm based on ray back-projection in the third part. In the final part, the reconstructed plane images are used for 3D object detection. To show the feasibility of the proposed method, we carry out the preliminary experiments for a scattering 3D object behind a diffuser screen as the scattering medium.
The pickup part of the ADS method is shown in Fig. 1. We translate a single camera along the optical axis and record multiple 2D images of the scene observed through the scattering media. We suppose that the object is located at a distance
When a 3D object is located in scattering media, the recorded image may contain severe scattering noise which can prevent the correct visualization and detection for the 3D object. In this paper, therefore, we wish to reduce the noise by using statistical image processing. To do so, we apply statistical image processing techniques to the scattering elemental images. Let us assume that degradation caused by the diffuser can be modeled as Gaussian [6]. The statistical image processing procedure to reduce the scattering effect in the elemental images is shown in Fig. 2. First, we estimate the unknown parameter
where
The estimated elemental images are obtained by subtracting . The estimated elemental images are given by
This estimation process enables us to reduce the scattering noise in the elemental images.
where
Next, we apply histogram equalization and matching to the corrected elemental images. This process can remove artificial gray levels from the elemental images. We first calculate a cumulative distribution function (CDF) and this is given by
where
In the proposed method, the third part is the digital reconstruction using the scatter-reduced elemental images. This is shown in Fig. 3. It is based on ray back-propagation through virtual pinholes. This reconstruction algorithm numerically implements the reverse of the pickup process. In other words, all scatter-reduced elemental images are back projected and magnified by different magnifications
For faster calculation, the reconstruction process may be normalized by the magnification ratio
In the last part of the proposed method, the plane image
where
To demonstrate the proposed position detection method for a 3D object in scattering media, we carried out optical experiments. The experimental setup is shown in Fig. 4 where a ‘car’ object is positioned approximately 440 mm away from the first camera position. We placed a diffuser at approximately 50 mm in front of the object. The thickness of the diffuser was 1 mm. We used a camera with 2184×1456 pixels with 8.2 um pixel pitch. An imaging lens with focal length
To reduce the scattering noise in the elemental images, the statistical image processing technique was applied to them as described in Fig. 3. Figure 5 shows the example of the 21st elemental image produced by the statistical image processing technique. The 21st elemental image shown in Fig. 5(a) was scatter-reduced as shown in Fig. 5(b). The statistical image processing was repeated to all the recorded elemental images. Then, we can obtain the 41 scatter-reduced elemental images.
To reconstruct the 3D images, the scatter-reduced 41 elemental images were computationally back projected through virtual pinholes according to Eq. (8). The 3D plane images were obtained according to the reconstruction distance. Some reconstructed plane images are shown in Fig. 6(a) for three different reconstruction distances (340 mm, 440 mm, and 540 mm). When the distance of reconstruction plane was 440 mm, where the ‘car’ object is originally located, the reconstructed image is well focused after reducing the scattering noises through the statistical image processing. For comparison, the plane images are shown in Fig. 6(b) when using the conventional method without the statistical image processing.
To detect the position of the 3D object, the non-linear correlation operation as described in Eq. (9) was used for the original reference image and the reconstructed plane images. The correlation peak results are shown in Fig. 7 according to the reconstruction distances from 340 mm to 540 mm. Here the non-linear parameter was 0.6. We can see that the correlation peaks are very low in the conventional method. This is because all of the reconstructed plane images have heavily scattered noise regardless of the reconstruction distance. On the other hand, we can see the highest correlation peak at 440 mm where the object was originally located in the result of the proposed method. At the original position of the object, the 2D correlation output was shown in Fig. 8(a) when the original image and our scatter-reduced plane image were used. For comparison, the correlation output in the conventional method is very low when the scattered plane image was used as shown in Fig. 8(b). Figure 9 shows the graph of the maximum correlation peaks according to the non-linear parameter (
In conclusion, the ADS-based position detection method for a 3D object in scattering media was presented. The elemental images recorded by the ADS method contain severe scattering noise. To reduce the scattering noise, we applied a statistical image processing algorithm to the scattering elemental images. Thus, we were able to obtain the improved 3D plane images using the digital reconstruction algorithm based on ray back-projection. Using them, we compare the correlation performance for the proposed method and the conventional method. The experimental results reveal that the proposed method is superior to the conventional method in terms of correlation operation.