검색 전체 메뉴
PDF
맨 위로
OA 학술지
Dynamic Modulation Transfer Function Analysis of Images Blurred by Sinusoidal Vibration
  • 비영리 CC BY-NC
  • 비영리 CC BY-NC
ABSTRACT

The dynamic modulation transfer function (MTF) for image degradation caused by sinusoidal vibration is formulated based on a Bessel function of the first kind. The presented method makes it possible to obtain an analytical MTF expression derived for arbitrary frequency sinusoidal vibration. The error obtained by the use of finite order sum approximations instead of infinite sums is investigated in detail. Dynamic MTF exhibits a stronger random behavior for low frequency vibration than high frequency vibration. The calculated MTFs agree well with the measured MTFs with the slant edge method in imaging experiments. With the proposed formula, allowable amplitudes of any frequency vibration are easily calculated. This is practical for the analysis and design of the line-of-sight stabilization system in the remote sensing camera.


KEYWORD
Imaging system , Modulation transfer function , Sinusoidal vibration , Slant edge method
  • I. INTRODUCTION

    In the remote sensing imaging system, image resolution is generally limited resulting from motion degradation caused by mechanical vibration [1]. Sinusoidal vibration is a basic form of mechanical vibration, such as low frequency, rigid body motion due to platform control instabilities and medium-to-high frequency disturbances due to structural elasticity [2]. A convenient form with which to characterize motion degradation quantitatively is dynamic MTF [3, 4].

    Earlier MTF calculation methods were based on spatial frequency analysis of sine-wave response or on spatial domain spread function analysis. Analytical MTF expressions were established only for simple kinds of motion such as linear motion and high frequency vibration whose frequency is integral times the detector exposure frequency [5-7]. A MTF expression for low frequency vibration was approximated by a sinc function, regarding square root of the average central second moment during exposure time as constant velocity motion [8]. The calculation method presented by A. Stern and N. S. Kopeika for any kind of motion was expressed in the form of a power series in terms of statistical moments of the motion during the exposure [9]. MTF for 2-D relative motion is obtained with the method of numerical integration [10]. However, the previous calculation methods are not very suitable for arbitrary frequency sinusoidal vibration.

    In this paper a formula is established to calculate dynamic MTF for sinusoidal vibration at arbitrary frequency. The MTF expression is in the form of an infinite sum of integral order Bessel functions of the first kind. Whereas, only finite order of Bessel functions can be used for practical implementation. The truncation error caused by replacing the infinite sum with a finite sum approximation is described in detail. In the simulation analysis, there exists a strong random characteristic especially for low frequency vibration when the ratio of the exposure period to the vibration period is not an integer. Admissible vibration amplitudes at arbitrary frequency are calculated with the MTFs in the worst case. The actual MTF due to vibration is measured with the knife edge chart. Using a fast steering mirror (FSM) actuated by the piezoelectric transducer (PZT), sinusoidal vibrations are generated. The measured MTFs agree well with the calculated results, indicating the validity of the proposed MTF calculation formula.

    II. MTF CALCULATION FORMULA

       2.1. Analytical MTF Expression

    According to the transfer function theory of the linear optical system, the line spread function (LSF) in one direction is expressed as δ (X) in ideal conditions. The relative motion between the object and detector is assumed to be x(t). The LSF becomes δ [X-x(t)] when the motion component is only in the direction which is perpendicular to the optical axis direction. The LSF of the imaging system during the exposure period is given by normalization processing.

    image

    where ts is the beginning time of exposure, te is the exposure period. The optical transfer function (OTF) is given in terms of the Fourier Transform of the LSF.

    image

    Hence OTF can be deduced from Eqs. (1) and (2):

    image

    Dynamic MTF is derived as the modulus of the OTF:

    image

    MTF for any kind of motion can be calculated by numerical integration without obtaining the probability density function (PDF) of the motion in previous calculation methods. Sinusoidal vibration can be expressed as:

    image

    where D stands for the amplitude and T stands for the period of the sinusoidal motion. MTF for sinusoidal vibration becomes:

    image

    The exponential function can be expressed as an infinite sum of integral order Bessel functions of the first kind:

    image

    Because the sum of infinite series is coincident convergence, the operation order of integrals and sums can be exchanged. The MTF expression becomes

    image

    where

    image
    image

    Substituting Eqs. (9) and (10) into Eq. (8), we have the MTF expression:

    image

    Thus, Eq. (11) defines a direct relation between dynamic MTF and the vibration amplitude D, the ratio te/T between the exposure period and vibration period and the initial exposure time ts. With different initial exposure time MTF may change even if the vibration amplitude and the ratio are certain. However, MTF is the function of the vibration amplitude D when the ratio is an integer. The expression becomes:

    image

    Eq. (12) is identical with the well-known expression for high frequency vibration derived by other MTF calculation methods.

       2.2. Convergence of the Approximate Analytical MTF Expression

    An infinite sum of integral order Bessel functions is needed to calculate MTF theoretically. However an infinite sum of integral order Bessel functions of the first kind can’t be achieved in practice. Sinusoidal vibration caused MTFs are calculated by truncating up to 2Nth order Bessel functions of the first kind.

    image

    The 2Nth order approximation error is deduced by the remainder of the infinite sum.

    image

    Based on the triangle inequality the approximation error is expressed as:

    image
    image

    Because of the inequality (17) and (18)

    image
    image

    The approximation error is given:

    image

    The integral order Bessel function of the first kind can be expressed in the form of a power series.

    image

    Substituting Eq. (20) into Eq. (19)

    image

    The 2Nth order approximation error is calculated by the remainder of the sum in Lagrange form.

    image

    Finally, the upper bound to the absolute error is expressed as follows:

    image

    With Eq. (23), the upper bound error can be calculated. However it is necessary to emphasize that fewer order Bessel functions are required generally. A plot of the upper limit error for the 2Nth order approximation at the spatial frequency f = 1/D is shown in Fig. 1. As can be seen, up to 18th order Bessel functions are needed for the approximation error less than 0.02.

    III. SIMULATION ANALYSIS OF MTF FOR SINUSOIDAL VIBRATION

       3.1. Simulation of MTF for Low and High Frequency Sinusoidal Vibration

    Because of turbines and motors or structural resonance, vibration is a critical factor that degrades the image quality when the imaging system is located on aircraft and other vehicles [11]. There is still residual image motion even though sinusoidal vibration is mostly attenuated by passive isolation and gyro stabilization techniques. Sinusoid oscillations are often classified as low frequency (te/T < 1) and high frequency (te/T > 1) based on the ratio of the exposure period to the vibration period as shown in Fig. 2. For low frequency vibration, there is a great change in the relative motion during the exposure period. Whereas the relative motion for high frequency vibration is nearly the same.

    In accordance with the calculation formula, MTF for sinusoidal vibration depends on the parameters (the amplitude D and the ratio te /T). It is also a random process, depending on the beginning time of the exposure when the ratio te /T is not an integer. The MTFs for sinusoidal vibration (D = 10 μm and te /T = 0.25, 0.5, 1.5, 5.5) are calculated with different initial time of the exposure as shown in Fig. 3.

    As can be seen, the MTFs exhibit a strong stochastic characteristic for low frequency. Image blur due to low frequency vibration is variable because the beginning time of the exposure is usually random. However, the random behavior is not evident for high frequency vibration and the exposure period can be approximated to an integral number of the vibration period when the ratio te /T is more than 5. MTF can be calculated simply by using the zero order Bessel function of the first kind.

       3.2. Tolerance of Residual Sinusoidal Vibration Amplitude

    Dynamic MTF in the worst case should be analyzed to make sure that the image resolution can be high enough. With the initial exposure time ts = (T - te)/2), image degradation is the most severe. The analytical MTF expression becomes:

    image

    MTFworst is a function of vibration amplitude D and the ratio te /T. The MTFs with different vibration amplitudes and ratios are calculated as shown in Fig. 4. As can be seen, for low frequency vibration, image quality can be improved by reducing vibration amplitude and the exposure period of the detector. However, the only effective way of enhancing image resolution for high frequency vibration is limiting the vibration amplitude.

    As previously discussed, the MTF due to vibration at the Nyquist frequency should be more than 0.9 to ensure high resolution of images [11]. The Nyquist frequency is defined as

    image

    where p is the pixel size of the detector. The upper bound of vibration amplitudes with arbitrary ratio is obtained with Eq. (26).

    image

    As illustrated in Fig. 5, the upper bound of low frequency vibration amplitudes declines as the ratios rise. And the allowable amplitudes of high frequency vibration are almost consistent with the value 0.2 pixel size.

    IV. EXPERIMENTS AND RESULTS

       4.1. Experimental Setup

    The optical system for measuring dynamic MTF under sinusoidal vibration is illustrated in Fig. 6. The uniform illumination for the knife-edge target is provided by an integrating sphere and the edge target is at the focal plane of the collimation lens. The light is incident to the CMOS camera after being reflected by a FSM actuated by PZT.

    The sinusoidal motion at the focal plane is generated when the mirror actuator is supplied with a sinusoidal signal by the function generator. The image motion is expressed as:

    image

    where F is the focal length of the camera, θ is the angular amplitude of the mirror rotation, T is the period of the sinusoidal signal.

    In this paper the slanted edge method is used to provide a fast and effective MTF measurement [12]. The slanted edge method has been used to measure MTF on orbit and modified methods have been proposed to improve the measuring accuracy [13-15]. For the sake of increasing the sampling frequency and eliminating the aliasing effect, the knife-edge is slightly slanted compared with the knife-edge method. The procedure of the slanted edge method is illustrated in Fig. 7. Firstly, the edge angle is estimated by performing the linear regression on the collected line-to-line estimated edge positions. In Fig. 7(a), the pixels in the rectangular region of interest (ROI) are projected along the gradient direction into the bins whose width is a quarter of the sampling frequency on the horizontal axis [16]. The one-dimensional edge spread function (ESF) is generated by averaging the values of the pixels in each bin in Fig. 7(b). The line spread function (LSF) is yielded by the derivative of the ESF in Fig. 7(c) and the MTF in Fig. 7(d) is measured after performing a discrete Fourier transform and normalizing.

    The total MTF for the imaging system denoted by MTFtotal is obtained from Eq. (28):

    image

    where MTFstatic is the MTF of the camera without vibration and MTFvibration is the dynamic MTF of image degradation caused by vibration.

       4.2. Experimental Results

    As Fig. 8 shows, the COMS camera we used is with 1K×1K pixels and the size of each pixel is 5.5 μm × 5.5 μm. The exposure period is set as 20 ms and the focal length of the camera is 50 mm. The frequency range of the vibration generated by the FSM is from 10 Hz to 300 Hz and the amplitude provided by the FSM is 0.5 mrad. Figure 9 shows the static image and blurry images caused by the sinusoidal vibration whose frequency is 25 Hz. Figure 9(a) shows the static image without vibration and as shown in Fig. 9(b) ~ Fig. 9(f), the blurred images are dissimilar due to the different beginning time of the exposure. The dynamic MTFs calculated by Eq. (28) though the static MTF and the total MTF measured with the slant edge method are shown in Fig. 10(a). The MTFs measured from the degraded images agree well with the calculated MTFs shown in Fig. 10(b). For the sinusoidal vibration whose frequency is 50, 100, 200 Hz, the blurry images are mostly uniform as in Fig. 9(g) ~ Fig. 9(i) and the MTFs measured from images and the MTFs in theory are basically consistent as shown in Fig. 11.

    V. CONCLUSION

    In this paper a new formula to calculate dynamic MTF for sinusoid oscillation has been described. The great advantage of the proposed method is that analytical MTF expressions for any frequency sinusoidal vibration are obtained. Dynamic MTF is expressed as an infinite sum of integral order Bessel functions of the first kind. For practical application, low order sum approximations give satisfactory results. And the validity of the MTF calculation formula is verified with imaging experiments.

    For low frequency, MTF exhibits a strongly random characteristic. And the random behavior is not obvious for high frequency vibration especially when the ratio te/T is more than 5. With the same vibration amplitude, a comparison shows that image degradation due to high frequency vibration is more severe than for low frequency vibration.

    This new method can be implemented in image motion degradation analysis. Allowable vibration amplitudes can be predicted simply with the presented method which has an effective guidance for the line-of-sight stabilization system design.

참고문헌
  • 1. Wang S. G., Guan B. Q., Wang G. B., Li Q. (2007) “Measurement of sinusoidal vibration from motion blurred images,” [Pattern Recogn. Lett.] Vol.28 P.1029-1040 google cross ref
  • 2. Vollmerhausen R., Friedman M. H., Reynolds J., Burks S. (2007) “Modeling the blur associated with vibration and motion,” [Proc SPIE] Vol.6543 P.65430U google
  • 3. Xu P., Hao Q., Huang C. N., Wang Y. T. (2003) “Degradation of modulation transfer function in push-broom camera caused by mechanical vibration,” [Opt. Laser Technol.] Vol.35 P.547-552 google cross ref
  • 4. Lee J. H., Jung Y. S., Ryoo S. Y., Kim Y. J. (2011) “Imaging performance analysis of an EO/IR dual band airborne camera,” [J. Opt. Soc. Korea] Vol.15 P.174-181 google cross ref
  • 5. Wulich D., Kopeika N. S. (1987) “Image resolution limits resulting from mechanical vibrations,” [Opt. Eng.] Vol.26 P.529-533 google
  • 6. Hadar O., Fisher M., Kopeika N. S. (1992) “Image resolution limits resulting from mechanical vibrations. Part III: numerical calculation of modulation transfer function,” [Opt. Eng.] Vol.31 P.581-589 google cross ref
  • 7. Hadar O., Dror I., Kopeika N. S. (1994) “Image resolution limits resulting from mechanical vibrations. Part IV: real-time numerical calculation of optical transfer functions and experimental verification,” [Opt. Eng.] Vol.33 P.566-578 google cross ref
  • 8. Friedenberg A. (2008) “Simulation of the MTF due to low-frequency and correlated vibrations,” [J. Mod. Opt.] Vol.55 P.401-407 google cross ref
  • 9. Stern A., Kopeika N. S. (1997) “Analytical method to calculate optical transfer functions for image motion and vibrations using moments,” [J. Opt. Soc. Am. A] Vol.14 P.388-396 google cross ref
  • 10. Deng Q., Feng H. J., Xu Z. H., Li Q., Chen Y. T., Dong W. D. (2012) “Study on MTF of remote sensing imaging under arbitrary known vibration,” [Proc SPIE] Vol.8420 P.84200W google
  • 11. Liao J. Y., Gao X. D. (2010) “Dynamic MTF analysis and calculation of aerial camera,” [Proc SPIE] Vol.7658 P.765819 google
  • 12. 2000 Photography-Electronic Still Picture Cameras-Resolution Measurements, ISO Standard 12233 google
  • 13. Najafi S., Madanipour K. (2013) “Measurement of the modulation transfer function of a charge-coupled device array by the combination of the self-imaging effect and slanted edge method,” [Appl. Opt.] Vol.52 P.4724-4727 google cross ref
  • 14. Sun C. S., Ding Y. L., Wang D. J., Tian D. P. (2015) “Backscanning step and stare imaging system with high frame rate and wide coverage,” [Appl. Opt.] Vol.54 P.4960-4965 google cross ref
  • 15. Li H., Yan C. X., Shao J. B. (2016) “Measurement of the modulation transfer function of infrared imaging system by modified slant edge method,” [J. Opt. Soc. Korea] Vol.20 P.381-388 google cross ref
  • 16. Masaoka K., Yamashita T., Nishida Y., Sugawara M. (2014) “Modified slanted-edge method and multidirectional modulation transfer function estimation,” [Opt. Express] Vol.22 P.6040-6046 google cross ref
이미지 / 테이블
  • [ ] 
  • [ ] 
  • [ ] 
  • [ ] 
  • [ ] 
  • [ ] 
  • [ ] 
  • [ ] 
  • [ ] 
  • [ ] 
  • [ ] 
  • [ ] 
  • [ ] 
  • [ ] 
  • [ ] 
  • [ ] 
  • [ ] 
  • [ ] 
  • [ ] 
  • [ ] 
  • [ ] 
  • [ ] 
  • [ ] 
  • [ FIG. 1. ]  The upper bound error for the 2Nth order approximation at spatial frequency f = 1/D.
    The upper bound error for the 2Nth order approximation at spatial frequency f = 1/D.
  • [ FIG. 2. ]  Sinusoidal vibration: (a) low frequency vibration; (b) high frequency vibration.
    Sinusoidal vibration: (a) low frequency vibration; (b) high frequency vibration.
  • [ FIG. 3. ]  The MTFs for sinusoidal vibration different ratios: (a) te /T = 0.25; (b) te /T = 0.5; (c) te /T = 1.5; (d) te /T = 5.5.
    The MTFs for sinusoidal vibration different ratios: (a) te /T = 0.25; (b) te /T = 0.5; (c) te /T = 1.5; (d) te /T = 5.5.
  • [ ] 
  • [ FIG. 4. ]  MTFworst for sinusoidal vibration: (a) low frequency vibration; (b) high frequency vibration.
    MTFworst for sinusoidal vibration: (a) low frequency vibration; (b) high frequency vibration.
  • [ ] 
  • [ ] 
  • [ FIG. 5. ]  The upper bound of allowable vibration amplitudes for arbitrary ratios.
    The upper bound of allowable vibration amplitudes for arbitrary ratios.
  • [ FIG. 6. ]  Sketch of the experimental setup.
    Sketch of the experimental setup.
  • [ ] 
  • [ FIG. 7. ]  The procedure of the slant edge method.
    The procedure of the slant edge method.
  • [ ] 
  • [ FIG. 8. ]  The experimental imaging system.
    The experimental imaging system.
  • [ FIG. 9. ]  The static image and blurry images caused by low and high frequency vibration.
    The static image and blurry images caused by low and high frequency vibration.
  • [ FIG. 10. ]  The MTFs for low frequency vibration: (a) the measured MTFs with the slant edge method; (b) the calculated MTFs with the derived formula.
    The MTFs for low frequency vibration: (a) the measured MTFs with the slant edge method; (b) the calculated MTFs with the derived formula.
  • [ FIG. 11. ]  The measured MTF and calculated MTF for high frequency vibration.
    The measured MTF and calculated MTF for high frequency vibration.
(우)06579 서울시 서초구 반포대로 201(반포동)
Tel. 02-537-6389 | Fax. 02-590-0571 | 문의 : oak2014@korea.kr
Copyright(c) National Library of Korea. All rights reserved.