In phase measuring profilometry, the accuracy of the recovered 3D result relies heavily on the quality of the phase. However, the presence of gamma effect often introduces severe nonlinear phase errors, leading to ripple-like artifacts in the reconstructed surface profile. It has been proved that the Probability Density Function (PDF) of the wrapped phase values, i.e., regarded as phase histogram can well visualize the noticeable periodic errors introduced by the nonlinear gamma. Therefore, a variety of PDF-based solutions have been proposed, including calculating an optimal preset gamma value, searching better compensation coefficients and building an in-situ Look-Up-Table (LUT) and so on. Nonetheless, the influence of nonuniform intensity resulting from factors such as variations in illumination distance and imaging distance has not been adequately considered. In pursuit of further advancements, this paper introduces a real-time sub-regional compensation method based on PDF to mitigate the influence of uneven intensity distribution. In this solution, a series of simulated PDF curves, as well as gamma-value-based look-up tables that map phase-to-phase errors are created w.r.t different gamma values in advance. These simulated PDF curves are used to find the optimal gamma values of each sub-region that is divided based on a projected grayscale image. The adaptive LUTs are applied to each sub-region based on the respective gamma values, which results in improved calibration accuracy. By utilizing three-step phase-shifting fringe patterns and a grayscale image, the proposed method effectively addresses the influence of nonuniform intensity and avoids complexities of pre-calibration procedures. Experimental results validate the efficacy and practicality of this approach, highlighting its potential for high-precision and real-time measurements.
KEYWORDS: Deformation, Digital image correlation, 3D metrology, 3D projection, Phase shifts, Projection systems, Modulation, Cameras, 3D image processing, Shape analysis
Stereo digital image correlation (3D-DIC or Stereo-DIC) has advantages of high accuracy and flexibility and is widely used for 3D shape and deformation reconstruction. However, it is difficult to retrieve information of complex structure due to the severe perspective distortion in both views and area-based matching algorithm. And on the other hand, fringe projection profilometry (FPP) has pixelwise 3D shape reconstruction ability for complex structure but lacks accurate deformation and strain analyzing ability. In this work, we combine DIC with FPP to simultaneously obtain accurate 3D shape and deformation information and further perform strain analysis. First, the complete 3D shape of complex surface is reconstructed pixel by pixel using FPP. Next, the modulation of the phase-shifting fringes is extracted as texture maps to eliminate the interference of ambient light and for further DIC processing. DIC is only used to perform temporal matching for pixel-by-pixel tracking on reconstructed 3D shape. The in-plane and out-of-plane deformations are obtained simultaneously by directly comparing the complete 3D data for each corresponding pixel. Moreover, the strain in each direction is calculated by differencing the deformation data with chain rule. Experiments on the complex dynamic scene demonstrate the feasibility of the proposed method and show potential in analysis of specimen with complex structure.
Large DOF (depth-of-field) with high SNR (signal-noise-ratio) imaging plays an important role in many applications such as unmanned driving to medical imaging. However, there is always a trade-off between DOF and SNR in traditional optical design. In this paper, we propose a NIR&VISCAM (NIR&VIS Camera) that combines multi-spectral optical design and deep learning to realize large DOF and high SNR imaging. Specifically, a multi-spectral optical imaging system based on the HVS (human visual system) is designed to provide colorful but small DOF VIS (visible) image and large DOF NIR (near-infrared) image. To achieve DOF extension, we build a fusion network NIR&VISNet consisting of a VIS encoder for color extraction, a NIR encoder for spatial details extraction and a decoder for information fusion. We establish a prototype to capture real-scene dataset containing 1000 sets and test our method on a variety of test samples. The experimental results demonstrate that our NIR&VISCAM can effectively produce large DOF images with high quality. Moreover, compared to the classic image fusion methods, our designed algorithm achieves the optimal performance in DOF extension and color fidelity. With the prominent performance in large DOF and high SNR imaging, this novel and portable system is promising for vision applications such as smartphone photography, industry detection, and life medical.
In large-scale imaging or measurement, a rotating photogrammetric system with a camera fixed on the surface of the turntable can be used to extend the field of view of the camera with the rotation of the turntable. The camera’s projection center needs to be located at the rotation axis of the turntable, so the images captured during the sequentially rotating share the same projection center. It is very convenient to merge the subimages into a panoramic image. Due to the complexity of the camera’s lens system, the position of the projection center is usually unknown, which makes it difficult to find the projection center and align it with the rotation axis of the turntable. We propose a method to find the distance and azimuth angle between the projection center and rotation axis to solve the alignment problem using the parameters of the camera. In theory, as long as the intrinsic and extrinsic parameters of the camera are known, the distance and angle can be obtained by rotating the turntable once. With the translation values calculated from the distance and angle, the camera can be moved in two directions perpendicular to each other, so its projection center passes through the rotation axis. The theoretical analysis of the alignment problem is given. Experiments verify the feasibility of the proposed method are conducted. The alignment uncertainty of the proposed method is <0.2 mm.
Establishing a highly accurate phase-to-height mapping relationship is very important in fringe projection profilometry, which guarantees the accuracy of final three-dimensional reconstruction. The influence coming from lens distortion, random noises, and the nontelecentric projecting and imaging of the measurement system is analyzed in detail, followed by the exhaustive discussion of a more accurate phase-to-height mapping method. The mapping tabulation between absolute phase and height information is set up by the piecewise linear fitting method within the whole measurement range for per-pixel. Our method is compared with the previously used methods, such as linear fitting (LF), quadratic fitting (QF), and cubic fitting (CF) methods. Computer simulations and experiments verify that the reconstructed height distribution employing our method is more accurate than either LF or QF methods when the random noise is obvious. In addition, if the random noise can be controlled to low level and the lens distortion is considered, the reconstruction accuracy of our method is better than that of the CF method.
Common problems faced in optical comprehensive design experiment and going against the Washington Accord are pointed out. For resolving these problems, an instructional and innovative teaching scheme for Optics Comprehensive Design Experiment is proposed. We would like to understand the student that can improve the hands-on practical ability, theory knowledge understanding ability, complex problem solving ability, engineering application ability, cooperative ability after tracking and researching the student who have attended the class about Optical Comprehensive Design Experiment, We found that there are some problems on the course such as the experiment content vague, the student beginning less time, phase separation theory and engineering application, the experiment content lack of selectivity and so on. So we have made some improvements reference to the Washington Accord for the class teaching plan about Optical Comprehensive Design Experiment. This class must relevant to the engineering basic courses, professional foundation course and the major courses, so far as to the future study and work that which can play a role in inheriting and continuity to the students. The Optical Comprehensive Design Experiment teaching program requires students learning this course to have learnt basic courses like analog electronics technique, digital electronic technique, applied optics and computer and other related courses which students are required to comprehensively utilize. This teaching scheme contains six practical complex engineering problems which are respectively optical system design, light energy meter design, illuminometer design, material refractive index measuring system design, light intensity measuring system design and open design. Establishing the optional experiment and open experiment can provide students with a greater choice and enhance the students' creativity, vivid teaching experimental teachers and enriching contents of experiment can make the experiment more interesting, providing students with more opportunities to conduct experiment and improving students' practical ability with long learning time, putting emphasis on student's understanding of complex engineering problems and the cognitive of the process to solve complex engineering problems with actual engineering problems. Applying the scheme in other courses and improving accordingly will be able to ensure the quality of engineering education. Look forward to offering useful reference for the curriculum system construction in colleges and universities.
The vertical optical measurement method with coaxial projection and imaging can measure the complex surface or step-like surface because it helps to avoid the shadow and occlusion. Instead of the phase calculation and phase unwrapping processing, only the modulation information is needed to reconstruct the surface of the tested object by this method. To improve the accuracy of the modulation calculation at each scanning position from only one fringe pattern, this paper introduces the two-dimensional (2-D) wavelet transform into modulation measurement profilometry. The relationship between the 2-D complex wavelet transform coefficients and the modulation distribution of the fringe is deduced. The computer simulation and experiment are carried out to verify that the method based on the 2-D complex wavelet analysis offers higher accuracy than that based on the Fourier transform analysis.
The S-transform, a time frequency representation proposed in 1996 by R.G. Stockwell, can be conceptually thought of
either as a variable window short-time Fourier transform or a phase corrected Wavelet transform. Whose window size
verifies with the frequency and here both the local amplitude and local phase spectrum of a time varying signal can be
simultaneously estimated. As a reversible time-frequency analysis tool, it is well suited to analyzing of non-stationary
signals and has many desirable characteristics. Distinct from the wavelet transformation, averaging the local S spectra
over the direction of time can correctly form the Fourier transform spectra of the signal. Therefore S transform have
direct relationship with the Fourier transform. In recent years, the S-transform has been introduced in three-dimensional
optical measurement based on a fringe projection technique and attracted many researchers to work on the field. In this
paper, for verifying the advantages of S transform, we compare the reconstruction of S transform, including S transform
ridge method and S transform filtering method, with that of other methods, such as Fourier transform method, wavelet
transform method for eliminating phase errors caused by the existences of both nonlinear factor and noise. In addition,
we have a discussion and make a comparison on these methods by means of computer simulations appearing robust
within different white Gaussian noise levels. It shows that S-transform profilometry based on the filtering way is helpful
to the enhancement of measurement accuracy, which is verified by experiments for its better reconstruction results.
We focus on the discussion of Wavelet transform profilometry based on dual-frequency fringe projection in this work. Employing a deformed fringe pattern with dual-frequency components captured by a CCD camera, we can calculate two wavelet ridge-lines from its continuous wavelet transform coefficients. Then, two sets of wrapped phase maps with difference resolution can be extracted. The longer the equivalent wave length is, the lower the measurement accuracy is.
However, the direct shape reconstruction is not accuracy from low frequency component even though the fringe order from the low frequency component is easier to obtain correctly than from the high frequency component. Therefore the fringe order from low frequency component is used to guide the calculation of the fringe order of the high frequency component in dual-frequency fringe projection technique. Employing the relationship between the two carriers f2 and f1 (supposing f1<f2). we discuss the structure condition and sampling condition of wavelet transform profilometry based on
dual-frequency fringe projection from the aspect of frequency analysis, which guarantee the correct shape reconstruction
from the dual-frequency fringe. We finished the theoretical derivation and computer simulations to verify the correction
of the theory.
The size and shape of ventricle are very important to analyze and diagnose pathology of human heart. So it is very
necessary to measure the profile of ventricle. It is very difficult to measure the ventricle by vivisectional method for its
unique function of heart, so the ventricle specimen is adopted to be measured. Three-dimensional (3D) automatic measurement methods are widely used in many fields. In Biology and Medicine society, it can be applicable for surgery, orthopedics, viscera disease analysis and diagnosis etc. Here a new method to measure the 3D surface of ventricle specimen is proposed. Although the traditional 3D measuing method with equal or stated phase-shifting step length
possess excellent accuracy, they are much dependent on the consistency of these phase-shifting step lengths. In fact, this
condition is very difficult to guarantee. which may lead to the incorrect wrapped phase and incorrect phase unwrapping
in some regions, even the reconstructed object may be misshapen or anamorphic. In the proposed method, a novel
improved three undecided step lengths phase-shifting algorithm with three unequal phase-shifting steps has been
presented detailed and is applied to measure the profile of ventricle sucssesfully. Experiments show that the improved
algorithm can not only effectively improve the measuring accuracy, but also branch out its application.
An adaptive windowed Fourier transform method in 3-D measurement based on a wavelet transform is proposed, in which, by applying a wavelet ridge, a series of scaling factors are calculated to determine the series of prime windows needed in the windowed Fourier transform method. Because the spectrum of each local fringe is simpler than that of the whole fringe, even though there is frequency aliasing as far as the whole fringe is concerned, the fundamental spectrum may separate into components in each local fringe. It is easy to filter out one of the fundamental frequency components from the local spectra. Adding these local fundamental components, the full fundamental component can be obtained correctly. The advantage of the method is that it not only eliminates the frequency aliasing, but also obtains the modulation distribution function to guide phase unwrapping.
A modified Fourier transform profilomtry (FTP) based on a fringe pattern with two frequency components is proposed. We discuss its principle, analyze the maximum measuring range and give an expression to describe the measurable slope of the height variation limitation of this method. The modified FTP provides us another approach to eliminate frequency overlapping. When the spectra distribution of a measured object is not spherical symmetry, we can avoid the frequency aliasing through projecting a fringe pattern with two frequency components, instead of increasing the density of the projected fringe and the resolution of CCD camera. The theoretical analysis and primary experiments verified the method.
An optical method for shape and deformation measurement of a rotating blade, which is based on Fourier transform profilometry (FTP) and the stroboscopic effect, is proposed and has been verified by experiments. The integrated principles of the method, the process of 3-D phase unwrapping, and the detailed design of the synchronization control unit are discussed. Experimental results on a commercial electric fan prove that FTP can reconstruct the shape of a rotating blade efficiently and reveal its deformation different times clearly by using stroboscopic structured illumination. This method can be used for studying high-speed motion with rapid periodic signals.
KEYWORDS: 3D metrology, Motion measurement, Fluctuations and noise, Fringe analysis, Sensors, Light emitting diodes, 3D visualizations, Dynamical systems, Signal detection, Data processing
A stroboscopic structured illumination system, which can be used in measurement for 3D shape and deformation of high-speed motion object, is proposed and verified by experiments. The system, present in this paper, can automatically detect the position of high-speed moving object and synchronously control the flash of LED to project a structured optical field onto surface of motion object and the shoot of imaging system to acquire an image of deformed fringe pattern, also can create a signal, set artificially through software, to synchronously control the LED and imaging system to do their job. We experiment on a civil electric fan, successful acquire a serial of instantaneous, sharp and clear images of rotation blade and reconstruct its 3D shapes in difference revolutions.
Digital micro-mirror device(DMD) is a new type of component which integrates with micro-electronics, micro-machinery and micro-optics. It used as a new type of spatial-light modulator will have a wide prospect in optical information processing and structured illumination three-dimensional sensing. The basic principles of DMD and digital light processor(DLP) have been particularly introduced. The spatio-temporal characteristic of DMD has been extensively studied. The effect on the Phase Measuring Profilometry due to the Spatio-temporal characteristic of DMD is discussed by computer simulation. Experiments have approved the validity of the simulation results which can give the guidance for the application of DMD in structured illumination three-dimensional sensing.
In this paper we proposed a method for three-dimensional (3D) shape measurement and visualization of balloon hull during quick deflation based on Fourier transform profilometry (FTP). A sequence of dynamic deformed fringe images can be grabbed by high-speed CCD camera and saved on disk rapidly. By Fourier transform, filtering, inverse Fourier transform and unwrapping these phase maps in 3D phase space, we can obtain the shape of the rapid deflating balloon in different times. Based on the phase difference between two neighborhood frames, we propound a 3D phase unwrapping algorithm, which will be of great benefit to 3D phase unwrapping in speed and accuracy. The results of our experiment indicate that the method, presented in this paper, can efficiently deal with the surface shape measurement for rapid motion object and will be a promising one with the development of high-speed frame grabber.
KEYWORDS: Fringe analysis, Fourier transforms, 3D metrology, Calibration, Digital cameras, Projection systems, Phase shifting, RGB color model, 3D modeling, Inspection
Fourier transform profilometry (FTP) based on fringe projection has high speed and high procession advantages, so it is widely used in industrial inspection, solid modeling, biomedicine, machine vision and so on. In this paper, we present a novel method, in which we project a bi-color fringe pattern that is consisted of two interlaced RGB base color fringe patterns with π phase difference onto the object using digital light projector and the deformed color pattern is captured by color digital camera. Then the deformed color fringe pattern is decoded into two individual fringe patterns with π phase difference using image-separating technique. After modifying their averages and contrast, we subtract one of the two fringe patterns from the other to eliminate zero spectra. Compared with π phase-shifting technique, the obvious advantage of this method is that only one fringe pattern is needed to remove the zero spectra and raise the measurable slope of height variation nearly three times while no phase shifting device needed. Computer simulation and experiments verify our method.
Optical non-contact 3-D shape measurement provides a novel and useful tool for analysis of facial shape and movement in presurgical and postsurgical regular check. In this article we present a system, which allows a precise 3-D visualization of the patient's facial before and after craniofacial surgery. We discussed, in this paper, the real time 3-D image capture, processing and the 3-D phase unwrapping method to recover complex shape deformation when the movement of the mouth. The result of real-time measurement for facial shape and movement will be helpful for the more ideal effect in plastic surgery.
We introduce short-time Fourier transform into Fourier transform profilometry(FTP) to extract zero frequency component included in deformed fringe pattern. This method can be used to eliminate zero component by only one deformed fringe pattern instead of two. First we extract zero component of deformed fringe image using short-time Fourier transform and normalize it, then calculate the normalized Fourier spectra of deformed fringe image, finally subtract the zero component from Fourier spectra Fourier spectra of deformed fringe image. We give the theory analysis. Experimental results verify that this method can eliminate zero component and extend the measuring range of Fourier transform profilometry to nearly three times of that of the traditional FTP using a frame deformed fringe image. So it is an efficient method to extend measuring range and keep measuring speed, and the setup is very simple because of no phase shifting device needed.
Three-dimensional (3-D) automatic measurement of an object is widely used in many fields. In Biology and Medicine society, it can be applicable for surgery, orthopedics, viscera disease analysis and diagnosis etc. Here a new fast method to measure the 3D surface of human heart is proposed which can provide doctors a lot of information, such as the size of heart profile, the sizes of the left or right heart ventricle, and the curvature center and radius of heart ventricle, to fully analyze and diagnose pathobiology of human heart. The new fast method is optically and noncontacted and based upon the Phase Measurement Profilometry (PMP), which has higher measuring precision. A human heart specimen experiment has verified our method.
KEYWORDS: Computer generated holography, 3D metrology, Holograms, 3D acquisition, Holography, 3D visualizations, 3D image processing, 3D modeling, Visualization, Wavefronts
In this paper, we propose a technique to reconstruct 3-D object shape by its measurement data using CGH. Firstly, both the range image and the intensity image of 3D object are acquired simultaneously using 3D shape measurement system. Then, the Fresnel CGH is designed and fabricated using these data. Finally, combining CGH with optical holography, an image hologram is recorded. The principle of the proposed method, the technology for designing and fabrication of the CGH and optical hologram, and the experimental results are also given in this paper.
We use the micro-scanning technique to eliminate the frequency aliasing caused by sub-sampling in Fourier trans-form profilometry (FTP). It has been discussed that in FTP correct 3-D surface shape retrieval can be obtained only when the slope of the height variation of the measured object is limited within maximum measurement range. If this condition is not satisfied, it is im-possible to obtain correct retrieval because of shadows existed in the fringe pattern. In a crossed-optical-axes system for FTP, a smaller included angle between axis of the projection and the detection system is set to avoid the frequency alias caused by shadows. But the smaller the included angle is, the lower the phase sensitivity in FTP. That is, a small phase error can cause a large height distribution error. In order to eliminate this kind of error, we should project a dense grating image onto an object to reduce equivalent wavelength of fringe. At the same time, we need a high resolution CCD to record the fringe pattern to satisfy the sampling theory. When there is not suitable high resolution CCD, the sub-sampled fringe is obtained. In this paper, we discuss how to combine a cor-rect fringe from sub-sampling fringe patterns using micro-scanning technique in FTP in theory. Computer simulations experiments have proved our analysis.
Phase measuring profilometry using structured illumination with a digital micro-mirror device(DMD) has been extensively studied because of its advantage of the programmable projection. In this paper we discussed the effect of intensity transfer function of the commercial projector with DMD, analyzed the influence of the intensity transfer function and the nonlinear of detector on the quantity of projected sinusoidal fringe and the accuracy of phase measurement, and proposed the correction method for intensity transfer function of DMD. A DMD based phase measuring profilometry system includes a commercial projector with DMD, a CCD camera and a fringe pattern analysis and processing unit. The experiments show that with the correction of the intensity transfer function of the projector the phase measurement accuracy has been improved obviously.
The shoeprint impressions of suspect left at the crime scene can sometimes tell investigators what type of shoes to be looked for. These shoeprint impressions as one of the important evidence are useful in the detection of criminals. In this paper we propose a novel technique for identifying and analyzing the 3D characteristics of shoeprint impressions. We also design 3D shoeprint impression analysis system based on the combination the 3D shape measurement with structured illumination and fringe pattern analysis. We give a detail discussion on the principle and configuration of the system. Laboratory experiments show the technique is efficient in the detection of shoeprint and in the offering the reference for judicial evidence.
In this paper, we propose a method for dynamic 3D shape measurement based on Fourier transform profilometry. We also study the algorithm of phase difference between two deformed fringes and 3D phase unwrapping method based on phase difference.
Fourier transform profilometry (FTP) is a popular method for automatic 3-D shape measurement, which has been widely used in many fields. Now a new method for improving the precision of FTP is presented, in which a gray image of the measured object is captured by CCD camera and used to eliminate the zero frequency component of the deformed pattern. This results in improving the measurement precision and the range of FTP. Theoretical analysis and experiments verify that this method achieves the measurement precision as π phase-shifting technique does, and the experimental setup is simpler because of no phase-shift device.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.