This PDF file contains the front matter associated with SPIE Proceedings Volume 8043, including the Title Page, Copyright information, Table of Contents, and Conference Committee listing.

The success of 3D video, as one of the emerging multimedia formats, will largely depend on the improved quality of experience that it provides to viewers when compared to conventional 2D video. Therefore reliable methods for 3D video quality assessment are crucial in order to optimize 3D video systems and services. The goal of this paper is to review recent developments in 3D video quality assessment, and to discuss its future directions.

Since the big hit of 3D movie 'Avatar', broadcasting industry is preparing launch of 3DTV service. There are many ways to transmit stereoscopic video data and provide 3DTV service. In order to provide 3DTV service of full HDTV quality and at the same time 2DTV service to legacy viewers in terrestrial broadcasting, we need to send two images of full resolution encoded separately. We present new hybrid encoding schemes: 'MPEG-2+AVC', 'MPEG-2+AVC Interview' and 'MPEG-2+HEVC', and then compare objective and subjective performance of each scheme. 'MPEG- 2+HEVC' shows the best result and it shows the possibility of providing backward compatible 3DTV service while keeping HDTV quality to legacy HDTV users.

The class of two-dimensional non-separable linear canonical transforms is the most general family of linear canonical transforms, which are important in both signal/image processing and optics. Application areas include noise filtering, image encryption, design and analysis of ABCD systems, etc. To facilitate these applications, one need to obtain a digital computation method and a fast algorithm to calculate the input-output relationships of these transforms. We derive an algorithm of NlogN time, N being the space-bandwidth product. The algorithm controls the space-bandwidth products, to achieve information theoretically sufficient, but not redundant, sampling required for the reconstruction of the underlying continuous functions.

Recently, researches on digital holographic 3D display are getting very active as well as the digital holography for 3D image acquisition. This paper reviews recent research activities in Japan, including digital holographic 3D video displays, digital holographic fringe printers and computer-generated holograms. The holographic video display includes 100 megapixel full-color full-parallax display, horizontal scanning display, enlarged viewing angle display. For the fringe printer, laser plotter and tiling systems are introduced. For the computer-generated hologram, various kinds of hologram types are described as well as fast computation methods.

This paper introduces holographic 3D displays for ray-based and wavefront-based light-field reproductions. As a raybased display though a hard copy 3D image, a holographic 3D printer is introduced, which automatically outputs highresolution full-parallax holographic stereograms from 3D image data. Fine-quality full-color 3D images were experimentally obtained with excellent gloss and texture appearances. As a wavefront-based display, we have proposed a technique for calculating computer generated hologram, in which the wavefront is derived from the light-ray information. High-resolution display of deep 3D scene is possible, while realistic image can be generated by utilizing conventional rendering techniques for computer graphics.

Recent development of computer algorithms and micro fabrication technologies allows us to reconstruct the wave-field of light emitted from a completely virtual 3D scene given by the numerical model. In addition, recent evolution of image sensors and a technique for capturing real object waves makes it possible to digitize the whole process of classical holography. The wave-field of the virtual, real, and hybrid scene are optically reconstructed by the computer holograms fabricated by laser lithography system. The produced spatial 3D images have a wide viewing-zone in full-parallax and give viewers a strong sensation of depth, which never has been caused by conventional 3D systems.

Previously, we reported a digital technique for formation of real, non-distorted, orthoscopic integral images by direct pickup. However the technique was constrained to the case of symmetric image capture and display systems. Here, we report a more general algorithm which allows the pseudoscopic to orthoscopic transformation with full control over the display parameters so that one can generates a set of synthetic elemental images that suits the characteristics of the Integral-Imaging monitor and permits control over the depth and size of the reconstructed 3D scene.

Integral imaging is a 3D sensing and imaging technique. Conventional 3D integral imaging systems require that all the sensor positions in the image capture stage are known. But in certain image pick up geometries, it may be difficult to obtain accurate measurement of sensor positions such as sensors on moving platforms and/or randomly distributed sensors. In this paper, we present a 3D integral imaging method with unknown sensor positions. In the proposed method, all the sensors are randomly distributed on a plane with parallel optical axes. More, only the relative position of any two sensors is needed whereas all other sensor positions are unknown. We combine image correspondences extraction, camera perspective model, two view geometry and computational integral imaging 3D reconstruction techniques to estimate the unknown sensor positions and reconstruct 3D images. The experiment results executed both in lab and outside show the feasibility of the proposed method in 3D integral imaging. Furthermore, the experiments indicate that the quality of reconstructed images by using the proposed sensor position estimation algorithm can be improved compared to the ones by using the physical measurements of the sensor positions.

We present a method of changing the ratio of a horizontal to vertical angles by rotating a lens array in integral imaging. We arranged an elemental image with a width and height that is not equal to the pitch of an elemental lens as the total number of the pixels of the elemental image is invariant. Additionally, we rotated the lens array to avoid overlapping the specially-shaped elemental images. We enlarged the horizontal viewing angle by arranging the elemental images with a width that is larger than height and the pitch of the elemental lens. We investigated the arrangement of these images and found that rotating the lens array changed the ratio of the horizontal to vertical viewing angles.

In this paper realization of precise depth perception using coarse integral volumetric imaging (CIVI) is discussed. CIVI is a 3D display technology that combines multiview and volumetric solutions by introducing multilayered structure to integral imaging. Since CIVI generates real images optically, optical distortion can cause distortion of 3D space to be presented. To attain presentation of undistorted 3D space with CIVI, the authors simulate the optics of CIVI and propose an algorithm to show undistorted 3D space by compensating the optical distortion on the software basis. The authors also carry out psychophysical experiments to verify that vergence-accommdation conflict is reduced and depth perception of the viewer is improved by combining multiview and volumetric technologies.

Three types of multi-focus(MF) 3D display are developed and possibility about monocular depth cue is tested. The multi-focus means the ability of monocular depth cue to various depth levels. By achieving multi-focus function, we developed 3D display system for each eye, which can satisfy accommodation to displayed virtual objects within defined depth. The first MF 3D display is developed via laser scanning method, the second MF 3D display uses LED array for light source, and the third MF 3D display uses slated LED array for full parallax monocular depth cue. The full parallax MF 3D display system gives omnidirectional focus effect. The proposed 3D display systems have a possibility of solving eye fatigue problem that comes from the mismatch between the accommodation of each eye and the convergence of two eyes. The monocular accommodation is tested and a proof of the satisfaction of the full parallax accommodation is given as a result of the proposed full parallax MF 3D display system. We achieved a result that omni-directional focus adjustment is possible via parallax images.

When people watch 3D-Ready TV, the display luminance as well as the ambient illuminace is important factors for image quality and physiological comfort. In this research, a human factors experiment on a stereoscopic display was conducted. The result showed that display luminance affected subjective comfort evaluation and image quality evaluation. The effect of ambient illuminance also influenced objective asthenopia index (CFF), subjective comfort evaluation and viewers' image quality evaluation of watching 3D static pictures. However, the main effects of display luminance, ambient illuminance, and their interaction effect were not significant on objective physiological measurement (HRV). Among the six combination levels of display luminance and ambient illuminance, viewers felt more comfortable and got the best image quality in the high levels of display luminance and ambient illuminance. The outcome of the experiment is expected to find out the optimal display luminance and ambient illuminance combination level for designers' guidelines and users' references as viewing 3D displays.

Photonica, Inc. has pioneered the use of magneto-optics and hybrid technologies in visual display systems to create arrays addressing hi-speed, solid-state modulators up to 1K times faster that DMD/DLP, yielding high frame-rate and extremely high net native resolution allowing for full-duplication of right eye and left eye modulators at 1080p, DCI 2K, 4K and other specified resolution requirements. The technology enables high-transmission (brightness) per frame. In one version, each integrated image-engine assembly processes binocular frames simultaneously, employing simultaneous right eye/left eye channels, either polarization-based or "Infitec" color-band based channels, as well as pixel-vector based systems. In another version, a multi-chip, massively parallel signal-processing architecture integrates pixel-signal channels to yield simultaneous binocular frames. This may be combined with on-chip integration. Channels are integrated either through optics elements on-chip or through fiber network or both.

Integral imaging could be considered as one of the prospective methods for recording and displaying 3D images based on its distinct features. Some of the most important challenges with this approach are the field of view and resolution limitation. In this work we investigate using frequency division multiple access (FDMA) idea for solving this problem. Simulation results show an increase of more than ten percent in the performance of the 3D reconstructed images using the proposed method.

Recovering 3D object information through analyzing image focus (or defocus) has been shown to be a potential tool in situations where only a single viewing point is possible. Precise modeling and manipulation of imaging system parameters, e.g. depth of field, modulation transfer function and sensor characteristics, as well as lighting condition and object surface characteristics are critical for effectiveness of such methods. Sub-optimal performance is achieved when one or more of these parameters are dictated by other factors. In this paper, we will discuss the implicit requirements imposed by most common depth from focus/defocus (DFF/DFD) analysis methods and offer related application considerations. We also describe how a priori information about the objects of interest can be used to improve performance in realistic applications of this technology.

The use of structured light illumination techniques for three-dimensional data acquisition is, in many cases, limited to stationary subjects due to the multiple pattern projections needed for depth analysis. Traditional Composite Pattern (CP) multiplexing utilizes sinusoidal modulation of individual projection patterns to allow numerous patterns to be combined into a single image. However, due to demodulation artifacts, it is often difficult to accurately recover the subject surface contour information. On the other hand, if one were to project an image consisting of many thin, identical stripes onto the surface, one could, by isolating each stripe center, recreate a very accurate representation of surface contour. But in this case, recovery of depth information via triangulation would be quite difficult. The method described herein, Modified Composite Pattern (MCP), is a conjunction of these two concepts. Combining a traditional Composite Pattern multiplexed projection image with a pattern of thin stripes allows for accurate surface representation combined with nonambiguous identification of projection pattern elements. In this way, it is possible to recover surface depth characteristics using only a single structured light projection. The technique described utilizes a binary structured light projection sequence (consisting of four unique images) modulated according to Composite Pattern methodology. A stripe pattern overlay is then applied to the pattern. Upon projection and imaging of the subject surface, the stripe pattern is isolated, and the composite pattern information demodulated and recovered, allowing for 3D surface representation. Additionally, we introduce techniques which, when implemented, allow fully automated processing of the Modified Composite Pattern image.

Reconstruction of three dimensional (3D) images from photon counting integral images was recently demonstrated by applying several methods including: maximum likelihood estimation, Bayesian estimation, and statistical estimation involving truncated Poisson statistics. Here we present simulation results for a new estimation approach implementing Penalized Maximum Likelihood Expectation Maximization (PMLEM) that better incorporates prior information in the reconstruction process.

In this paper, we propose a 3D sensing and visualization of micro-objects using an axially distributed image capture system. In the proposed method, the micro-object is optically magnified and the axial images of magnified micro-object are recorded using axially distributed image capture. The recorded images are used to visualize the 3D scene using the computational reconstruction algorithm based on ray back-projection. To show the usefulness of the proposed method, we carry out preliminary experiments and present the results.

In this paper, three-dimensional (3D) imaging of objects in scattering medium is presented. Synthetic Aperture Integral Imaging (SAII) technique is used to record multiple images with different perspectives. Each recorded image is degraded by light scattering. This degradation function can be modeled by Gaussian Theory. The unknown parameter mean of Gaussian distribution can be estimated by using Maximum Likelihood Estimation (MLE). The effects of scattering can be remedied by using estimated degradation function and statistical image processing techniques such as histogram stretching and matching. 3D scene can be visualized by computational 3D reconstruction algorithms of integral imaging. To show the ability of 3D object visualization in scattering medium, experimental results are presented.

The distortions in the perceived images of three different camera arrangements of parallel, converging and diverging are compared for different inter-camera distances. The parallel also reveals distortion in both depth and image size when inter-camera distance is small. The converging and diverging are showing opposite behaviors in their distortion appearance. The distortions are most for the diverging but it can enhance the protruding depth, especially when the intercamera distance is much smaller than the interocular distance.

Stereoscopic crosstalk can be expressed in terms of gamma characteristics. In presence of crosstalk the background regions of the displayed image and the disparity regions are perceived as if they are displayed with different gamma characteristics. To equalize the characteristics means to compensate the crosstalk. In this paper we show that the reference gamma characteristic can be modified to improve crosstalk compensation. The method can be recommended for reduction of dark ghosting in stereoscopic systems.

The traidational 3D interactive sysetm which uses CCD camera to capture image is difficult to operate on near range for mobile applications.Therefore, 3D interactive display with embedded optical sensor was proposed. Based on optical sensor based system, we proposed four different methods to support differenct functions. T mark algorithm can obtain 5- axis information (x, y, z,θ, and φ)of LED no matter where LED was vertical or inclined to panel and whatever it rotated. Sequential mark algorithm and color filter based algorithm can support mulit-user. Finally, bare finger touch system with sequential illuminator can achieve to interact with auto-stereoscopic images by bare finger. Furthermore, the proposed methods were verified on a 4-inch panel with embedded optical sensors.

This work describes a novel scheme, in which LC material is used to form a lenticular lens array in order to achieve 2D and autostereoscopic 3D display on a 10.1-inch (1366×768 pixels) LCD panel. Optimized design parameters of the 3D display are also derived by theoretical analyses. Additionally, the LC lens configuration and the lenticular-type 3D display model are constructed by analyzing the LC properties and optical characteristics based on simulation software, respectively. Experimental results demonstrate the 3D quality and the switching 2D/3D performance. Two novel 3D applications of the LC lens based on a tablet PC are discussed as well.

In this paper, we suggested a way constructing an objective space transformation as the distorted objective space to make a perceived scaled depth sense as the nature depth for an actual image circumstance. In there, a hybrid camera system is adopted as a tool of multi-views actual images acquisition. There is consisted of two camera system, one is a depth camera which used to take an actual object's depth information and the other is a common camera which is used to map color information to the depth image. In previous work, we already showed the possibility of the concept that a transformed an object space for taking a natural depth sense based on CG object space is good approach. For improving the work, we show an advanced approach that the multi-views of the right scaled object depth senses without a depth distortion based on an actual image by any size of display adaptation can also perceived. Both systematic and observational stereoscopic constraints are already considered to the distorted object space to make a scaled depth image in the reconstructed image space.

Plenoptic cameras have been developed over the last years as a passive method for 3d scanning. Several superresolution algorithms have been proposed in order to increase the resolution decrease associated with lightfield acquisition with a microlenses array. A number of multiview stereo algorithms have also been applied in order to extract depth information from plenoptic frames. Real time systems have been implemented using specialized hardware as Graphical Processing Units (GPUs) and Field Programmable Gates Arrays (FPGAs). In this paper, we will present our own implementations related with the aforementioned aspects but also two new developments consisting of a portable plenoptic objective to transform every conventional 2d camera in a 3D CAFADIS plenoptic camera, and the novel use of a plenoptic camera as a wavefront phase sensor for adaptive optics (OA). The terrestrial atmosphere degrades the telescope images due to the diffraction index changes associated with the turbulence. These changes require a high speed processing that justify the use of GPUs and FPGAs. Na artificial Laser Guide Stars (Na-LGS, 90km high) must be used to obtain the reference wavefront phase and the Optical Transfer Function of the system, but they are affected by defocus because of the finite distance to the telescope. Using the telescope as a plenoptic camera allows us to correct the defocus and to recover the wavefront phase tomographically. These advances significantly increase the versatility of the plenoptic camera, and provides a new contribution to relate the wave optics and computer vision fields, as many authors claim.

Digital holography (DH) is being increasingly used for its time-resolved three-dimensional (3-D) imaging capabilities. A 3-D volume can be numerically reconstructed from a single 2-D hologram. Applications of DH range from experimental mechanics, biology, and fluid dynamics. Improvement and characterization of the 3-D reconstruction algorithms is a current issue. Over the past decade, numerous algorithms for the analysis of holograms have been proposed. They are mostly based on a common approach to hologram processing: digital reconstruction based on the simulation of hologram diffraction. They suffer from artifacts intrinsic to holography: twin-image contamination of the reconstructed images, image distortions for objects located close to the hologram borders. The analysis of the reconstructed planes is therefore limited by these defects. In contrast to this approach, the inverse problems perspective does not transform the hologram but performs object detection and location by matching a model of the hologram. Information is thus extracted from the hologram in an optimal way, leading to two essential results: an improvement of the axial accuracy and the capability to extend the reconstructed field beyond the physical limit of the sensor size (out-of-field reconstruction). These improvements come at the cost of an increase of the computational load compared to (typically non iterative) classical approaches.

Imaging of transparent micro-objects objects, especially living cells, becomes a challenging problem since such objects do not appreciably change the amplitude of the electromagnetic radiation interacting with it. Phase contrast techniques can be used to overcome this hurdle. Digital holography is one of the most effective tools for phase contrast microscopic imaging of transparent objects and it yields the three dimensional profile of the object under investigation. Another advantage of digital holography is that of numerical focusing, allowing one to focus on to any desired object plane. This aspect of digital holography along with interferometry is utilized to study dynamics of phase micro-objects. The changes occurring to the object under study is determined from their three dimensional profile which is obtained from the phase information.

Live biological cells are three-dimensional microscopic objects that constantly adjust their sizes, shapes and other biophysical features. Wide-field digital interferometry (WFDI) is a holographic technique that is able to record the complex wavefront of the light which has interacted with in-vitro cells in a single camera exposure, where no exogenous contrast agents are required. However, simple quasi-three-dimensional holographic visualization of the cell phase profiles need not be the end of the process. Quantitative analysis should permit extraction of numerical parameters which are useful for cytology or medical diagnosis. Using a transmission-mode setup, the phase profile represents the multiplication between the integral refractive index and the thickness of the sample. These coupled variables may not be distinct when acquiring the phase profiles of dynamic cells. Many morphological parameters which are useful for cell biologists are based on the cell thickness profile rather than on its phase profile. We first overview methods to decouple the cell thickness and its refractive index using the WFDI-based phase profile. Then, we present a whole-cell-imaging approach which is able to extract useful numerical parameters on the cells even in cases where decoupling of cell thickness and refractive index is not possible or desired.

Digital holography is a 3D imaging technology that provides phase information. It has been used for microscopy in many applications as 3D surface recognition, biophotonics and so on. However, it is not easy to obtain accurate information when objects have right angle shapes and measured vertically. To make ease the condition an object is rotated to obtain 3D information in trading off some shape view, but if several holograms are taken for the same object at different views the trade-off information can be reconstructed by topographic compensation. This paper suggests a method of integrating microscopic holograms using view compensation. View compensation is processed by feature extraction and object motion compensation.

In this paper we overview a method which can remove speckle noises to exist in coherent imaging systems. Integral imaging (II) system under coherent illumination records the elemental image set with speckle noise patterns of a threedimensional (3D) object. The computational geometrical ray propagation and statistical point estimation algorithms are applied to the elemental image set in order to reconstruct the speckle reduced 3D integral imaging. As performance metrics, the SNR and speckle index are calculated. The results are used to compare the speckle reduced 3D image reconstructed by the presented method with the coherent image having speckle patterns. It is shown in experiments that the presented method can three dimensionally reduce the speckle noise in the 3D object reconstruction.

Digital holography records the superposition of the object and reference waves. The subsequent reconstruction of both amplitude and phase of the optical field is done by numerically propagating the optical field along the direction perpendicular to the hologram plane in accordance with the laws of diffraction. Phase changes undergone by a light wave passing through or reflecting from objects can be converted to the optical thickness or height measurements, providing the three dimensional structural information about the object. Our dual wavelength phase imaging method allows three dimensional measurements of a wide variety of biological systems and microstructures.

So far most research of human behavior recognition focus on simple individual behavior, such as wave, crouch, jump and bend. This paper will focus on abnormal behavior with objects carrying in power generation. Such as using mobile communication device in main control room, taking helmet off during working and lying down in high place. Taking account of the color and shape are fixed, we adopted edge detecting by color tracking to recognize object in worker. This paper introduces a method, which using geometric character of skeleton and its angle to express sequence of three-dimensional human behavior data. Then adopting Semi-join critical step Hidden Markov Model, weighing probability of critical steps' output to reduce the computational complexity. Training model for every behavior, mean while select some skeleton frames from 3D behavior sample to form a critical step set. This set is a bridge linking 2D observation behavior with 3D human joints feature. The 3D reconstruction is not required during the 2D behavior recognition phase. In the beginning of recognition progress, finding the best match for every frame of 2D observed sample in 3D skeleton set. After that, 2D observed skeleton frames sample will be identified as a specifically 3D behavior by behavior-classifier. The effectiveness of the proposed algorithm is demonstrated with experiments in similar power generation environment.

Digital holographic microscopy (DHM) provides a non-destructive and quantitative phase contrast imaging that is suitable for high resolving investigations of living cells. On the other hand, for many applications including cell analysis the immobilization of the sample under study is a crucial task. Optical trap is an elegant candidate to immobilize the micro samples. In this work, DHM is integrated with an optical trapping setup. This combination is of particular advantage for quantitative visualization of three dimensional structures that are trapped by laser beam. The recorded hologram by CCD can be post-processed to three dimensional (3D) reconstruction of the trapped objects.

We have already developed glasses-free three-dimensional (3-D) displays using multi-projectors and a special diffuser screen that results in a highly realistic communication system. The system can display 70-200 inch large-sized 3-D images with full high-definition video image quality. The displayed 3-D images were, however, only computergenerated graphics or still images of actual objects. In this work, we studied a 3-D video capturing method for our multiprojection 3-D display. We analyzed the optimal arrangement of cameras for the display, and the image quality as influenced by calibration error. In the experiments, we developed a prototype multi-camera system using 30 highdefinition video cameras. The captured images were corrected via image processing optimized for the display. We successfully captured and displayed, for the first time, 3-D video of actual moving objects in our glasses-free 3-D video system.

We have developed some prototype systems for ultra-realistic communication in future using electronic holography as 3D display, since electronic holography is the technology to reconstruct ideal 3D objects in space. In this paper, we describe the basis of the systems and introduce three of them, i.e., a real-time electronic holography system with integral photography, wide viewing-zone-angle electronic holography system, and electronic holography system with camera array.