Andrew Maimone
Abstract
We present a glasses-free 3D display design with the potential to provide viewers with nearly correct accommodative depth cues, as well as motion parallax and binocular cues. Building on multilayer attenuator and directional backlight architectures, the proposed design achieves the high angular resolution needed for accommodation by placing spatial light modulators about a large lens: one conjugate to the viewer's eye, and one or more near the plane of the lens. Nonnegative tensor factorization is used to compress a high angular resolution light field into a set of masks that can be displayed on a pair of commodity LCD panels. By constraining the tensor factorization to preserve only those light rays seen by the viewer, we effectively steer narrow high-resolution viewing cones into the user's eyes, allowing binocular disparity, motion parallax, and the potential for nearly correct accommodation over a wide field of view. We verify the design experimentally by focusing a camera at different depths about a prototype display, establish formal upper bounds on the design's accommodation range and diffraction-limited performance, and discuss practical limitations that must be overcome to allow the device to be used with human observers.
Supplemental Material
Available for Download
Supplemental movie and image files for, Focus 3D: Compressive accommodation display
- Akeley, K., Watt, S. J., Girshick, A. R., and Banks, M. S. 2004. A stereo display prototype with multiple focal distances. ACM Trans. Graph. 23, 804--813. Google Scholar
Digital Library
- Brott, R. and Schultz, J. 2010. Directional backlight lightguide considerations for full resolution autostereoscopic 3d displays. SID Symp. Digest Tech Papers 41, 1, 218--221.Google ScholarCross Ref
- Chien, K.-W. and Shieh, H.-P. D. 2006. Time-multiplexed three-dimensional displays based on directional backlights with fast-switching liquid-crystal displays. Appl. Optics 45, 13, 3106--3110.Google ScholarCross Ref
- Chu, Y. M., Chien, K. W., Shieh, H. P. D., Chang, J. M. A., Hu, Y. C. S., and Yang, V. 2005. 3D mobile display based on dual-directional light guides with a fast-switching liquid-crystal panel. J. Soc. Inf. Display 13, 10, 875--879.Google ScholarCross Ref
- Cichocki, A., Zdunek, R., Phan, A. H., and Ichi Amari, S. 2009. Nonnegative Matrix and Tensor Factorizations. Wiley. Google ScholarDigital Library
- Cossairt, O. S., Napoli, J., Hill, S. L., Dorval, R. K., and Favalora, G. E. 2007. Occlusion-capable multiview volumetric three-dimensional display. Appl. Optics 46, 8, 1244--1250.Google ScholarCross Ref
- Favalora, G. E. 2005. Volumetric 3d displays and application infrastructure. IEEE Comput. 38, 37--44. Google ScholarDigital Library
- Gotoda, H. 2010. A multilayer liquid crystal display for autosteroscopic 3D viewing. In Proceedings of the SPIE Conference on Stereoscopic Displays and Applications XXI. Vol. 7524. 1--8.Google ScholarCross Ref
- Gotoda, H. 2011. Reduction of image blurring in an autostereoscopic multilayer liquid crystal display. In Proceedings of the SPIE Conference on Stereoscopic Displays and Applications XXII. Vol. 7863. 1--7.Google ScholarCross Ref
- Hagood, N., Barton, R., Brosnihan, T., Fijol, J., Gandhi, J., Halfman, M., Payne, R., and Steyn, J. L. 2007. 35.5l: Late-news paper: A direct-view mems display for mobile applications. SID Symp. Digest Tech. Papers 38, 1, 1278--1281.Google ScholarCross Ref
- Hecht, E. 2001. Optics, 4th ed. Addison-Wesley.Google Scholar
- Heide, F., Wetzstein, G., Raskar, R., and Heidrich, W. 2013. Adaptive image synthesis for compressive displays. In Proceedings of the ACM SIGGRAPH Conference on Computer Graphics and Interactive Techniques. Google ScholarDigital Library
- Hoffman, D., Girshick, A., Akeley, K., and Banks, M. 2008. Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. J. Vis. 8, 3, 33.Google ScholarCross Ref
- Hoffman, D. M. and Banks, M. S. 2009. Stereo display with time-multiplexed focal adjustment. In Proceedings of the SPIE Conference on Stereoscopic Displays and Applications XX. Vol. 7237. 1--8.Google Scholar
- Hoffman, D. M. and Banks, M. S. 2010. Focus information is used to interpret binocular images. J. Vis. 10, 5, 13.Google ScholarCross Ref
- Huang, F.-C., Lanman, D., Barsky, B. A., and Raskar, R. 2012. Correcting for optical aberrations using multilayer displays. ACM Trans. Graph. 31. Google ScholarDigital Library
- Ives, F. E. 1903. Parallax stereogram and process of making same. U.S. Patent 725, 567.Google Scholar
- Jones, A., McDowall, I., Yamada, H., Bolas, M., and Debevec, P. 2007. Rendering for an interactive 360 degree light field display. ACM Trans. Graph. 26, 40:1--40:10. Google ScholarDigital Library
- Kolda, T. G. and Bader, B. W. 2009. Tensor decompositions and applications. SIAM Rev. 51, 3, 455--500. Google ScholarDigital Library
- Kwon, H. and Choi, H.-J. 2012. A time-sequential multiview autostereoscopic display without resolution loss using a multi-directional backlight unit and an lcd panel. In Proceedings of the SPIE Conference on Stereoscopic Displays and Applications XXIII. Vol. 8288. 1--6.Google Scholar
- Lanman, D., Hirsch, M., Kim, Y., and Raskar, R. 2010. Content-adaptive parallax barriers: Optimizing dual-layer 3d displays using low-rank light field factorization. ACM Trans. Graph. 29, 163:1--163:10. Google ScholarDigital Library
- Lanman, D., Wetzstein, G., Hirsch, M., Heidrich, W., and Raskar, R. 2011. Polarization fields: Dynamic light field display using multi-layer lcds. ACM Trans. Graph. 30, 1--9. Google ScholarDigital Library
- Lippmann, G. 1908. Epreuves reversibles donnant la sensation du relief. J. Phys. 7, 4, 821--825.Google Scholar
- Marwah, K., Wetzstein, G., Bando, Y., and Raskar, R. 2013. Compressive light field photography using overcomplete dictionaries and optimized projections. In Proceedings of the ACM SIGGRAPH Conference on Computer Graphics and Interactive Techniques. Google ScholarDigital Library
- Mather, J., Barratt, N., Kean, D. U., Walton, E. J., and Bourhill, G. 2009. Directional backlight, a multiple view display and a multi-direction display. U.S. Patent Application 11/814, 383.Google Scholar
- Pamplona, V., Oliveira, M., Aliaga, D., and Raskar, R. 2012. Tailored displays to compensate for visual aberrations. ACM Trans. Graph. 31, 1--11. Google ScholarDigital Library
- Perlin, K., Paxia, S., and Kollin, J. S. 2000. An autostereoscopic display. In Proceedings of the ACM SIGGRAPH Conference on Computer Graphics and Interactive Techniques. 319--326. Google ScholarDigital Library
- Peterka, T., Kooima, R. L., Sandin, D. J., Johnson, A., Leigh, J., and Defanti, T. A. 2008. Advances in the dynallax solid-state dynamic parallax barrier autostereoscopic visualization display system. IEEE Trans. Vis. Comput. Graph. 14, 3, 487--499. Google ScholarDigital Library
- Putilin, A. N., Lukianitsa, A. A., and Kanashin, K. 2001. Stereodisplay with neural network image processing. In Proceedings of the SPIE Conference on Advanced Display Technologies. Vol. 4511. 245--250.Google Scholar
- Shibata, T., Kawai, T., Ohta, K., Otsuki, M., Miyake, N., Yoshihara, Y., and Iwasaki, T. 2005. Stereoscopic 3d display with optical correction for the reduction of the discrepancy between accommodation and convergence. J. Soc. Inf. Display 13, 8, 665--671.Google ScholarCross Ref
- Stolle, H., Olaya, J.-C., Buschbeck, S., Sahm, H., and Schwerdtner, A. 2008. Technical solutions for a full-resolution autostereoscopic 2d/3d display technology. In Proceedings of the SPIE Conference. 1--12.Google Scholar
- Sullivan, A. 2003. A solid-state multi-planar volumetric display. SID Symp. Digest Tech Papers 32, 207--211.Google ScholarCross Ref
- Takaki, Y. 2006. High-density directional display for generating natural three-dimensional images. Proc. IEEE 94, 3.Google ScholarCross Ref
- Takaki, Y., Tanaka, K., and Nakamura, J. 2011. Super multi-view display with a lower resolution flat-panel display. Optics Express 19, 5, 4129--4139.Google ScholarCross Ref
- Toyooka, K., Miyashita, T., and Uchida, T. 2001. The 3d display using field-sequential lcd with light direction controlling back-light. SID Symp. Digest Tech Papers 32, 1, 174--177.Google ScholarCross Ref
- Travis, A., Large, T., Emerton, N., and Bathiche, S. 2013. Wedge optics in flat panel displays. Proc. IEEE 101, 1, 45--60.Google ScholarCross Ref
- Travis, A. R. L. 1990. Autostereoscopic 3-d display. Appl. Optics 29, 4341--4342.Google ScholarCross Ref
- Wetzstein, G., Lanman, D., Heidrich, W., and Raskar, R. 2011. Layered 3d: Tomographic image synthesis for attenuation-based light field and high dynamic range displays. ACM Trans. Graph. 30, 1--11. Google ScholarDigital Library
- Wetzstein, G., Lanman, D., Hirsch, M., and Raskar, R. 2012. Tensor displays: Compressive light field synthesis using multilayer displays with directional backlighting. ACM Trans. Graph. 31, 1--11. Google ScholarDigital Library
- Zhang, W., Ye, Z., Zhao, T., Chen, Y., and Yu, F. 2007. Point spread function characteristics analysis of the wavefront coding system. Optics Express 15, 4, 1543--1552.Google ScholarCross Ref
- Zwicker, M., Matusik, W., Durand, F., and Pfister, H. 2006. Antialiasing for automultiscopic 3d displays. In Proceedings of the Eurographics Symposium on Rendering Techniques. Google ScholarDigital Library
Index Terms
- Focus 3D: Compressive accommodation display
Recommendations
Tensor displays: compressive light field synthesis using multilayer displays with directional backlighting
We introduce tensor displays: a family of compressive light field displays comprising all architectures employing a stack of time-multiplexed, light-attenuating layers illuminated by uniform or directional backlighting (i.e., any low-resolution light ...
Optimal presentation of imagery with focus cues on multi-plane displays
We present a technique for displaying three-dimensional imagery of general scenes with nearly correct focus cues on multi-plane displays. These displays present an additive combination of images at a discrete set of optical distances, allowing the ...
Joint view expansion and filtering for automultiscopic 3D displays
Multi-view autostereoscopic displays provide an immersive, glasses-free 3D viewing experience, but they require correctly filtered content from multiple viewpoints. This, however, cannot be easily obtained with current stereoscopic production pipelines. ...
Comments