Ballumiere: real-time tracking and projection system for high-speed flying balls

ABSTRACT

We present Ballumiere, a novel projection system for the balls moving in the air. Recently projection mapping has attracted much attention. "Shader Lamps" [Raskar et al. 2001] enable to render computer graphics to real objects in three dimensional space using projectors. However, almost all the projection mapping techniques only allow projecting to static objects or projection targets that move slowly. When we try to track and project to moving objects, the conventional method of projection mapping is unsatisfactory due to the delay between tracking and projection. "Lumipen" [Okumura et al. 2013] tracks and projects to a small object in real-time using a high-speed vision sensor and a projector combination using a high-speed optical gaze controller. This system successfully projects to an object moving quickly, but only allows for one object to be a projection target due to restrictions of the optical axis of the vision sensors and the projector being the same. To solve these problems, we present Ballumiere as a new real-time tracking and projection system that can project to the multiple fast moving airborne balls using a motion capture camera and a standard off the shelf projector. We overcome the delay problem using prediction algorithms using Kalman filters and kinetic models. In this demo, we project images and movies onto juggling balls and soccer balls.

References

1. Okumura, K., Oku, H., and Ishikawa, M. 2013. Acitve projection ar using high-speed optical axis control and appearance estimation algorithm. IEEE International Conference on Multimedia and Expo.
2. Raskar, R., Welch, G., Low, K.-L., and Bandyopadhyay, D. 2001. Shader lamps: animating real objects with image-based illumination. Eurographics Workshop on Rendering, London.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Computer vision problems

        • Tracking

      • Computer vision tasks

        • Scene understanding

      • Image and video acquisition

        • 3D imaging

  • Computer graphics

    • Animation