Ballumiere: Real-Time Tracking and Spherical Projection for High-Speed Moving Balls

ABSTRACT

Projections on moving objects have a problem in that the projection may slip because of the delay between tracking and projection. Here, we propose a new prediction method combining a Kalman filter and a three-frame feedback model that switches between these models according to the ball's state of motion. We developed a real-time tracking and projection system named "Ballumiere", which uses motion capture cameras for tracking and multiple projectors for spherical projection. We conducted a comparative experiment with an existing prediction model and showed that our method minimizes slipping and increases the accuracy of the projection.

References

1. Jones, B., Sodhi, R., Murdock, M., Mehra, R., Benko, H., Wilson, A., Ofek, E., MacIntyre, B., Raghuvanshi, N., and Shapira, L. RoomAlive: Magical experiences enabled by scalable, adaptive projector-camera units. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology, UIST '14, ACM (New York, NY, USA, 2014), 637--644.
2. Jones, B. R., Benko, H., Ofek, E., and Wilson, A. D. IllumiRoom: Peripheral projected illusions for interactive experiences. In ACM SIGGRAPH 2013 Emerging Technologies, SIGGRAPH '13, ACM (New York, NY, USA, 2013), 7:1--7:1.
3. Kettner, S., Madden, C., and Ziegler, R. Direct rotational interaction with a spherical projection. Creativity & Cognition Symposium on Interaction: Systems, Plactice and Theory. (2004).
4. Knibbe, J., Benko, H., and Wilson, A. D. Juggling the effects of latency: Software approaches to minimizing latency in dynamic projector-camera systems. In Adjunct Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, UIST '15 Adjunct, ACM (New York, NY, USA, 2015), 93--94.
5. Koike, H., and Yamaguchi, H. Lumospheres: Real-time tracking of flying objects and image projection for a volumetric display. In Proceedings of the 6th Augmented Human International Conference, AH '15, ACM (New York, NY, USA, 2015), 93--96.
6. Lincoln, P., Blate, A., Singh, M., Whitted, T., State, A., Lastra, A., and Fuchs, H. From motion to photons in 80 microseconds: Towards minimal latency for virtual and augmented reality. IEEE Trans Vis Comput Graph 22, 4 (Apr 2016), 1367--1376.
7. Miyafuji, S., and Koike, H. Ballumiere: Real-time tracking and projection system for high-speed flying balls. In SIGGRAPH Asia 2015 Emerging Technologies, SA '15, ACM (New York, NY, USA, 2015), 2:1--2:1.
8. Okumura, K., Oku, H., and Ishikawa, M. Lumipen: Projection-based mixed reality for dynamic objects. In Proceedings of the 2012 IEEE International Conference on Multimedia and Expo, ICME '12, IEEE Computer Society (Washington, DC, USA, 2012), 699--704.
9. Raskar, R., Welch, G., Low, K.-L., and Bandyopadhyay, D. Shader Lamps: Animating real objects with image-based illumination. In Proceedings of the 12th Eurographics Workshop on Rendering Techniques, Springer-Verlag (London, UK, UK, 2001), 89--102.
10. Zheng, F., Whitted, T., Lastra, A., Lincoln, P., State, A., Maimone, A., and Fuchs, H. Minimizing latency for augmented reality displays: Frames considered harmful. In Mixed and Augmented Reality (ISMAR), 2014 IEEE International Symposium on (Sept 2014), 195--200.

Index Terms

• Information systems

  • Information systems applications

    • Multimedia information systems