Object tracking in the presence of occlusions via a camera network

ABSTRACT

This paper describes a sensor network approach to tracking a single object in the presence of static and moving occluders using a network of cameras. To conserve communication bandwidth and energy, each camera first performs simple local processing to reduce each frame to a scan line. This information is then sent to a cluster head to track a point object. We assume the locations of the static occluders to be known, but only prior statistics on the positions of the moving occluders are available. A noisy perspective camera measurement model is presented, where occlusions are captured through an occlusion indicator function. An auxiliary particle filter that incorporates the occluder information is used to track the object. Using simulations, we investigate (i) the dependency of the tracker performance on the accuracy of the moving occluder priors, (ii) the tradeoff between the number of cameras and the occluder prior accuracy required to achieve a prescribed tracker performance, and (iii) the importance of having occluder priors to the tracker performance as the number of occluders increases. We generally find that computing moving occluder priors may not be worthwhile, unless it can be obtained cheaply and to a reasonable accuracy. Preliminary experimental results are provided.

References

1. R. Holman and T. Ozkan-Haller, "Applying video sensor networks to nearshore environment monitoring," IEEE Pervasive Computing, vol. 2, no. 4, pp. 14--21, 2003.
2. A. O. Ercan, D. B.-R. Yang, A. El Gamal, and L. J. Guibas, "Optimal placement and selection of camera network nodes for target localization," in Proceedings of DCOSS, June 2006.
3. A. O. Ercan, A. El Gamal, and L. J. Guibas, "Camera network node selection for target localization in the presence of occlusions," in Distributed Smart Cameras, October 2006.
4. B. Ristic, S. Arulampalam, and N. Gordon, Beyond the Kalman Filter, Particle Filters for Tracking Applications. Artech House, 2004.
5. R. R. Brooks, P. Ramanathan, and A. M. Sayeed, "Distributed target classification and tracking in sensor networks," Proceedings of IEEE, vol. 91, no. 8, pp. 1163--1171, August 2003.
6. F. Zhao, J. Liu, J. Liu, L. J. Guibas, and J. Reich, "Collaborative signal and information processing: an information-directed approach," Proceedings of IEEE, vol. 91, no. 8, pp. 1199--1209, August 2003.
7. J. Aslam, Z. Butler, F. Constantin, V. Crespi, G. Cybenko, and D. Rus, "Tracking a moving object with a binary sensor network," in Proceedings of SENSYS, November 2003.
8. C. Taylor, A. Rahimi, J. Bachrach, H. Shrobe, and A. Grue, "Simultaneous localization, calibration and tracking in an ad-hoc sensor network," in Proceedings of IPSN, April 2006.
9. N. Shrivastava, R. Mudumbai, and U. Madhow, "Target tracking with binary proximity sensors: Fundamental limits, minimal descriptions, and algorithms," in Proceedings of SENSYS, November 2006.
10. P. V. Pahalawatta, D. Depalov, T. N. Pappas, and A. K. Katsaggelos, "Detection, classification, and collaborative tracking of multiple targets using video sensors," in Proceedings of IPSN, April 2003, pp. 529--544.
11. S. Funiak, C. Guestrin, M. Paskin, and R. Sukthankar, "Distributed localization of networked cameras," in Proceedings of IPSN, April 2006.
12. P. F. Gabriel, J. G. Verly, J. H. Piater, and A. Genon, "The state of the art in multiple object tracking under occlusion in video sequences," in Proceedings of ACIVS, September 2003.
13. A. Yilmaz, X. Li, and M. Shah, "Contour-based object tracking with occlusion handling in video acquired using mobile cameras," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 11, pp. 1531--1536, November 2004.
14. Q. Cai and J. K. Aggarwal, "Tracking human motion in structured environments using a distributed-camera system," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 21, no. 12, pp. 1241--1247, 1999.
15. S. Khan, O. Javed, Z. Rasheed, and M. Shah, "Human tracking in multiple cameras," in Proceedings of ICCV, July 2001.
16. W. Zajdel, A. T. Cemgil, and B. J. A. Krose, "Online multicamera tracking with a switching state-space model," in Proceedings of ICPR, August 2004.
17. A. Utsumi, H. Mori, J. Ohya, and M. Yachida, "Multiple-view-based tracking of multiple humans," in Proceedings of the ICPR, 1998.
18. K. Otsuka and N. Mukawa, "Multiview occlusion analysis for tracking densely populated objects based on 2-d visual angles," in Proceedings of CVPR, 2004.
19. S. L. Dockstander and A. M. Tekalp, "Multiple camera tracking of interacting and occluded human motion," Proceedings of the IEEE, vol. 89, no. 10, pp. 1441--1455, October 2001.
20. A. Doucet, B.-N. Vo, C. Andrieu, and M. Davy, "Particle flltering for multi-target tracking and sensor management," in Proceedings of ISIF, 2002, pp. 474--481.
21. C. Tomasi and T. Kanade, "Detection and tracking of point features," Carnegie Mellon University, Technical Report CMU-CS-91-132, April 1991.
22. Y. Bar-Shalom, X. R. Li, and T. Kirubarajan, Estimation with Applications to Tracking and Navigation. New York, NY: John Wiley & Sons Inc., 2001.
23. X. Sheng and Y.-H. Hu, "Maximum likelihood multiple-source localization using acoustic energy measurements with wireless sensor networks," IEEE Transactions on Signal Processing, vol. 53, no. 1, pp. 44--53, 2005.
24. D. B.-R. Yang, H. Gonzales-Banos, and L. J. Guibas, "Counting people in crowds with a real-time network of image sensors," in Proceedings of ICCV, October 2003.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Computer vision tasks

• Mathematics of computing

  • Probability and statistics

    • Probabilistic algorithms

    • Probabilistic reasoning algorithms

      • Markov-chain Monte Carlo methods

      • Sequential Monte Carlo methods