Shubham Jain
Paramvir Bahl
ABSTRACT
Steerable surveillance cameras offer a unique opportunity to support multiple vision applications simultaneously. However, state-of-art camera systems do not support this as they are often limited to one application per camera. We believe that we should break the one-to-one binding between the steerable camera and the application. By doing this we can quickly move the camera to a new view needed to support a different vision application. When done well, the scheduling algorithm can support a larger number of applications over an existing network of surveillance cameras. With this in mind we developed Panoptes, a technique that virtualizes a camera view and presents a different fixed view to different applications. A scheduler uses camera controls to move the camera appropriately providing the expected view for each application in a timely manner, minimizing the impact on application performance. Experiments with a live camera setup demonstrate that Panoptes can support multiple applications, capturing up to 80% more events of interest in a wide scene, compared to a fixed view camera.
- Telegraph 2013. One surveillance camera for every 11 people in Britain. https://goo.gl/gXFmwN. (2013).Google Scholar
- BBC 2006. Britain is Surveillance Society. http://news.bbc.co.uk/2/hi/uk/6108496.stm. (2006).Google Scholar
- Nest Cam 2013. Nest Cam. https://goo.gl/I85twa. (2013).Google Scholar
- Cash J. Costello, Christopher P. Diehl, Amit Banerjee, and Hesky Fisher. 2004. Scheduling an Active Camera to Observe People. In Proceedings of the ACM 2Nd International Workshop on Video Surveillance & Sensor Networks (VSSN '04). ACM, New York, NY, USA, 39--45. Google ScholarDigital Library
- J. C. Neves and H. Proena. 2015. Dynamic camera scheduling for visual surveillance in crowded scenes using Markov random fields. In Advanced Video and Signal Based Surveillance (AVSS), 2015 12th IEEE International Conference on.Google Scholar
- Adrian Ilie and Greg Welch. 2014. Online Control of Active Camera Networks for Computer Vision Tasks. ACM Trans. Sen. Netw., Article 25 (2014), 40 pages. Google ScholarDigital Library
- Navin K. Sharma, David E. Irwin, Prashant J. Shenoy, and Michael Zink. 2011. MultiSense: Fine-grained Multiplexing for Steerable Camera Sensor Networks. In Proceedings of the Second Annual ACM Conference on Multimedia Systems (MMSys '11). ACM, New York, NY, USA, 23--34. Google ScholarDigital Library
- A. J. Lipton, H. Fujiyoshi, and R. S. Patil. 1998. Moving target classification and tracking from real-time video. In IEEE WACV. Google ScholarDigital Library
- C. Stauffer and W. E. L. Grimson. 1999. Adaptive background mixture models for real-time tracking. In IEEE CVPR.Google Scholar
- Vijay Mahadevan, Weixin Li, Viral Bhalodia, and Nuno Vasconcelos. 2010. Anomaly detection in crowded scenes. IEEE CVPR (2010).Google Scholar
- Paul Viola, Michael J. Jones, and Daniel Snow. 2005. Detecting Pedestrians Using Patterns of Motion and Appearance. Int. Journal of Computer Vision 2 (2005). Google ScholarDigital Library
- Timo Ahonen, Abdenour Hadid, and Matti Pietikäinen. 2004. Face recognition with local binary patterns. In ECCV 2004. Springer.Google ScholarCross Ref
- Nam T.Nguyen, Svetha Venkatesh, Geoff West, and Hung H. Bui. 2003. Multiple camera coordination in a surveillance system. ACTA Automatica Sinica (2003).Google Scholar
- A. W. Senior, A. Hampapur, and M. Lu. 2005. Acquiring Multi-Scale Images by Pan-Tilt-Zoom Control and Automatic Multi-Camera Calibration. In IEEE WACV/MOTIONS. Google ScholarDigital Library
- C.J. Costello and I-Jeng Wang. 2005. Surveillance Camera Coordination Through Distributed Scheduling. In CDC-ECC '05.Google Scholar
- K. Nummiaro, E. Koller-Meier, T. Svoboda, D. Roth, and L. Van Gool. 2003. Color-Based Object Tracking in Multi-Camera Environments. Lecture Notes in Comp. Sci. (2003).Google Scholar
- F. Z. Qureshi and D. Terzopoulos. 2009. Planning ahead for PTZ camera assignment and handoff. In Distributed Smart Cameras, 2009. ICDSC 2009. Third ACM/IEEE International Conference on. 1--8.Google Scholar
- Yi Yao, Chung-Hao Chen, Andreas Koschan, and Mongi Abidi. 2010. Adaptive online camera coordination for multi-camera multi-target surveillance. Computer Vision and Image Understanding (2010). Google ScholarDigital Library
- Chung-Hao Chen, Yi Yao, David Page, Besma Abidi, Andreas Koschan, and Mongi Abidi. 2010. Camera handoff and placement for automated tracking systems with multiple omnidirectional cameras. Computer Vision and Image Understanding (2010). Google ScholarDigital Library
- Canon 2015. Canon goes resolution-crazy with a 250-megapixel sensor. https://goo.gl/hIKx7N. (2015).Google Scholar
- Onvif 2016. ONVIF. http://www.onvif.org/. (2016).Google Scholar
- Pelco 2016. Pelco SDK. https://goo.gl/pI1CIZ. (2016).Google Scholar
- Onvif 2016. ONVIF Video Specification. https://goo.gl/W6B3nK. (2016).Google Scholar
- E. Bas, A. M. Tekalp, and F. S. Salman. 2007. Automatic Vehicle Counting from Video for Traffic Flow Analysis. In Intelligent Vehicles Symp.Google Scholar
- D. Beymer, P. McLauchlan, B. Coifman, and J. Malik. 1997. A real-time computer vision system for measuring traffic parameters. In CVPR. Google ScholarDigital Library
- A. B. Chan, Zhang-Sheng John Liang, and N. Vasconcelos. 2008. Privacy preserving crowd monitoring: Counting people without people models or tracking. In CVPR.Google Scholar
- Shyang-Lih Chang, Li-Shien Chen, Yun-Chung Chung, and Sei-Wan Chen. 2004. Automatic license plate recognition. IEEE Trans. Intell. Transp.Syst. 1 (2004), 42--53.Google ScholarDigital Library
- C. N. E. Anagnostopoulos, I. E. Anagnostopoulos, I. D. Psoroulas, V. Loumos, and E. Kayafas. 2008. License Plate Recognition From Still Images and Video Sequences: A Survey. IEEE Trans. Intell. Transp. Syst. 3 (2008). Google ScholarDigital Library
- Ashkan Nikravesh, Hongyi Yao, Shichang Xu, David Choffnes, and Z. Morley Mao. 2015. Mobilyzer: An Open Platform for Controllable Mobile Network Measurements (MobiSys). ACM, New York, NY, USA, 16. Google ScholarDigital Library
- Erik V Cuevas, Daniel Zaldivar, and Raul Rojas. 2005. Kalman filter for vision tracking. (2005).Google Scholar
- R. I. Hartley and A. Zisserman. 2004. Multiple View Geometry in Computer Vision (second ed.). Cambridge University Press. Google ScholarDigital Library
- Herbert Bay, Tinne Tuytelaars, and Luc Gool. 2006. ECCV 2006. Chapter SURF: Speeded Up Robust Features. Google ScholarDigital Library
- Pelco 2016. Pelco Spectra. https://goo.gl/M991vQ. (2016).Google Scholar
- OpenCV. 2017. OpenCV Motion Analysis. (2017).Google Scholar
- libvlc 2016. libVLC. https://wiki.videolan.org/LibVLC/. (2016).Google Scholar
- G-NetTrack 2010. G-NetTrack Pro. https://goo.gl/MHEQJ7. (2010).Google Scholar
Index Terms
- Panoptes: servicing multiple applications simultaneously using steerable cameras
Recommendations
Keeping a Pan-Tilt-Zoom Camera Calibrated
Pan-tilt-zoom (PTZ) cameras are pervasive in modern surveillance systems. However, we demonstrate that the (pan, tilt) coordinates reported by PTZ cameras become inaccurate after many hours of operation, endangering tracking and 3D localization ...
Simple, Accurate, and Robust Projector-Camera Calibration
3DIMPVT '12: Proceedings of the 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & TransmissionStructured-light systems are simple and effective tools to acquire 3D models. Built with off-the-shelf components, a data projector and a camera, they are easy to deploy and compare in precision with expensive laser scanners. But such a high precision ...
Baseline and Triangulation Geometry in a Standard Plenoptic Camera
In this paper, we demonstrate light field triangulation to determine depth distances and baselines in a plenoptic camera. Advances in micro lenses and image sensors have enabled plenoptic cameras to capture a scene from different viewpoints with ...
Comments