Bryan S. Morse
Michael A. Goodrich
ABSTRACT
Video-equipped mini unmanned aerial vehicles (mini-UAVs) are becoming increasingly popular for surveillance, remote sensing, law enforcement, and search and rescue operations, all of which rely on thorough coverage of a target observation area. However, coverage is not simply a matter of seeing the area (visibility) but of seeing it well enough to allow detection of targets of interest, a quality we here call "see-ability". Video flashlights, mosaics, or other geospatial compositions of the video may help place the video in context and convey that an area was observed, but not necessarily how well or how often. This paper presents a method for using UAV-acquired video georegistered to terrain and aerial reference imagery to create geospatial video coverage quality maps and indices that indicate relative video quality based on detection factors such as image resolution, number of observations, and variety of viewing angles. When used for offline post-analysis of the video, or for online review, these maps also enable geospatial quality-filtered or prioritized non-sequential access to the video. We present examples of static and dynamic see-ability coverage maps in wilderness search-and-rescue scenarios, along with examples of prioritized non-sequential video access. We also present the results of a user study demonstrating the correlation between see-ability computation and human detection performance.
Supplemental Material
- M. A. Goodrich, B. S. Morse, D. Gerhardt, J. L. Cooper, J. Adams, C. Humphrey, and M. Quigley, "Supporting wilderness search and rescue using a camera-equipped mini UAV," J. Field Robotics, vol. 25, no. 1-2, pp. 89--110, January 2008. Google Scholar
Digital Library
- M. A. Goodrich, B. S. Morse, C. Engh, J. L. Cooper, and J. A. Adams, "Towards using UAVs in wilderness search and rescue: Lessons from field trials," Interaction Studies, vol. 10, no. 3, pp. 453--478, 2009.Google ScholarCross Ref
- J. Casper and R. R. Murphy, "Human-robot interactions during the robot-assisted urban search and rescue response at the world trade center," IEEE Trans. Syst., Man, Cybern. B, vol. 33, pp. 367--385, 2003. Google ScholarDigital Library
- J. Reason, Human Error. Cambridge University Press, 1990.Google Scholar
- D. D. Woods and J. C. Watts, "How not to have to navigate through too many displays," in Handbook of Human-Computer Interaction, 2nd ed., M. G. Helander, T. K. Landauer, and P. Prabhu, Eds. Elsevier, 1997.Google Scholar
- D. D. Woods, J. Tittle, M. Feil, and A. Roesler, "Envisioning human-robot coordination in future operations," IEEE Trans. Syst., Man, Cybern. C, vol. 34, pp. 210--218, 2004. Google ScholarDigital Library
- J. Cooper and M. A. Goodrich, "Towards combining UAV and sensor operator roles in UAV-enabled visual search," in ACM/IEEE Int. Conf. on HRI, 2008, pp. 351--358. Google ScholarDigital Library
- J. Rasmussen and K. J. Vicente, "Coping with human errors through system design: Implications for ecological interface design," Int. J. Man-Machine Studies, pp. 517--534, 1989. Google ScholarDigital Library
- S. Thrun, "Robotic mapping: A survey," in Exploring Artificial Intelligence in the New Millennium. Morgan Kaufmann, 2003, pp. 1--33. Google ScholarDigital Library
- J. Blitch, R. Murphy, and T. Durkin, "Mobile semiautonomous robots for urban search and rescue," in Encyclopedia of Microcomputers, A. Kent and J. G. Williams, Eds. CRC Press, 2002, vol. 28, ch. 19, pp. 211--222.Google Scholar
- R. Cutler, C. Shekhar, B. Burns, R. Chellappa, and R. Bolles, "Monitoring human and vehicle activities using airborne video," in 28th Applied Imagery Patt. Rec. Workshop, 1999.Google Scholar
- K. J. Hanna, H. S. Sawhney, R. Kumar, Y. Guo, and S. Samarasekara, "Annotation of video by alignment to reference imagery," in IEEE Int. Conf. on Multimedia Comp. & Sys., 1999, pp. 38--43. Google ScholarDigital Library
- R. Kumar, H. Sawhney, S. Samarasekera, S. Hsu, H. Tao, Y. Guo, K. Hanna, A. Pose, R. Wildes, D. Hirvonen, M. Hansen, and P. Burt, "Aerial video surveillance and exploitation," Proceedings of the IEEE, vol. 89, no. 10, pp. 1518--1539, October 2001.Google ScholarCross Ref
- R. Kumar, H. S. Sawhney, J. C. Asmuth, A. Pope, and S. Hsu, "Registration of video to geo-referenced imagery," IEEE CVPR, pp. 54--62, 1998.Google Scholar
- Y. Lin and G. Medioni, "Map-enhanced UAV image sequence registration and synchronization of multiple image sequences," in IEEE CVPR, 2007, pp. 1--7.Google Scholar
- H. Schultz, A. Hanson, E. Riseman, F. Stolle, Z. Zhu, C. Hayward, and D. Slaymaker, "A system for real-time generation of geo-referenced terrain models," in SPIE Symposium on Enabling Technolgies for Law Enforcement, November 2000.Google Scholar
- C. Shekhar and R. Chellappa, "Airborne video registration for activity monitoring," in Video Registration, M. Shah and R. Kumar, Eds. Springer, 2003, ch. 6.Google Scholar
- R. P. Wildes, D. J. Hirvonen, S. C. Hsu, R. Kumar, W. B. Lehman, B. Matei, and W. Y. Zhao, "Video georegistration: algorithm and quantitative evaluation," in IEEE ICCV, vol. 2, 2001, pp. 343--350.Google Scholar
- H. S. Sawhney, A. Arpa, R. Kumar, S. Samarasekera, M. Aggarwal, S. Hsu, D. Nister, and K. Hanna, "Video flashlights: real time rendering of multiple videos for immersive model visualization," in Eurographics Workshop on Rendering, 2002, pp. 157--168. Google ScholarDigital Library
- M. Irani and P. Anandan, "Video indexing based on mosaic representations," Proceedings of the IEEE, vol. 86, no. 5, pp. 905--921, 1998.Google ScholarCross Ref
- United States Geological Survey, "The national map seamless server," http://seamless.usgs.gov/.Google Scholar
- D. Luebke, M. Reddy, J. Cohen, A. Varshney, B. Watson, and R. Huebner, Level of Detail for 3D Graphics. Morgan Kaufmann, 2002. Google ScholarDigital Library
- R. Pajarola and E. Gobbetti, "Survey of semi-regular multiresolution models for interactive terrain rendering," The Visual Computer, vol. 23, no. 8, pp. 583--605, August 2007. Google ScholarDigital Library
- M. Segal, C. Korobkin, R. van Widenfelt, J. Foran, and P. Haeberli, "Fast shadows and lighting effects using texture mapping," in ACM SIGGRAPH, 1992, pp. 249--252. Google ScholarDigital Library
- L. Williams, "Casting curved shadows on curved surfaces," in ACM SIGGRAPH, 1978, pp. 270--274. Google ScholarDigital Library
- Air Force Research Laboratory, "Geo*View."Google Scholar
- Science Applications International Corporation, "GeoViz."Google Scholar
- H. Piéron, The Sensations: Their Functions, Processes, and Mechanisms. Yale University Press, 1952.Google Scholar
- J. Cohen, Statistical Power Analysis for the Behavioral Sciences (2nd Edition). Lawrence Erlbaum Associates, 1988Google Scholar
Index Terms
- UAV video coverage quality maps and prioritized indexing for wilderness search and rescue
Recommendations
An Autonomous Multi-UAV System for Search and Rescue
DroNet '15: Proceedings of the First Workshop on Micro Aerial Vehicle Networks, Systems, and Applications for Civilian UseThis paper proposes and evaluates a modular architecture of an autonomous unmanned aerial vehicle (UAV) system for search and rescue missions. Multiple multicopters are coordinated using a distributed control system. The system is implemented in the ...
Color anomaly detection and suggestion for wilderness search and rescue
HRI '12: Proceedings of the seventh annual ACM/IEEE international conference on Human-Robot InteractionIn wilderness search and rescue, objects not native or typical to a scene may provide clues that indicate the recent presence of the missing person. This paper presents the results of augmenting an aerial wilderness search-and-rescue system with an ...
UAV networks in rescue missions
WiNTECH '13: Proceedings of the 8th ACM international workshop on Wireless network testbeds, experimental evaluation & characterizationSmall-scale unmanned aerial vehicles (UAVs) have received high attention by the robotics community for delivering sensory data of limited size. Yet, the communication capabilities of off-the-shelf UAVs are insufficient for high volume data, such as ...
Comments