Weichao Qiu
ABSTRACT
UnrealCV is a project to help computer vision researchers build virtual worlds using Unreal Engine 4 (UE4). It extends UE4 with a plugin by providing (1) A set of UnrealCV commands to interact with the virtual world. (2) Communication between UE4 and an external program, such as Caffe. UnrealCV can be used in two ways. The first one is using a compiled game binary with UnrealCV embedded. This is as simple as running a game, no knowledge of Unreal Engine is required. The second is installing UnrealCV plugin to Unreal Engine 4 (UE4) and use the editor of UE4 to build a new virtual world. UnrealCV is an open-source software under the MIT license. Since the initial release in September 2016, it has gathered an active community of users, including students and researchers.
- Greg Brockman, Vicki Cheung, Ludwig Pettersson, Jonas Schneider, John Schulman, Jie Tang, and Wojciech Zaremba. 2016. OpenAI Gym. (2016). arXiv:arXiv:1606.01540Google Scholar
- Daniel J Butler, Jonas Wulff, Garrett B Stanley, and Michael J Black. 2012. A naturalistic open source movie for optical flow evaluation. In European Conference on Computer Vision. Springer, 611--625. Google ScholarDigital Library
- Matthew Johnson, Katja Hofmann, Tim Hutton, and David Bignell. 2016. The malmo platform for artificial intelligence experimentation. IJCAI International Joint Conference on Artificial Intelligence 2016-January (2016), 4246--4247. Google ScholarDigital Library
- Michał Kempka, Marek Wydmuch, Grzegorz Runc, Jakub Toczek, and Wojciech Jaśkowski. 2016. Vizdoom: A doom-based ai research platform for visual reinforcement learning. In Computational Intelligence and Games (CIG), 2016 IEEE Conference on. IEEE, 1--8.Google ScholarDigital Library
- Adam Lerer, Sam Gross, and Rob Fergus. 2016. Learning Physical Intuition of Block Towers by Example. (2016). arXiv:1603.01312 http://arxiv.org/abs/1603. 01312Google Scholar
- Siyuan Qiao, Wei Shen, Weichao Qiu, Chenxi Liu, and Alan Yuille. 2017. ScaleNet: Guiding Object Proposal Generation in Supermarkets and Beyond. arXiv preprint arXiv:1704.06752 (2017).Google Scholar
- Weichao Qiu and Alan Yuille. 2016. UnrealCV: Connecting Computer Vision to Unreal Engine. In Computer Vision--ECCV 2016 Workshops. Springer International Publishing, 909--916.Google ScholarCross Ref
- German Ros, Laura Sellart, Joanna Materzynska, David Vazquez, and Antonio M Lopez. 2016. The synthia dataset: A large collection of synthetic images for semantic segmentation of urban scenes. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3234--3243.Google ScholarCross Ref
- Shital Shah, Debadeepta Dey, Chris Lovett, and Ashish Kapoor. 2017. AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehicles. (2017). arXiv:arXiv:1705.05065Google Scholar
- Yi Zhang, Weichao Qiu, Qi Chen, Xiaolin Hu, and Alan Yuille. 2016. UnrealStereo: A Synthetic Dataset for Analyzing Stereo Vision. arXiv preprint arXiv:1612.04647 (2016).Google Scholar
- Yuke Zhu, Roozbeh Mottaghi, Eric Kolve, Joseph J. Lim, Abhinav Gupta, Li Fei-Fei, and Ali Farhadi. 2017. Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learning. In International Conference on Robotics and Automation (ICRA) .Google ScholarCross Ref
Index Terms
- UnrealCV: Virtual Worlds for Computer Vision
Recommendations
What’s Inside Unreal Engine? - A Curious Gaze!
ISEC '21: Proceedings of the 14th Innovations in Software Engineering Conference (formerly known as India Software Engineering Conference)Game developers often use game engines to efficiently develop games and reduce effort by reusing predefined components. However, game engines are complex and difficult to comprehend to extend and integrate with other components. Unreal Engine is one of ...
First-Person Shooter Game for Virtual Reality Headset with Advanced Multi-Agent Intelligent System
MM '16: Proceedings of the 24th ACM international conference on MultimediaWe present a multiplayer first-person shooter (FPS) game with advanced intelligent non-playable characters (NPC) under computer control. The game is specially adapted for playing in VR headset so the simulator sickness symptoms are significantly ...
Robo recall
SA '16: SIGGRAPH ASIA 2016 VR ShowcaseRobo Recall is an action-packed virtual reality first-person shooter with gratifying gameplay and an in-depth scoring system. Explore immersive environments as you take on a variety of rogue robots, unlock an expanding arsenal of weapons and access all-...
Comments