Exploring the use of ray tracing for future games

ABSTRACT

Rasterization hardware and computer games have always been tightly connected: The hardware implementation of rasterization has made complex interactive 3D games possible while requirements for future games drive the development of increasingly parallel GPUs and CPUs. Interestingly, this development - together with important algorithmic improvements - also enabled ray tracing to achieve realtime performance recently.In this paper we explore the opportunities offered by ray tracing based game technology in the context of current and expected future performance levels. In particular, we are interested in simulation-based graphics that avoids pre-computations and thus enables the interactive production of advanced visual effects and increased realism necessary for future games. In this context we analyze the advantages of ray tracing and demonstrate first results from several ray tracing based game projects. We also discuss ray tracing API issues and present recent developments that support interactions and dynamic scene content. We end with an outlook on the different options for hardware acceleration of ray tracing.

References

1. Airey, J. M., Rohlf, J. H., and Brooks, Jr., F. P. 1990. Towards image realism with interactive update rates in complex virtual building environments. Computer Graphics (1990 Symposium on Interactive 3D Graphics) 24, 2, 41--50.]]
2. ARTVPS, 2003. Pure PCi-X 3D Rendering Card. http://www.artvps.com/page/15/pure.htm.]]
3. Benthin, C., Wald, I., and Slusallek, P. 2003. A scalable approach to interactive global illumination. Computer Graphics Forum 22, 3 (June), 621--630. (Proceedings of Eurographics).]]
4. Benthin, C., Wald, I., and Slusallek, P. 2006. Techniques for interactive ray tracing of Bézier surfaces. Journal of Graphics Tools 11, 2. (to appear).]]
5. Benthin, C. 2006. Realtime Ray Tracing on Current CPU Architectures. PhD thesis, Saarland University.]]
6. Bethesda Softworks LLC, 2005. The Elder Scrolls IV: Oblivion, http://www.elderscrolls.com/.]]
7. Cohen, M. F., and Wallace, J. R. 1993. Radiosity and Realistic Image Synthesis.]]
8. Dachsbacher, C., and Stamminger, M. 2006. Splatting indirect illumination. In Proceedings of the 2006 ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, 93--100.]]
9. Dietrich, A., Wald, I., Benthin, C., and Slusallek, P. 2003. The OpenRT application programming interface - towards a common API for interactive ray tracing. In Proceedings of the 2003 OpenSG Symposium, 23--31.]]
10. Dietrich, A., Colditz, C., Deussen, O., and Slusallek, P. 2005. Realistic and interactive visualization of high-density plant ecosystems. In Natural Phenomena 2005, Proceedings of the Eurographics Workshop on Natural Phenomena, 73--81.]]
11. Ernst, M., Akenine-Möller, T., and Jensen, H. W. 2005. Interactive rendering of caustics using interpolated warped volumes. In Proceedings of the 2005 Conference on Graphics Interface, 87--96.]]
12. Foley, T., and Sugerman, J. 2005. KD-tree acceleration structures for a GPU raytracer. In HWWS '05 Proceedings, 15--22.]]
13. Fuchs, H., Kedem, Z. M., and Naylor, B. F. 1980. On visible surface generation by a priori tree structures. Computer Graphics (Proceedings of SIGGRAPH '80) 14, 3, 124--133.]]
14. Geimer, M., and Abert, O. 2005. Interactive ray tracing of trimmed bicubic Bézier surfaces without triangulation. WSCG'2005 Full Papers Conference Proceedings, 71--78.]]
15. Günther, J., Wald, I., and Slusallek, P. 2004. Realtime caustics using distributed photon mapping. In Rendering Techniques, 111--121. (Proceedings of the 15th Eurographics Symposium on Rendering).]]
16. Günther, J., Friedrich, H., Wald, I., Seidel, H.-P., and Slusallek, P. 2006. Ray tracing animated scenes using motion decomposition. Computer Graphics Forum 25, 3 (Sept.). (Proceedings of Eurographics).]]
17. Havran, V. 2001. Heuristic Ray Shooting Algorithms. PhD thesis, Faculty of Electrical Engineering, Czech Technical University in Prague.]]
18. Hurley, J. 2005. Ray tracing goes mainstream. Intel Technology Journal 9, 2, 99--108.]]
19. ID Software, 1999. Quake III Arena. http://www.idsoftware.com/games/quake/quake3-arena/.]]
20. INTRACE, 2006. Company Hompage. http://www.intrace.com/.]]
21. Jensen, H. W. 2001. Realistic Image Synthesis Using Photon Mapping.]]
22. Kahle, J. A., Day, M. N., Hofstee, H. P., Johns, C. R., Maeurer, T. R., and Shippy, D. 2005. Introduction to the Cell multiprocessor. IBM Journal of Research and Development 49, 4, 589--604.]]
23. Kautz, J., Sloan, P.-P., and Snyder, J. 2002. Fast, arbitrary BRDF shading for low-frequency lighting using spherical harmonics. In Rendering Techniques, 301--308. (Proceedings of Eurographics Workshop on Rendering).]]
24. Keller, A. 1997. Instant radiosity. ACM Transactions on Graphics (Proceedings of SIGGRAPH 1997), 49--56.]]
25. Kruger, J., and Westermann, R. 2003. Acceleration techniques for GPU-based volume rendering. In VIS '03: Proceedings of the 14th IEEE Visualization 2003 (VIS'03), IEEE Computer Society, 38.]]
26. Lext, J., and Akenine-Möller, T. 2001. Towards rapid reconstruction for animated ray tracing. In Eurographics 2001 - Short Presentations, 311--318.]]
27. Luebke, D., and Georges, C. 1995. Portals and mirrors: simple, fast evaluation of potentially visible sets. In SI3D '95: Proceedings of the 1995 symposium on Interactive 3D graphics, 105--ff.]]
28. Luebke, D., Watson, B., Cohen, J. D., Reddy, M., and Varshney, A. 2002. Level of Detail for 3D Graphics. Elsevier Science Inc.]]
29. Marmitt, G., and Slusallek, P. 2006. Fast ray traversal of tetrahedral and hexahedral meshes for direct volume rendering. In Proceedings of Eurographics/IEEE-VGTC Symposium on Visualization (Euro-VIS) 2006, 235--242.]]
30. Microsoft, 2006. DirectX 9.0. http://www.microsoft.com/windows/directx/.]]
31. Parker, S., Martin, W., Sloan, P.-P., Shirley, P., Smits, B., and Hansen, C. 1999. Interactive ray tracing. In Proceedings of Interactive 3D Graphics, 119--126.]]
32. Purcell, T. J., Buck, I., Mark, W. R., and Hanrahan, P. 2002. Ray tracing on programmable graphics hardware. ACM Transactions on Graphics (Proceedings of ACM SIGGRAPH) 21, 3, 703--712.]]
33. Purcell, T. J. 2004. Ray Tracing on a Stream Processor. PhD thesis, Stanford University.]]
34. Reinhard, E., Smits, B., and Hansen, C. 2000. Dynamic acceleration structures for interactive ray tracing. In Proceedings of the Eurographics Workshop on Rendering, 299--306.]]
35. Reshetov, A., Soupikov, A., and Hurley, J. 2005. Multi-level ray tracing algorithm. ACM Transaction of Graphics 24, 3, 1176--1185. (Proceedings of ACM SIGGRAPH).]]
36. Rockstar Games, 2002. Grand Theft Auto: Vice City. http://www.rockstargames.com/vicecity/.]]
37. Schmittler, J., Wald, I., and Slusallek, P. 2002. SaarCOR - A hardware architecture for ray tracing. In Proceedings of the ACM SIGGRAPH/Eurographics Conference on Graphics Hardware, 27--36.]]
38. Schmittler, J., Dahmen, T., Pohl, D., Vogelgesang, C., and Slusallek, P. 2004. Ray tracing for current and future games. In Proceedings of 34. Jahrestagung der Gesellschaft für Informatik.]]
39. Schmittler, J., Woop, S., Wagner, D., Paul, W. J., and Slusallek, P. 2004. Realtime ray tracing of dynamic scenes on an FPGA chip. In Proceedings of Graphics Hardware.]]
40. Shirley, P., Slusallek, P., Mark, B., Stoll, G., and Wald, I. 2005. Introduction to real-time ray tracing. In Course notes #38 for ACM SIGGRAPH.]]
41. Sloan, P.-P., Kautz, J., and Snyder, J. 2002. Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments. In Proceedings of ACM SIGGRAPH, 527--536.]]
42. THQ Inc., 2001. Red Faction. http://www.redfaction.com/.]]
43. Wald, I., and Seidel, H.-P. 2005. Interactive ray tracing of point based models. In Proceedings of 2005 Symposium on Point Based Graphics (PGB), 9--16.]]
44. Wald, I., Slusallek, P., Benthin, C., and Wagner, M. 2001. Interactive rendering with coherent ray tracing. Computer Graphics Forum 20, 3, 153--164. (Proceedings of Eurographics).]]
45. Wald, I., Benthin, C., and Slusallek, P. 2002. OpenRT - A flexible and scalable rendering engine for interactive 3D graphics. Tech. rep., Saarland University. Available at http://graphics.cs.uni-sb.de/Publications.]]
46. Wald, I., Kollig, T., Benthin, C., Keller, A., and Slusallek, P. 2002. Interactive global illumination using fast ray tracing. In Rendering Techniques, Eurographics Association, 15--24. (Proceedings of the 13th Eurographics Workshop on Rendering).]]
47. Wald, I., Benthin, C., Dietrich, A., and Slusallek, P. 2003. Interactive ray tracing on commodity PC clusters -- state of the art and practical applications. In Euro-Par 2003. Parallel Processing, 9th International Euro-Par Conference, 2003. Proceedings, Springer, vol. 2790 of Lecture Notes in Computer Science, 499--508.]]
48. Wald, I., Benthin, C., and Slusallek, P. 2003. Distributed interactive ray tracing of dynamic scenes. In Proceedings of the IEEE Symposium on Parallel and Large-Data Visualization and Graphics (PVG), 77--86.]]
49. Wald, I., Friedrich, H., Marmitt, G., Slusallek, P., and Seidel, H.-P. 2005. Faster isosurface ray tracing using implicit KD-trees. IEEE Transactions on Visualization and Computer Graphics 11, 5, 562--573.]]
50. Wald, I., Boulos, S., and Shirley, P. 2006. Ray tracing deformable scenes using dynamic bounding volume hierarchies. SCI Institute Technical Report UUSCI-2006-015, University of Utah. (conditionally accepted at ACM Transactions on Graphics, available at http://www.sci.utah.edu/~wald/Publications/webgen/2006/BVH/download/togbvh.pdf).]]
51. Wald, I., Ize, T., Kensler, A., Knoll, A., and Parker, S. G. 2006. Ray tracing animated scenes using coherent grid traversal. ACM Transactions on Graphics 25, 3, 485--493. (Proceedings of ACM SIGGRAPH).]]
52. Wald, I. 2004. Realtime Ray Tracing and Interactive Global Illumination. PhD thesis, Saarland University.]]
53. Wang, X., Tong, X., Lin, S., Hu, S.-M., Guo, B., and Shum, H.-Y. 2004. Generalized displacement maps. In Rendering Techniques 2004, 227--234.]]
54. Woo, M., Neider, J., Davis, T., and Shreiner, D. 2001. OpenGL Programming Guide, Version 1.2, third ed. Addison Wesley, May.]]
55. Woop, S., Schmittler, J., and Slusallek, P. 2005. RPU: A programmable ray processing unit for realtime ray tracing. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2005) 24, 3, 434--444.]]
56. Woop, S., Marmitt, G., and Slusallek, P. 2006. B-KD trees for hardware accelerated ray tracing of dynamic scenes. In Proceedings of Graphics Hardware.]]
57. Wyman, C. 2005. An approximate image-space approach for interactive refraction. ACM Trans. Graph. 24, 3, 1050--1053.]]

Index Terms

• Computing methodologies

  • Computer graphics

    • Graphics systems and interfaces

    • Rendering

      • Ray tracing

• Software and its engineering

  • Software creation and management