The digital Michelangelo project: 3D scanning of large statues

ABSTRACT

We describe a hardware and software system for digitizing the shape and color of large fragile objects under non-laboratory conditions. Our system employs laser triangulation rangefinders, laser time-of-flight rangefinders, digital still cameras, and a suite of software for acquiring, aligning, merging, and viewing scanned data. As a demonstration of this system, we digitized 10 statues by Michelangelo, including the well-known figure of David, two building interiors, and all 1,163 extant fragments of the Forma Urbis Romae, a giant marble map of ancient Rome. Our largest single dataset is of the David - 2 billion polygons and 7,000 color images. In this paper, we discuss the challenges we faced in building this system, the solutions we employed, and the lessons we learned. We focus in particular on the unusual design of our laser triangulation scanner and on the algorithms and software we developed for handling very large scanned models.

References

1. Beraldin97.Beraldin, J.-A., Cournoyer,L., Rioux, M., Blais, F., El-Hakim, S.F., Godin, G., ''Object model creation from multiple range images: acquisition, cali-bration, model building and verification,'' Proc. 1st Int'l Conf.on 3-D Digital Imaging and Modeling,IEEE, 1997, pp. 326-333.
2. Beraldin99.Beraldin, J.-A., Blais, F., Cournoyer,L., Rioux, M., El-Hakim, S.F., Rodell, R., Bernier,F., Harrison, N., ''Digital 3D imaging system for rapid response on remote sites,'' Proc. 2nd Int'l Conf.on 3-D Digital Imaging and Modeling,IEEE, 1999, pp. 34-43.
3. Bergevin96.Bergevin, R., Soucy, M., Gagnon, H., Laurendeau, D., ''Towards a gen-eral multi-view registration technique,'' IEEE Trans. PAMI,Vol. 18, No. 5, May, 1996, pp. 540-547.
4. Bernardini00.Bernardini, F.,Martin, I., Rushmeier,H., ''High-Quality Texture Syn-thesis from Multiple Scans,'' IBM Research Report RC 21656(97598), February, 2000, IBM Research, Yorktown Heights, NY.
5. Besl92.Besl, P.,McKay,N., ''A Method for Registration of 3-D Shapes,'' IEEE Trans. PAMI,Vol. 14, No. 2, February,1992, pp. 239-256.
6. ChenMed92.Chen, Y.,Medioni, G., ''Object modeling by registration of multiple range images,'' Image and Vision Computing,Vol. 10, No. 3, April, 1992, pp. 145-155.
7. Rocchini99.Rocchini, C., Cignoni, P., Montani, C., Scopigno, R., ''Multiple textures stitching and blending on 3D objects,'' Proc. 10th Eurographics Rendering Work-shop, Springer-Verlag, 1999, pp. 119-130.
8. Curless96.Curless, B., Levoy,M., ''A Volumetric Method for Building Complex Models from Range Images,'' Proc. SIGGRAPH '96, ACM, 1996, pp. 303-312.
9. Dana99.Dana, K.J., Nayer,S.K., Ginneken, B.V,Koenderink, J.J., ''Reflectance and Texture of Real-World Surfaces,'' ACM Trans. on Graphics,Vol. 18, No. 1, Jan-uary 1999, pp. 1-34.
10. Debevec97.Debevec, P.E., Malik, J., ''Recovering high dynamic range radiance maps from photographs,'' Proc. SIGGRAPH '97, ACM, 1997, pp. 369-378.
11. Dorsey99.Dorsey, J., Edelman, A., Jensen, H.-W., Legakis, J., Pedersen, H.-K., ''Modeling and rendering of weathered stone,'' Proc. SIGGRAPH '99, ACM, 1999, pp. 225-234.
12. Giovannini99.Giovannini, P., ''Il 'San Matteo' di Michelangelo: analisi delle tracce di lavorazione, studio degli strumenti e osservazioni sulla tecnica di scultura,'' Riv-ista dell'Opificio delle Pietre Dure,Vol. 10, 1998, pp. 205-228.
13. Hebert95.Hebert, M., Ikeuchi, K., Delingette, H., ''A Spherical Representation for Recognition of Free-Form Surfaces,'' IEEE Trans. PAMI,Vol. 17, No. 7, July, 1995, pp. 681-690.
14. Heikkilä97.Heikkila . J., Silve~n O., ''A four-step camera calibration procedure with implicit image correction,'' Proc. CVPR '97,IEEE, 1997, pp. 1106-1112.
15. Johnson97.Johnson, A.E., Hebert, M., ''Surface Registration by Matching Oriented Points,'' Proc. 1st Int'l Conf.on 3D Digital Imaging and Modeling,IEEE, 1997, pp. 121-128.
16. Jokinen99.Jokinen, O., ''Self-calibration of a light striping system by matching multi-ple 3-D profile maps,'' Proc. 2nd Int'l Conf.on 3-D Digital Imaging and Model-ing, IEEE, 1999, pp. 180-190.
17. Levoy96.Levoy,M., Hanrahan, P., ''Light Field Rendering,'' Proc. SIGGRAPH '96, ACM, 1996, pp. 31-42.
18. Miller94.Miller,G., ''Efficient Algorithms for Local and Global Accessibility Shad-ing, '' Proc. SIGGRAPH '94, ACM, 1994, Computer Graphics pp. 319-326.
19. Nayar90.Nayar,S.K., Ikeuchi, K., Kanade, T., ''Shape from Interreflections,'' Proc. ICCV '90,IEEE, 1990, pp. 2-11.
20. Oren94.Oren, M., Nayar,S.K., ''Generalization of Lambert's reflectance model,'' Proc. SIGGRAPH '94, ACM, 1994, pp. 239-246.
21. Maver93.Maver, J., Bajcsy,R., ''Occlusions as a Guide for Planning the Next View,'' IEEE Trans. PAMI,Vol. 15, No. 5, May,1993, pp. 417-433.
22. Pito96.Pito, R., ''A sensor-based solution to the next best view problem,'' Proc. ICPR '96,1996, pp. 941-945.
23. Pulli97.Pulli, K., Surface Reconstruction and Display from Range and Color Data, Ph.D. dissertation, University of Washington, 1997.
24. Pulli99.Pulli, K., ''Multiview registration for large data sets,'' Proc. 2nd Int'l Conf.on 3-D Digital Imaging and Modeling,IEEE, 1999, pp. 160-168.
25. Rushmeier97.Rushmeier,H., Taubin, G., Gue~ziec, A., ''Applying shape from lighting variation to bump map capture,'' Proc. 8th Eurographics Rendering Workshop, Springer-Verlag, 1997, pp. 35-44.
26. Rushmeier98.Rushmeier,H., Bernardini, F., Mittleman, J., Taubin, G., ''Acquiring input for rendering at appropriate levels of detail: digitizing a Pieta`,'' Proc. 9th Eurographics Rendering Workshop,Springer-Verlag, 1998, pp. 81-92.
27. Rusinkiewicz00.Rusinkiewicz, S., Levoy,M., ''Qsplat: a multiresolution point render-ing system for large meshes,'' Proc. SIGGRAPH 2000 (these proceedings).
28. Sato97.Sato, Y.,Wheeler,M.D., Ikeuchi, K., ''Object shape and reflectance modeling from observation,'' Proc. SIGGRAPH '97, ACM, 1997, pp. 379-387.
29. Tolnay45.De Tolnay,C., ''Michelangelo,'' Princeton University Press, 1945.
30. Wood00.Wood, D., Azuma, D., Aldinger,K., Curless, B., Duchamp, T., Salesin, D., Stuetzle, W., ''Surface Light Fields for 3D Photography,'' Proc. SIGGRAPH 2000 (these proceedings).
31. Yu99.Yu, Y., Debevec, P., Malik, J., Hawkins, T., ''Inverse global illumination: recov-ering reflectance models of real scenes from photographs,'' Proc. SIGGRAPH '99, ACM, 1999, pp. 215-224.
32. Zhang99.Zhang, D., Hebert, M., ''Harmonic maps and their applications in surface matching,'' Proc. Computer Vision and Pattern Recognition (CVPR) '99,IEEE, 1999, pp. 525-530.

Index Terms

• Applied computing

  • Document management and text processing

    • Document capture

      • Document scanning

      • Graphics recognition and interpretation

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Computer vision problems

        • Reconstruction

      • Computer vision tasks

        • Scene understanding

  • Computer graphics

    • Graphics systems and interfaces

    • Image manipulation

      • Texturing

• Information systems

  • Information systems applications

    • Multimedia information systems

      • Multimedia databases