Feilong Yan
Liangliang Nan
Peter Wonka
Skip Abstract Section
Skip Supplemental Material SectionAbstract
We propose a framework for global registration of building scans. The first contribution of our work is to detect and use portals (e.g., doors and windows) to improve the local registration between two scans. Our second contribution is an optimization based on a linear integer programming formulation. We abstract each scan as a block and model the blocks registration as an optimization problem that aims at maximizing the overall matching score of the entire scene. We propose an efficient solution to this optimization problem by iteratively detecting and adding local constraints. We demonstrate the effectiveness of the proposed method on buildings of various styles and that our approach is superior to the current state of the art.
Supplemental Material
Available for Download
zip
a237-yan.zip (100 MB)
Supplemental file.
- Aiger, D., Mitra, N. J., and Cohen-Or, D. 2008. 4-points congruent sets for robust pairwise surface registration. In ACM Transactions on Graphics, vol. 27, 85. Google Scholar
Digital Library
- Besl, P. J., and McKay, N. D. 1992. Method for registration of 3-d shapes. In Robotics-DL tentative, International Society for Optics and Photonics, 586--606.Google Scholar
- Bochkanov, S., 2015. Alglib library. http://www.alglib.net/.Google Scholar
- Brown, B., and Rusinkiewicz, S. 2007. Global non-rigid alignment of 3-D scans. SIGGRAPH 26, 3 (Aug.). Google ScholarDigital Library
- Chen, J., Bautembach, D., and Izadi, S. 2013. Scalable real-time volumetric surface reconstruction. ACM Transactions on Graphics 32, 4, 113. Google ScholarDigital Library
- Choi, S., Zhou, Q.-Y., and Koltun, V. 2015. Robust reconstruction of indoor scenes. In CVPR, 5556--5565.Google Scholar
- Cutler, W. 1978. The six-piece burr. Journal of Recreational Mathematics 10, 4, 241--250.Google Scholar
- Dardari, D., Closas, P., and Djuric, P. M. 2015. Indoor tracking: Theory, methods, and technologies. Vehicular Technology, IEEE Transactions on 64, 4, 1263--1278.Google ScholarCross Ref
- Fu, H., Cohen-Or, D., Dror, G., and Sheffer, A. 2008. Upright orientation of man-made objects. In ACM transactions on graphics, vol. 27, 42. Google ScholarDigital Library
- Fu, C.-W., Song, P., Yan, X., Yang, L. W., Jayaraman, P. K., and Cohen-Or, D. 2015. Computational interlocking furniture assembly. ACM Trans. Graph. 34, 4 (July), 91:1--91:11. Google ScholarDigital Library
- Gelfand, N., Mitra, N. J., Guibas, L. J., and Pottmann, H. 2005. Robust global registration. In SGP, vol. 2, 5. Google ScholarDigital Library
- Ghanem, B., Thabet, A., Carlos Niebles, J., and Caba Heilbron, F. 2015. Robust manhattan frame estimation from a single rgb-d image. In CVPR, 3772--3780.Google Scholar
- GPS.gov, 2015. Gps accuracy. http://www.gps.gov/systems/gps/performance/accuracy/.Google Scholar
- Gurobi, 2015. Gurobi optimization. http://www.gurobi.com/.Google Scholar
- Harris, C., and Stephens, M. 1988. A combined corner and edge detector. In Alvey vision conference, vol. 15, Citeseer, 50.Google Scholar
- Horn, B. K. 1987. Closed-form solution of absolute orientation using unit quaternions. JOSA A 4, 4, 629--642.Google ScholarCross Ref
- Huang, Q.-X., Flöry, S., Gelfand, N., Hofer, M., and Pottmann, H. 2006. Reassembling fractured objects by geometric matching. ACM Transactions on Graphics 25, 3, 569--578. Google ScholarDigital Library
- Huang, P., Budd, C., and Hilton, A. 2011. Global temporal registration of multiple non-rigid surface sequences. In CVPR, IEEE, 3473--3480. Google ScholarDigital Library
- Huang, H., Gong, M., Cohen-Or, D., Ouyang, Y., Tan, F., and Zhang, H. 2012. Field-guided registration for feature-conforming shape composition. ACM Transactions on Graphics 31, 6, 179. Google ScholarDigital Library
- Huber, D. F., and Hebert, M. 2003. Fully automatic registration of multiple 3d data sets. Image and Vision Computing 21, 7, 637--650.Google ScholarCross Ref
- Huber, D. F. 2002. Automatic three-dimensional modeling from reality. PhD thesis, Carnegie Mellon University Pittsburgh. Google ScholarDigital Library
- Izadi, S., Kim, D., Hilliges, O., Molyneaux, D., Newcombe, R., Kohli, P., Shotton, J., Hodges, S., Freeman, D., Davison, A., et al. 2011. Kinectfusion: real-time 3d reconstruction and interaction using a moving depth camera. In UIST, ACM, 559--568. Google ScholarDigital Library
- Jian, B., and Vemuri, B. C. 2011. Robust point set registration using gaussian mixture models. IEEE Transactions on Pattern Analysis and Machine Intelligence 33, 8, 1633--1645. Google ScholarDigital Library
- Kahler, O., Prisacariu, V. A., Ren, C. Y., Sun, X., Torr, P. H. S., and Murray, D. W. Very High Frame Rate Volumetric Integration of Depth Images on Mobile Device. IEEE Transactions on Visualization and Computer Graphics. Google ScholarDigital Library
- Li, H., Sumner, R. W., and Pauly, M. 2008. Global correspondence optimization for non-rigid registration of depth scans. In Computer graphics forum, vol. 27, Wiley Online Library, 1421--1430. Google ScholarDigital Library
- Liu, Y.-S., and Ramani, K. 2009. Robust principal axes determination for point-based shapes using least median of squares. Computer-Aided Design 41, 4, 293--305. Google ScholarDigital Library
- Matterport, 2016. Matterport 3d models of real interior spaces. https://matterport.com/.Google Scholar
- Nan, L., Sharf, A., Zhang, H., Cohen-Or, D., and Chen, B. 2010. Smartboxes for interactive urban reconstruction. In SIGGRAPH, ACM, SIGGRAPH, 93:1--93:10. Google ScholarDigital Library
- Newcombe, R. A., Izadi, S., Hilliges, O., Molyneaux, D., Kim, D., Davison, A. J., Kohi, P., Shotton, J., Hodges, S., and Fitzgibbon, A. 2011. Kinectfusion: Real-time dense surface mapping and tracking. In Mixed and augmented reality (ISMAR), IEEE, 127--136. Google ScholarDigital Library
- Niessner, M., Zollhöfer, M., Izadi, S., and Stamminger, M. 2013. Real-time 3d reconstruction at scale using voxel hashing. ACM Transactions on Graphics 32, 6, 169. Google ScholarDigital Library
- Pauly, M., Keiser, R., and Gross, M. 2003. Multi-scale feature extraction on point-sampled surfaces. In Computer graphics forum, vol. 22, 281--289.Google Scholar
- Roth, H., and Vona, M. 2012. Moving volume kinectfusion. In BMVC, 1--11.Google Scholar
- Rueckert, D., Sonoda, L. I., Hayes, C., Hill, D. L., Leach, M. O., and Hawkes, D. J. 1999. Nonrigid registration using free-form deformations: application to breast mr images. IEEE Transactions on Medical Imaging 18, 8, 712--721.Google ScholarCross Ref
- Rusinkiewicz, S., and Levoy, M. 2001. Efficient variants of the icp algorithm. In 3-D Digital Imaging and Modeling, IEEE, 145--152.Google Scholar
- Rusu, R. B., and Cousins, S. 2011. 3d is here: Point cloud library (pcl). In International Conference on Robotics and Automation.Google Scholar
- Schenk, E., and Guittard, C. 2009. Crowdsourcing: What can be outsourced to the crowd, and why. In Workshop on Open Source Innovation.Google Scholar
- Schnabel, R., Wahl, R., and Klein, R. 2007. Efficient ransac for point-cloud shape detection. In Computer graphics forum, vol. 26, 214--226.Google Scholar
- Scott, W. R., Roth, G., and Rivest, J.-F. 2003. View planning for automated three-dimensional object reconstruction and inspection. ACM Comput. Surv. 35, 1 (Mar.), 64--96. Google ScholarDigital Library
- Segal, A., Haehnel, D., and Thrun, S. 2009. Generalized-icp. In Robotics: Science and Systems, vol. 2.Google Scholar
- Sharp, G. C., Lee, S. W., and Wehe, D. K. 2004. Multiview registration of 3d scenes by minimizing error between coordinate frames. IEEE Transactions on Pattern Analysis and Machine Intelligence 26, 8, 1037--1050. Google ScholarDigital Library
- Tam, G. K., Cheng, Z.-Q., Lai, Y.-K., Langbein, F. C., Liu, Y., Marshall, D., Martin, R. R., Sun, X.-F., and Rosin, P. L. 2013. Registration of 3d point clouds and meshes: a survey from rigid to nonrigid. IEEE Transactions on Visualization and Computer Graphics 19, 7, 1199--1217. Google ScholarDigital Library
- Theiler, P. W., Wegner, J. D., and Schindler, K. 2015. Globally consistent registration of terrestrial laser scans via graph optimization. ISPRS Journal of Photogrammetry and Remote Sensing 109, 126--138.Google ScholarCross Ref
- Whelan, T., Kaess, M., Fallon, M., Johannsson, H., Leonard, J., and McDonald, J. 2012. Kintinuous: Spatially extended kinectfusion.Google Scholar
- Wu, S., Sun, W., Long, P., Huang, H., Cohen-Or, D., Gong, M., Deussen, O., and Chen, B. 2014. Quality-driven poisson-guided autoscanning. ACM Trans. Graph. 33, 6 (Nov.), 203:1--203:12. Google ScholarDigital Library
- Xu, K., Huang, H., Shi, Y., Li, H., Long, P., Caichen, J., Sun, W., and Chen, B. 2015. Autoscanning for coupled scene reconstruction and proactive object analysis. ACM Trans. Graph. 34, 6 (Oct.), 177:1--177:14. Google ScholarDigital Library
- Yan, F., Sharf, A., Lin, W., Huang, H., and Chen, B. 2014. Proactive 3d scanning of inaccessible parts. ACM Trans. Graph. 33, 4 (July), 157:1--157:8. Google ScholarDigital Library
- Zhou, Q.-Y., and Koltun, V. 2013. Dense scene reconstruction with points of interest. ACM Trans. Graph. 32, 4 (July), 112:1--112:8. Google ScholarDigital Library
Index Terms
- Block assembly for global registration of building scans
Recommendations
Local to global registration of multi-view range scans using spanning tree
An approach is proposed for multi-view registration of scans using spanning tree.It achieves multi-view registration of initially posed scans with good performances.It can be applied to 3D object and scene reconstruction. Display Omitted Registration is ...
Branch-and-Bound Methods for Euclidean Registration Problems
In this paper, we propose a practical and efficient method for finding the globally optimal solution to the problem of determining the pose of an object. We present a framework that allows us to use point-to-point, point-to-line, and point-to-plane ...
Joint segmentation and registration for 4D lung CT images based on Markov random field
ICIMCS '18: Proceedings of the 10th International Conference on Internet Multimedia Computing and ServiceThe study of segmentation and registration of lung volume in medical images has been an active area with the emergence and development of 4D CT (Computed Tomography) medical imaging techniques. Precise image segmentation and registration methods are ...
Comments