Antialiasing recovery

Abstract

We present a method for restoring antialiased edges that are damaged by certain types of nonlinear image filters. This problem arises with many common operations such as intensity thresholding, tone mapping, gamma correction, histogram equalization, bilateral filters, unsharp masking, and certain nonphotorealistic filters. We present a simple algorithm that selectively adjusts the local gradients in affected regions of the filtered image so that they are consistent with those in the original image. Our algorithm is highly parallel and is therefore easily implemented on a GPU. Our prototype system can process up to 500 megapixels per second and we present results for a number of different image filters.

References

1. Agrawal, A., Raskar, R., Nayar, S. K., and Li, Y. 2005. Removing photography artifacts using gradient projection and flash-exposure sampling. ACM Trans. Graph. 24, 3, 828--835.
2. Aharon, M., Elad, M., and Bruckstein, A. 2006. K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation. IEEE Trans. Signal Process. 54, 11, 4311--4322.
3. Akenine-Möller, T., Haines, E., and Hoffman, N. 2008. Real-Time Rendering 3rd Ed. AK Peters.
4. Bando, Y., Chen, B.-Y., and Nishita, T. 2008. Extracting depth and matte using a color-filtered aperture. ACM Trans. Graph. 27, 5, 134.
5. Bennett, E. P., Uyttendaele, M., Zitnick, C. L., Szeliski, R., and Kang, S. B. 2006. Video and image Bayesian demosaicing with a two color image prior. In Proceedings of the European Conference on Computer Vision (ECCV'06). Lecture Notes in Computer Science, vol. 3951. 508--521.
6. Eisemann, E. and Durand, F. 2004. Flash photography enhancement via intrinsic relighting. ACM Trans. Graph. 23, 3, 673--678.
7. Fattal, R., Lischinski, D., and Werman, M. 2002. Gradient domain high dynamic range compression. ACM Trans. Graph. 21, 3, 249--256.
8. Hyvärinen, A., Hurri, J., and Hoyer, P. O. 2009. Natural Image Statistics: A Probabilistic Approach to Early Computational Vision. Springer.
9. Joshi, N., Zitnick, C., Szeliski, R., and Kriegman, D. 2009. Image deblurring and denoising using color priors. In Proceedings of the Conference on Computer Vision and Pattern Recognition IEEE (CVPR). 1550--1557.
10. Kim, Y., Jang, C., Demouth, J., and Lee, S. 2009. Robust color-to-gray via nonlinear global mapping. ACM Trans. Graph. 28, 5, 161.
11. Kopf, J., Cohen, M., Lischinski, D., and Uyttendaele, M. 2007. Joint bilateral upsampling. ACM Trans. Graph. 26, 3, 96.
12. Kyprianidis, J. E., Kang, H., and Döllner, J. 2009. Image and video abstraction by anisotropic Kuwahara filtering. Comput. Graph. Forum 28, 7, 1955--1963.
13. Levin, A., Lischinski, D., and Weiss, Y. 2006. A closed form solution to natural image matting. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR). vol. 1. 61--68.
14. Liu, C., Szeliski, R., Kang, S. B., Zitnick, C. L., and Freeman, W. T. 2007. Automatic estimation and removal of noise from a single image. IEEE Trans. Patt. Anal. Mach. Intell. 30, 2, 299--314.
15. Mairal, J., Elad, M., and Sapiro, G. 2008. Sparse representation for color image restoration. IEEE Trans. Image Process. 17, 1, 53--69.
16. Omer, I. and Werman, M. 2004. Color lines: Image specific color representation. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR). vol. 2. 946--953.
17. Paris, S., Kornprobst, P., Tumblin, J., and Durand, F. 2009. Bilateral filtering: Theory and applications. Found. Trends Comput. Graph. Vis. 4, 1, 57--62.
18. Pérez, P., Gangnet, M., and Blake, A. 2003. Poisson image editing. ACM Trans. Graph. 22, 3, 313--318.
19. Petschnigg, G., Szeliski, R., Agrawala, M., Cohen, M., Hoppe, H., and Toyama, K. 2004. Digital photography with flash and no-flash image pairs. ACM Trans. Graph. 23, 3, 664--672.
20. Pharr, M. and Humphreys, G. 2004. Physically Based Rendering: From Theory to Implementation. Morgan Kaufmann.
21. Reshetov, A. 2009. Morphological antialiasing. In Proceedings of the ACM Symposium on High Performance Graphics. 109--116.
22. Roweis, S. R. 1997. EM algorithms for PCA and SPCA. In Advances in Neural Information Processing Systems, vol. 10, MIT Press, 626--632.
23. TopazLabs. 2010. Topaz detail 2. Software package by Topaz Labs. http://www.topazlabs.com/detail/.
24. van Hateren, J. H. and van der Schaaf, A. 1998. Independent component filters of natural images compared with simple cells in primary visual cortex. Proc. Roy. Soc. B 265, 359--366.
25. Wang, J. and Cohen, M. 2007. Image and video matting: A survey. Found. Trends Comput. Graph. Vis. 3, 2.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Computer vision

  • Computer graphics

    • Image manipulation

    • Rendering