skip to main content
research-article

Towards High-Performance SAN with Fast Storage Devices

Published:01 March 2014Publication History
Skip Abstract Section

Abstract

Storage area network (SAN) is one of the most popular solutions for constructing server environments these days. In these kinds of server environments, HDD-based storage usually becomes the bottleneck of the overall system, but it is not enough to merely replace the devices with faster ones in order to exploit their high performance. In other words, proper optimizations are needed to fully utilize their performance gains. In this work, we first adopted a DRAM-based SSD as a fast backend-storage in the existing SAN environment, and found significant performance degradation compared to its own capabilities, especially in the case of small-sized random I/O pattern, even though a high-speed network was used. We have proposed three optimizations to solve this problem: (1) removing software overhead in the SAN I/O path; (2) increasing parallelism in the procedures for handling I/O requests; and (3) adopting the temporal merge mechanism to reduce network overheads. We have implemented them as a prototype and found that our approaches make substantial performance improvements by up to 39% and 280% in terms of both the latency and bandwidth, respectively.

References

  1. Bolhovitin, V. 2004. SCST: Generic SCSI target subsystem for Linux. SCST Ltd. http://scst.sourceforge.net/.Google ScholarGoogle Scholar
  2. Burr, G. W., Kurdi, B. N., Scott, J. C., Lam, C. H., Gopalakrishnan, K., and Shenoy, R. S. 2008. Overview of candidate device technologies for storage-class memory. IBM J. Res. Develop. 52, 4, 449--464. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Cashin, E. L. 2005. Kernel korner: ATA over Ethernet: Putting hard drives on the LAN. Linux J. 134, 10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Caulfield, A. M., De, A., Coburn, J., Mollow, T. I., Gupta, R. K., and Swanson, S. 2010. Moneta: A high-performance storage array architecture for next-generation, non-volatile memories. In Proceedings of the 43rd Annual IEEE/ACM International Symposium on Microarchitecture (MICRO’10). 385--395. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Freitas, R. F. and Wilcke, W. W. 2008. Storage-class memory: The next storage system technology. IBM J. Res. Develop. 52, 4, 439--447. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Huffman, A. 2012. NVM express revision 1.1. Intel Corporation.http://www.nvmexpress.org/wp-content/uploads/NVM-Express-1_1.pdf.Google ScholarGoogle Scholar
  7. Humphries, C., Tully, S., and Burkheimer, K. 2011. Fusion-io ioDrive performance testing. SPAWAR Systems Center Atlantic. http://www.fusionio.com/load/-media-/1ufyto/docsLibrary/WP_-_Navy_-_SSC_Atlantic_-_Fusion-io_Testing.pdf.Google ScholarGoogle Scholar
  8. INCITS. 2009. Fibre Channel: Backbone -- 5, revision 2.00. American National Standard of Accredited Standards Committee INCITS, T11 Project 1871-D/Rev. 200. http://www.t11.org/ftp/t11/pub/fc/bb-5/09-056v5.pdf.Google ScholarGoogle Scholar
  9. Katcher, J. 1997. Postmark: A new file system benchmark. Tech. rep. TR-3022. NetApp.Google ScholarGoogle Scholar
  10. Ko, M. 2003. Technical overview of iSCSI extensions for RDMA (iSER) & Datamover architecture for iSCSI (DA). In Proceedings of the RDMA Consortium.Google ScholarGoogle Scholar
  11. Lussier, D. 2004. BenchmarkSQL. http://benchmarksql.sourceforge.net/index.html.Google ScholarGoogle Scholar
  12. Machek, P. 1997. Network block device (TCP version). http://nbd.sourceforge.net/.Google ScholarGoogle Scholar
  13. Mellanox. 2012. Building a scalable storage with InfiniBand. Mellanox Technologies white paper. http://www.mellanox.com/related-docs/whitepapers/WP_Scalable_Storage_InfiniBand_Final.pdf.Google ScholarGoogle Scholar
  14. Ousterhout, J., Agrawal, P., Erickson, D., Kozyrakis, C., Leverich, J., Mazières, D., Mitra, S., Narayanan, A., Parulkar, G., Rosemblum, M., Rumble, S. M., Stratmann, E., and Stutsman, R. 2010. The case for RAMClouds: Scalable high-performance storage entirely in DRAM. ACM SIGOPS Oper. Syst. Rev. 43, 4, 92--105. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Palekar, A., Ganapathy, N., Chadda, A., and Russell, R. D. 2001. Design and implementation of a Linux SCSI target for storage area networks. In Proceedings of the 5th Linux Showcase & Conference (ALS’’01). Vol. 5, 11. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Peterson, L. L. and Davie, B. S. 2007. Computer Networks: A Systems Approach4th Ed. Morgan Kaufmann. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Pfister, G. F. 2001. An introduction to the InfiniBandTMarchitecture. In High Performance Mass Storage and Parallel I/O: Technologies and Applications. Wiley/IEEE Press, 617--663.Google ScholarGoogle Scholar
  18. Schneider, E. and Jandhyala, R. 2012. SAP HANA® -- Technical Overview. SAP AG. https://www.sap.com/bin/sapcom/downloadasset.sap-hana-technical-overview-pdf.html.Google ScholarGoogle Scholar
  19. Taejin Infotech. 2012. HYBRID Appliance HHA 3804. http://www.taejin.co.kr/taejin/images/Taejin_Products.pdf.Google ScholarGoogle Scholar
  20. Tate, J., Beck, P., Ibarra, H. H., Kumaravel, S., and Miklas, L. 2012. Introduction to storage area networks and system networking. IBM Redbooks Tech. rep. http://www.redbooks.ibm.com/redbooks/pdfs/sg245470.pdf.Google ScholarGoogle Scholar
  21. Woodruff, B., Hefty, S., Dreier, R., and Rosenstock, H. 2005. Introduction to the InfiniBand core software. In Proceedings of the Linux Symposium. Vol. 2, 271--282.Google ScholarGoogle Scholar
  22. Yang, J., Minturn, D. B., and Hady, F. 2011. When poll is better than interrupt. In Proceedings of the 9th USENIX Conference on File and Storage Technologies (FAST’11).Google ScholarGoogle Scholar
  23. Yu, Y. J., Shin, D. I., Shin, W., Song, N. Y., S., Eom, H., and Yeom, H. Y. 2012. Exploiting peak device throughput from random access workload. In Proceedings of the 4th USENIX Workshop on Hot Topics in Storage and File Systems (Hotstorage’12). Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Towards High-Performance SAN with Fast Storage Devices

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image ACM Transactions on Storage
      ACM Transactions on Storage  Volume 10, Issue 2
      March 2014
      86 pages
      ISSN:1553-3077
      EISSN:1553-3093
      DOI:10.1145/2600090
      • Editor:
      • Darrell Long
      Issue’s Table of Contents

      Copyright © 2014 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 1 March 2014
      • Accepted: 1 August 2013
      • Revised: 1 June 2013
      • Received: 1 February 2013
      Published in tos Volume 10, Issue 2

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader