Abstract
Storage area network (SAN) is one of the most popular solutions for constructing server environments these days. In these kinds of server environments, HDD-based storage usually becomes the bottleneck of the overall system, but it is not enough to merely replace the devices with faster ones in order to exploit their high performance. In other words, proper optimizations are needed to fully utilize their performance gains. In this work, we first adopted a DRAM-based SSD as a fast backend-storage in the existing SAN environment, and found significant performance degradation compared to its own capabilities, especially in the case of small-sized random I/O pattern, even though a high-speed network was used. We have proposed three optimizations to solve this problem: (1) removing software overhead in the SAN I/O path; (2) increasing parallelism in the procedures for handling I/O requests; and (3) adopting the temporal merge mechanism to reduce network overheads. We have implemented them as a prototype and found that our approaches make substantial performance improvements by up to 39% and 280% in terms of both the latency and bandwidth, respectively.
- Bolhovitin, V. 2004. SCST: Generic SCSI target subsystem for Linux. SCST Ltd. http://scst.sourceforge.net/.Google Scholar
- Burr, G. W., Kurdi, B. N., Scott, J. C., Lam, C. H., Gopalakrishnan, K., and Shenoy, R. S. 2008. Overview of candidate device technologies for storage-class memory. IBM J. Res. Develop. 52, 4, 449--464. Google ScholarDigital Library
- Cashin, E. L. 2005. Kernel korner: ATA over Ethernet: Putting hard drives on the LAN. Linux J. 134, 10. Google ScholarDigital Library
- Caulfield, A. M., De, A., Coburn, J., Mollow, T. I., Gupta, R. K., and Swanson, S. 2010. Moneta: A high-performance storage array architecture for next-generation, non-volatile memories. In Proceedings of the 43rd Annual IEEE/ACM International Symposium on Microarchitecture (MICRO’10). 385--395. Google ScholarDigital Library
- Freitas, R. F. and Wilcke, W. W. 2008. Storage-class memory: The next storage system technology. IBM J. Res. Develop. 52, 4, 439--447. Google ScholarDigital Library
- Huffman, A. 2012. NVM express revision 1.1. Intel Corporation.http://www.nvmexpress.org/wp-content/uploads/NVM-Express-1_1.pdf.Google Scholar
- Humphries, C., Tully, S., and Burkheimer, K. 2011. Fusion-io ioDrive performance testing. SPAWAR Systems Center Atlantic. http://www.fusionio.com/load/-media-/1ufyto/docsLibrary/WP_-_Navy_-_SSC_Atlantic_-_Fusion-io_Testing.pdf.Google Scholar
- INCITS. 2009. Fibre Channel: Backbone -- 5, revision 2.00. American National Standard of Accredited Standards Committee INCITS, T11 Project 1871-D/Rev. 200. http://www.t11.org/ftp/t11/pub/fc/bb-5/09-056v5.pdf.Google Scholar
- Katcher, J. 1997. Postmark: A new file system benchmark. Tech. rep. TR-3022. NetApp.Google Scholar
- Ko, M. 2003. Technical overview of iSCSI extensions for RDMA (iSER) & Datamover architecture for iSCSI (DA). In Proceedings of the RDMA Consortium.Google Scholar
- Lussier, D. 2004. BenchmarkSQL. http://benchmarksql.sourceforge.net/index.html.Google Scholar
- Machek, P. 1997. Network block device (TCP version). http://nbd.sourceforge.net/.Google Scholar
- Mellanox. 2012. Building a scalable storage with InfiniBand. Mellanox Technologies white paper. http://www.mellanox.com/related-docs/whitepapers/WP_Scalable_Storage_InfiniBand_Final.pdf.Google Scholar
- Ousterhout, J., Agrawal, P., Erickson, D., Kozyrakis, C., Leverich, J., Mazières, D., Mitra, S., Narayanan, A., Parulkar, G., Rosemblum, M., Rumble, S. M., Stratmann, E., and Stutsman, R. 2010. The case for RAMClouds: Scalable high-performance storage entirely in DRAM. ACM SIGOPS Oper. Syst. Rev. 43, 4, 92--105. Google ScholarDigital Library
- Palekar, A., Ganapathy, N., Chadda, A., and Russell, R. D. 2001. Design and implementation of a Linux SCSI target for storage area networks. In Proceedings of the 5th Linux Showcase & Conference (ALS’’01). Vol. 5, 11. Google ScholarDigital Library
- Peterson, L. L. and Davie, B. S. 2007. Computer Networks: A Systems Approach4th Ed. Morgan Kaufmann. Google ScholarDigital Library
- Pfister, G. F. 2001. An introduction to the InfiniBandTMarchitecture. In High Performance Mass Storage and Parallel I/O: Technologies and Applications. Wiley/IEEE Press, 617--663.Google Scholar
- Schneider, E. and Jandhyala, R. 2012. SAP HANA® -- Technical Overview. SAP AG. https://www.sap.com/bin/sapcom/downloadasset.sap-hana-technical-overview-pdf.html.Google Scholar
- Taejin Infotech. 2012. HYBRID Appliance HHA 3804. http://www.taejin.co.kr/taejin/images/Taejin_Products.pdf.Google Scholar
- Tate, J., Beck, P., Ibarra, H. H., Kumaravel, S., and Miklas, L. 2012. Introduction to storage area networks and system networking. IBM Redbooks Tech. rep. http://www.redbooks.ibm.com/redbooks/pdfs/sg245470.pdf.Google Scholar
- Woodruff, B., Hefty, S., Dreier, R., and Rosenstock, H. 2005. Introduction to the InfiniBand core software. In Proceedings of the Linux Symposium. Vol. 2, 271--282.Google Scholar
- Yang, J., Minturn, D. B., and Hady, F. 2011. When poll is better than interrupt. In Proceedings of the 9th USENIX Conference on File and Storage Technologies (FAST’11).Google Scholar
- Yu, Y. J., Shin, D. I., Shin, W., Song, N. Y., S., Eom, H., and Yeom, H. Y. 2012. Exploiting peak device throughput from random access workload. In Proceedings of the 4th USENIX Workshop on Hot Topics in Storage and File Systems (Hotstorage’12). Google ScholarDigital Library
Index Terms
- Towards High-Performance SAN with Fast Storage Devices
Recommendations
Research on security of storage area network
InfoSecu '04: Proceedings of the 3rd international conference on Information securityDuring developing of storage, new kind of storage storage area network (SAN) come into being. In the new framework, all hosts connect to storage through a network. There is more security risk than traditional storage system. In this paper, we discuss ...
Optimizing the file system with variable-length I/O for fast storage devices
APSys '13: Proceedings of the 4th Asia-Pacific Workshop on SystemsRecently, the demand for fast storages is rapidly increasing in HPC environments such as cloud platforms, social network services and desktop users. But HDD-based storages cannot satisfy these demands, and a variety of high performance storages ...
Concurrency control scheme for key-value stores based on InfiniBand
RACS '14: Proceedings of the 2014 Conference on Research in Adaptive and Convergent SystemsUsing InfiniBand technologies, the performance of key-value stores can be greatly improved because of RDMA features and the ultra-low latency of InfiniBand. However, maximizing the benefits of InfiniBand for key-value stores is still challenging because ...
Comments