Software as a service for data scientists

Abstract

Globus Online manages fire-and-forget file transfers for big-data, high-performance scientific collaborations.

References

1. Allcock, B., Bresnahan, J., Kettimuthu, R., Link, M., Dumitrescu, C., Raicu, I., and Foster, I. The Globus striped GridFTP framework and server. In Proceedings of the 2005 ACM/IEEE Conference on Supercomputing (Seattle, Nov. 12--18). ACM Press, New York, 2005.
2. Bell, G., Hey, T., and Szalay, A. Beyond the data deluge. Science 323, 5919 (Mar. 2009), 1297--1298.
3. Berriman, G.B. and Groom, S. How will astronomy archives survive the data tsunami? Commun. ACM 54, 12 (Dec. 2011), 52--56.
4. Chervenak, A., Schuler, R., Kesselman, C., Koranda, S. and Moe, B. Wide-area data replication for scientific collaborations. In Proceedings of the Sixth IEEE/ACM International Workshop on Grid Computing (Seattle, Nov. 13). IEEE Computer Society, Washington, D.C., 2005.
5. Childers, L., Liming, L., and Foster, I. Perspectives on Distributed Computing: 30 People, Four User Types, and the Distributed Computing User Experience, Technical Report ANL/MCS/CI-31. Argonne National Laboratory, Argonne, IL, 2008.
6. Cho, B. and Gupta, I., Budget-constrained bulk data transfer via internet and shipping networks. In Proceedings of the Eighth ACM international conference on Autonomic Computing (Karlsruhe, Germany, June 14-16). ACM Press, New York, 2011, 71--80.
7. Cholia, S., Skinner, D., and Boverhof, J. NEWT: A RESTful service for building high-performance computing Web applications. In Proceedings of the 2010 Gateway Computing Environments Workshop (New Orleans, Nov. 14). IEEE Computer Society Press, 2010, 1--11.
8. Cohen, B. Incentives build robustness in BitTorrent. In Proceedings of the First International Workshop on Economics of P2P Systems (Berkeley, CA, June 5--6, 2003).
9. Egeland, R., Wildishb, T., and Huang, C.-H. PhEDEx data service. Journal of Physics: Conference Series 219 (2010).
10. Erdos, M. and Cantor, S. Shibboleth Architecture. Internet 2, May 2, 2002; http://shibboleth.internet2.edu/docs/draft-internet2-shibboleth-arch-v05.pdf
11. Gray, J., Chong, W., Barclay, T., Szalay, A., and Vandenberg, J. TeraScale SneakerNet: Using Inexpensive Disks for Backup, Archiving, and Data Exchange Technical Report MSR-TR 2002-54. Microsoft Research, Redmond, WA, 2002.
12. Hammer-Lahav, E. The OAuth 1.0 Protocol. Internet Engineering Task Force RFC 5849, 2010; http://tools.ietf.org/html/rfc5849
13. Hanushevsky, A., Trunov, A., and Cottrell, L. Peer-to-peer computing for secure high-performance data copying. In Proceedings of the 2001 International Conference on Computing in High Energy and Nuclear Physics (Beijing, Sept. 3--7, 2001).
14. Kosar, T. and Livny, M. A framework for reliable and efficient data placement in distributed computing systems. Journal of Parallel and Distributed Computing 65, 10 (Oct. 2005), 1146--1157.
15. Monti, H., Butt, A.R., and Vazhkudai, S.S. CATCH: A cloud-based adaptive data-transfer service for HPC. In Proceedings of the 25 ^th IEEE International Parallel & Distributed Processing Symposium (Anchorage, Alaska, May 16--20). IEEE Computer Society, 2011, 1242--1253.
16. Novotny, J., Tuecke, S., and Welch, V. An online credential repository for the grid: MyProxy. In Proceedings of the 10 ^th IEEE International Symposium on High-Performance Distributed Computing (San Francisco, Aug. 7--9). IEEE Computer Society Press, Washington, D.C., 2001, 104--111.
17. Rajasekar, A., Moore, R., Hou, C.-Y., Lee, C.A., Marciano, R., de Torcy, A., Wan, M., Schroeder, W., Chen, S.-Y., Gilbert, L., Tooby, P., and Zhu, B. iRODS Primer: Integrated Rule-Oriented Data System. Morgan and Claypool Publishers, 2010.
18. Sun, W., Zhang, K., Chen, S.-K., Zhang, X., and Liang, H. Software as a service: An integration perspective. In Proceedings of the Fifth International Conference on Service-Oriented Computing, B. Krämer, K.-J. Lin, and P. Narasimhan, Eds. (Vienna, Austria, Sept. 17--20). Springer, Berlin/Heidelberg, 2007, 558--569.
19. Thain, D., Basney, J., Son, S.-C., and Livny, M. The Kangaroo approach to data movement on the grid. In Proceedings of the 10 ^th IEEE International Symposium on High-Performance Distributed Computing (San Francisco, Aug. 7--9). IEEE Computer Society Press, Washington, D.C., 2001, 325--333.
20. Tridgell, A. and Mackerras, P. The Rsync Algorithm TR-CS-96-05. Department of Computer Science, Australian National University, Canberra, 1994.
21. Wang, L., Park, K.S., Pang, R., Pai, V., and Peterson, L. Reliability and security in the CoDeeN content distribution network. In Proceedings of the USENIX Annual Technical Conference (Boston, June 27--July 2). USENIX Association, Berkeley, CA, 2004, 171--184.
22. Welch, V., Foster, I., Kesselman, C., Mulmo, O., Pearlman, L., Tuecke, S., Gawor, J., Meder, S., and Siebenlist, F. X.509 proxy certificates for dynamic delegation. In Proceedings of the Third Annual Public Key Infrastructure R&D Workshop (Gaithersburg, MD, Apr. 12--14), National Institute of Standards and Technology, Gaithersburg, MD, 2004.

Index Terms

• Applied computing

  • Computers in other domains

  • Physical sciences and engineering

• Computer systems organization

  • Architectures

    • Distributed architectures

• Hardware

  • Communication hardware, interfaces and storage

• Information systems

  • Information storage systems

    • Record storage systems

      • Record storage alternatives

    • Storage management

• Mathematics of computing

  • Information theory

    • Coding theory

• Networks

  • Network protocols

  • Network services

• Security and privacy

  • Cryptography

    • Mathematical foundations of cryptography

• Software and its engineering

  • Software notations and tools

    • General programming languages

      • Language features

        • Data types and structures

  • Software organization and properties

    • Contextual software domains

      • Operating systems

        • File systems management

        • Memory management

    • Software system structures

      • Distributed systems organizing principles