Thomas Sandholm
Peter Gardfjäll
ABSTRACT
In this paper, we present an Open Grid Services Architecture (OGSA)-based decentralized allocation enforcement system, developed with an emphasis on a consistent data model and easy integration into existing scheduling, and workload management software at six independent high-performance computing centers forming a Grid known as SweGrid. The Swedish National Allocations Committee (SNAC) allocates resource quotas at these centers to research projects requiring substantial computer time. Our system, the SweGrid Accounting System (SGAS), addresses the need for soft real-time allocation enforcement on SweGrid for cross-domain job submission. The SGAS framework is based on state-of-the-art Web and Grid services technologies. The openness and ubiquity of Web services combined with the fine-grained resource control and cross-organizational security models of Grid services proved to be a perfect match for the SweGrid needs. Extensibility and customizability of policy implementations for the three different parties the system serves (the user, the resource manager, and the allocation authority) are key design goals. Another goal is end-to-end security and single sign-on, to allow resources-selected based on client policies-to act on behalf of the user when negotiating contracts with the bank in an environment where the six centers would continue to use their existing accounting policies and tools. We conclude this paper by showing the feasibility of SGAS, which is currently being deployed at the production sites, using simulations of reservation streams. The reservation streams are shaped using soft computing and policy-based algorithms.
- Apache Axis, http://ws.apache.org/axis, Apache Software Foundation, 2003.Google Scholar
- Apache Xindice, http://xml.apache.org/xindice, Apache Software Foundation, 2004.Google Scholar
- Contract Net Interaction Protocol Specification, FIPA, 2003.Google Scholar
- Globus Toolkit, http://www.globus.org/toolkit, Globus Alliance, 2004.Google Scholar
- SGAS, http://www.sgas.se, 2004.Google Scholar
- Sun's XACML Implementation, http://sunxacml.sourceforge.net/, Sun Microsystems, 2004.Google Scholar
- Xalan Java, http://xml.apache.org/xalan-j, Apache Software Foundation, 2004.Google Scholar
- Abramson, D., Giddy, J., and Kotler, L., High Performance Parametric Modeling with Nimrod/G: Killer Application for the Global Grid? in International Parallel and Distributed Processing Symposium (IPDPS), (Cancun, Mexico, 2000), 520--528. Google ScholarDigital Library
- Alfieri, R., Cecchini, R., Ciaschini, V., dell'Agnello, L., Frohner, Á., Gianoli, A., Lõrentey, K., and Spataro, F., VOMS, an Authorization System for Virtual Organizations. in 1st European Across Grids Conference, (Santiago de Compostela, February 13-14, 2003).Google Scholar
- Anderson, A., Nadalin, A., Parducci, B., Engovatov, D., Lockhart, H., Kudo, M., Humenn, P., Godik, S., Abderson, S., Crocker, S., and Moses, T. eXtensible Access Control Markup Language (XACML) Version 1.0. Godik, S. and Moses, T. eds., OASIS, 2003.Google Scholar
- Andrews, T., Curbera, F., Dholakia, H., Goland, Y., Klein, J., Leymann, F., Liu, K., Roller, D., Smith, D., Thatte, S., Trickovic, I., and Weerawarana, S. Business Process Execution Language for Web Services Version 1.1. Thatte, S. ed., Microsoft, IBM, Siebel Systems, BEA, SAP, 2003.Google Scholar
- Andrieux, A., Czajkowski, K., Dan, A., Keahey, K., Ludwig, H., Pruyne, J., Rofrano, J., Tuecke, S., and Xu, M. Web Services Agreement Specification (WS-Agreement), Draft, Global Grid Forum, 2004.Google Scholar
- Barmouta, A., and Buyya, R., GridBank: A Grid Accounting Services Architecture (GASA) for Distributed Systems Sharing and Integration. in International Parallel and Distributed Processing Symposium (IPDPS'03), (Nice, France, 2003), IEEE. Google ScholarDigital Library
- Bartel, M., Boyer, J., Fox, B., LaMacchia, B., and Simon, E. XML-Signature Syntax and Procesing. Eastlake, D., Reagle, J. and Solo, D. eds., W3C, 2002.Google Scholar
- Booth, D., Haas, H., McCabe, F., Newcomber, E., Champion, M., Ferris, C., and Orchard, D. Web Services Architecture, W3C, 2003.Google Scholar
- Buyya, R., Abramson, D., and Giddy, J. A Case for Economy Grid Architecture for Service Oriented Grid Computing, Global Grid Forum, 2001.Google ScholarCross Ref
- Chinnici, R., Gudgin, M., Moreau, J., Schlimmer, J., and Weerawarana, S. Web Service Description Language (WSDL) Version 2.0 Part 1: Core Language, W3C, 2003.Google Scholar
- Della-Libera, G., Dixon, B., Garg, P., and Hada, S. Web Services Secure Conversation (WS-SecureConversation). Kaler, C. and Nadalin, A. eds., Microsoft, IBM, VeriSign, RSA Security, 2002.Google Scholar
- Elmroth, E., Gardfjäll, P., Mulmo, O., and Sandholm, T. An OGSA-based Bank Service for Grid Accounting Systems. Applied Parallel Computing. State-of-the-art in Scientific Computing. Lecture Notes in Computer Science. (to appear) Springer Verlag. Google ScholarDigital Library
- Fielding, R.T. Architectural Styles and the Design of Network-based Software Architectures, Ph.D. Dissertation at the Information and Computer Science Department, University of California, Irvine, 2000. Google ScholarDigital Library
- Foster, I., Berry, D., Djaoui, A., Grimshaw, A., Horn, B., Kishimoto, H., Maciel, F., Savva, A., Siebenlist, F., Subramaniam, R., Treadwell, J., and Reich, J.V. The Open Grid Services Architecture, Version 1.0, Global Grid Forum, 2004.Google Scholar
- Foster, I., and Kesselman, C. (eds.). The Grid: Blueprint for a New Computing Infrastructure. Morgan Kaufmann, 1999. Google ScholarDigital Library
- Foster, I., Kesselman, C., Nick, J.M., and Tuecke, S. Grid Services for Distributed System Integration. Computer, 35 (6). 37--46. Google ScholarDigital Library
- Guarise, A., Piro, R., and Werbrouck, A. DataGrid Accounting System - Architecture - v1.0, EU DataGrid, 2003.Google Scholar
- Hazelwood, V., Bean, R., and Yoshimoto, K., SNUPI: A Grid Accounting and Performance System Employing Portal Services and RDBMS Back-end. in Linux Clusters: The HPC Revolution, (Urbana/Champaign, USA, 2001).Google Scholar
- Imamura, T., Dillaway, B., and Simon, E. XML Encryption Syntax and Processing, W3C, 2002.Google Scholar
- Jackson, S. The Gold Accounting and Allocation Manager, http://sss.scl.ameslab.gov/gold.shtml, 2004.Google Scholar
- Jackson, S. QBank: A Resource Management Package for Parallel Computers, Pacific Northwest National Laboratory, Washington, USA, 2000.Google Scholar
- Jackson, S., and Lepro Metz, R. Usage Record -- XML Format, Global Grid Forum, 2003.Google Scholar
- Lorch, M., and Skow, D. Authorization Glossary, Global Grid Forum, 2004.Google Scholar
- Mitra, N. SOAP Version 1.2 Part 0: Primer, W3C, 2003.Google Scholar
- Newhouse, S. Grid Economic Services Architecture, Global Grid Forum, 2003.Google Scholar
- Pearlman, L., Welch, V., Foster, I., Kesselman, C., and Tuecke, S., A Community Authorization Service for Group Collaboration. in IEEE 3rd International Workshop on Policies for Distributed Systems and Networks, (2002). Google ScholarDigital Library
- Sadighi, B., Olsson, O., and Rissanen, E. Managing authorisations in dynamic coalitions, Swedish Institute of Computer Science, 2003.Google Scholar
- Smirnova, O., Eerola, P., Ekelöf, T., Ellert, M., Hansen, J.R., Konstantinov, A., Kónya, B., Nielsen, J.L., Ould-Saad, F., and Wäänänen, A. The NorduGrid Architecture and Middleware for Scientific Applications. Lecture Notes in Computer Science, 2657. 264--273. Google ScholarDigital Library
- Thigpen, W., Hacker, J., McGinnis, L., and Athey, B. Distributed Accounting on the Grid, Global Grid Forum, 2001.Google Scholar
- Tuecke, S., Czajkowski, K., Foster, I., Frey, J., Graham, S., Kesselman, C., Maquire, T., Sandholm, T., Snelling, D., and Vanderbilt, P. Open Grid Services Infrastructure (OGSI) Version 1.0, Global Grid Forum, 2003.Google Scholar
- Welch, V., Siebenlist, F., Chadwick, D., Meder, S., and Pearlman, L. Use of SAML for OGSA Authorization, Global Grid Forum, 2004.Google Scholar
- Zadeh, L.A. Fuzzy Sets. Information and Control, 8. 338--353.Google Scholar
Index Terms
- An OGSA-based accounting system for allocation enforcement across HPC centers
Recommendations
Scalable Grid-wide capacity allocation with the SweGrid Accounting System (SGAS)
The SweGrid Accounting System (SGAS) allocates capacity in collaborative Grid environments by coordinating enforcement of Grid-wide usage limits as a means to offer usage guarantees and prevent overuse. SGAS employs a credit-based allocation model where ...
An OGSA-based bank service for grid accounting systems
PARA'04: Proceedings of the 7th international conference on Applied Parallel Computing: state of the Art in Scientific ComputingThis contribution presents the design and implementation of a bank service, constituting a key component in a recently developed Grid accounting system. The Grid accounting system maintains a Grid-wide view of the resources consumed by members of a ...
ShanghaiGrid in action: the first stage projects towards digital city and city grid
The nearest goal of ShanghaiGrid is going to connect all supercomputers in this metropolis together to form a sharing environment for massive storage and grid computing. The first stage projects of ShanghaiGrid comprise four sub-projects, including: ...
Comments