www.it-ebooks.info www.it-ebooks.info MARKET-ORIENTED GRID AND UTILITY COMPUTING www.it-ebooks.info www.it-ebooks.info MARKET-ORIENTED GRID AND UTILITY COMPUTING Edited by RAJKUMAR BUYYA, PhD The University of Melbourne and Manjrasoft Pty Ltd, Australia KRIS BUBENDORFER, PhD Victoria University of Wellington, New Zealand www.it-ebooks.info Copyright Ó 2010 by John Wiley & Sons, Inc. All rights reserved Published by John Wiley & Sons, Inc., Hoboken, New Jersey Published simultaneously in Canada No part of this publication may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, electronic, mechanical, photocopying, recording, scanning, or otherwise, except as permitted under Section 107 or 108 of the 1976 United States Copyright Act, without either the prior written permission of the Publisher, or authorization through payment of the appropriate per copy fee to the Copyright Clearance Center, Inc., 222 Rosewood Drive, Danvers, MA 01923, (978) 750 8400, fax (978) 750 4470, or on the web at www.copyright.com. Requests to the Publisher for permission should be addressed to the Permissions Department, John Wiley & Sons, Inc., 111 River Street, Hoboken, NJ 07030, (201) 748 6011, fax (201) 748 6008, or online at http://www.wiley.com/go/permission. Limit of Liability/Disclaimer of Warranty: While the publisher and author have used their best efforts in preparing this book, they make no representations or warranties with respect to the accuracy or completeness of the contents of this book and specifically disclaim any implied warranties of merchantability or fitness for a particular purpose. No warranty may be created or extended by sales representatives or written sales materials. The advice and strategies contained herein may not be suitable for your situation. You should consult with a professional where appropriate. Neither the publisher nor author shall be liable for any loss of profit or any other commercial damages, including but not limited to special, incidental, consequential, or other damages. For general information on our other products and services or for technical support, please contact our Customer Care Department within the United States at (800) 762 2974, outside the United States at (317) 572 3993 or fax (317) 572 4002. Wiley also publishes its books in a variety of electronic formats. Some content that appears in print may not be available in electronic formats. For more information about Wiley products, visit our web site at www.wiley.com. Library of Congress Cataloging-in-Publication Data: Market oriented grid and utility computing / edited by Rajkumar Buyya, Kris Bubendorfer. p. cm. Includes bibliographical references and index. ISBN 978 0 470 28768 2 (cloth) 1. Computational grids (Computer systems) 2. Utilities (Computer programs) I. Buyya, Rajkumar, 1970 II. Bubendorfer, Kris. QA76.9.C58M37 2009 004’.36 dc22 2008045492 Printed in the United States of America 10987654321 www.it-ebooks.info CONTENTS CONTRIBUTORS ix PREFACE xv ACRONYMS xix PART I FOUNDATIONS 1 Market-Oriented Computing and Global Grids: An Introduction 3 Rajkumar Buyya and Srikumar Venugopal 2 Markets, Mechanisms, Games, and Their Implications in Grids 29 Yibo Sun, Sameer Tilak, Ruppa K. Thulasiram, and Kenneth Chiu 3 Ownership and Decentralization Issues in Res ource Allocation Mechanisms 49 Tiberiu Stef Praun 4 Utility Functions, Prices, and Negotiation 67 John Wilkes v www.it-ebooks.info 5 Options and Commodity Markets for Com puting Resources 89 Dan Cristian Marinescu, John Patrick Morrison, and Howard Jay Siegel PART II BUSINESS MODELS 6 Grid Business Models, Evaluation, and Principles 123 Steve Taylor and Paul McKee 7 Grid Business Models for Brokers Executing SLA-Based Workflows 147 Dang Minh Quan and Jo€rn Altman 8 A Business-Rules-Based Model to Manage Virtual Organizations in Collaborative Grid Environments 167 Pilar Herrero, Jos  e Luis Bosque, and Mar ı aS.P  erez 9 Accounting as a Requirement for Market-Oriented Grid Computing 187 Andrea Guarise and Rosario M. Piro PART III POLICIES AND AGREEMENTS 10 Service-Level Agreements (SLAs) in the Grid Environment 215 Bastian Koller, Eduardo Oliveros, and Alfonso S  anchez Macian 11 SLAs, Negotiation, and Challenges 237 Paul McKee, Steve Taylor, Mike Surridge, and Richard Lowe 12 SLA-Based Resource Manage ment and Allocation 261 Jordi Guitart, Mario Mac ı as, Omer Rana, Philipp Wieder, Ramin Yahyapour, and Wolfgang Ziegler 13 Market-Based Resource Allocation for Differentiated Quality Service Levels 285 H. Howie Huang and Andrew S. Grimshaw 14 Specification, Planning, and Execution of QoS-Aware Grid Workflows 309 Ivona Brandic, Sabri Pllana, and Siegfried Benkner 15 Risk Management In Grids 355 Karim Djemame, James Padgett, Iain Gourlay, Kerstin Voss, and Odej Kao vi CONTENTS www.it-ebooks.info PART IV RESOURCE ALLOCATION AND SCHEDULING MECHANISMS 16 A Reciprocation-Based Economy for Multiple Services in a Computational Grid 357 Nazareno Andrade, Francisco Brasileiro, Miranda Mowbray, and Walfredo Cirne 17 The Nimrod/G Grid Resource Brok er for Economics-Based Scheduling 371 Rajkumar Buyya and David Abramson 18 Techniques for Providing Hard Quality-of-Service Guarantees in Job Scheduling 403 Pavan Balaji, Ponnuswamy Sadayappan, and Mohammad Islam 19 Deadline Budget-Based Scheduling of Workflows on Utility Grids 427 Jia Yu, Kotagiri Ramamohanarao, and Rajkumar Buyya 20 Game-Theoretic Scheduling of Grid Computations 451 Yu Kwong Kwok 21 Cooperative Game-Theory-Based Cost Optimization for Scientific Workflows 475 Radu Prodan and Rubing Duan 22 Auction-Based Resource Alloc ation 495 Bj € orn Schnizler 23 Two Auction-Based Resource Allocation Environments: Design and Experience 513 Alvin AuYoung, Phil Buonadonna, Brent N. Chun, Chaki Ng, David C. Parkes, Jeff Shneidman, Alex C. Snoeren, and Amin Vahdat 24 Trust in Grid Resource Auctions 541 Kris Bubendorfer, Ben Palmer, and Wayne Thomson 25 Using Secure Auctions to Build a Distributed Metascheduler for the Grid 569 Kyle Chard and Kris Bubendorfer 26 The Gridbus Middleware for Market-Oriented Computing 589 Rajkumar Buyya, Srikumar Venugopal, Rajiv Ranjan, and Chee Shin Yeo INDEX 623 CONTENTS vii www.it-ebooks.info www.it-ebooks.info [...]... resources, and negotiate service-level agreements (SLAs) to enhance the observed stability of their applications The purpose of this book, entitled Market-Oriented Grid and Utility Computing, is to capture the state of the art in both market-oriented Grid and utility computing research, and to identify potential research directions and technologies that will facilitate creation of a global commercial Grid. .. on Grid resources [28], and the Gridbus project (University of Melbourne, Australia) for market-oriented Grid and utility computing [54] 1.4.4 Standardization Efforts Given the large amount of middleware development happening in this area of research, standardization is important to ensure interoperability between different products and implementations Grid standardization efforts led by the Open Grid. .. mechanisms and various technologies supporting different market models It covers economic models, such as commodity models, reciprocation, auctions, and game theory, and middleware technologies such as Nimrod-G and Gridbus for market-oriented Grid computing and utility- oriented resource allocation ACKNOWLEDGMENTS First and foremost, we are grateful to all the contributing authors for their time, effort, and. .. service-oriented architecture and provides the hardware and software services and infrastructure for secure and uniform access to heterogeneous www.it-ebooks.info 5 GRID COMPUTING resources and enables the formation and management of virtual organizations (VOs) It also supports application and services composition, workflow expression, scheduling, and execution management and service-level agreement (SLA)-based... highlighting the potential and suitability of Grids to be used as utility computing environments The current trend of implementing Grids based on open standard service-based architectures to improve interoperability is a step toward supporting utility computing Even though most existing Grid applications are scientific research and collaboration projects, the number of applications in business and industryrelated... technologies, service, and applications, and the infrastructure to support them The Grid is analogous in concept to the power (electricity) Grid It aims to couple distributed resources, and offers consistent and inexpensive access to them irrespective of their physical location Thus, Grid computing is enabling the delivery of computing as the fifth utility to users after water, gas, electricity, and telephone... HTTP and XML for communicating between heterogeneous components and architectures Other standardization bodies such as World Wide Web Consortium (W3C), Organization for Advancement of Structured Information Standards (OASIS), and Internet Engineering Task Force (IETF) also produce standards relevant to aspects of Grid Computing 1.5 MARKET-ORIENTED GRID RESOURCE MANAGEMENT Resource management and scheduling... higher-level abstractions and services These include application development environments, programming tools, and resource brokers for managing resources and scheduling application tasks for execution on global resources Grid applications and portals are typically developed using Grid- enabled programming environments and interfaces and are deployed on Grids using brokering and scheduling services provided... service providers maintain and supply utility services, such as electrical power, gas, and water to consumers Consumers in turn pay service providers according to their usage Therefore, the underlying design of utility computing is based on a service provisioning model, where users (consumers) pay providers for using computing power only when they need to 1.2 GRID COMPUTING Grid computing follows the service-oriented... telephone Such a model of computing is popularly called utility computing in the business world where service providers maintain and supply information technology (IT) services to consumers, and receive payment in return As the Grid matures, a vision of a truly global Grid infrastructure has started to emerge In this global Grid, computational resources are acquired on demand and provided with an agreed-on . www.it-ebooks.info www.it-ebooks.info MARKET-ORIENTED GRID AND UTILITY COMPUTING www.it-ebooks.info www.it-ebooks.info MARKET-ORIENTED GRID AND UTILITY COMPUTING Edited by RAJKUMAR. Market-Oriented Grid and Utility Computing, is to capture the state of the art in both market-oriented Grid and utility com puting research, and to identify