TEAM LinG Autonomic Computing Concepts, Infrastructure, and Applications 9367_FM.indd 1 11/15/06 2:56:45 PM TEAM LinG 9367_FM.indd 2 11/15/06 2:56:45 PM TEAM LinG Autonomic Computing Concepts, Infrastructure, and Applications CRC Press is an imprint of the Taylor & Francis Group, an informa business Boca Raton London New York Edited by Manish Parashar Salim Hariri 9367_FM.indd 3 11/15/06 2:56:45 PM TEAM LinG CRC Press Taylor & Francis Group 6000 Broken Sound Parkway NW, Suite 300 Boca Raton, FL 33487‑2742 © 2007 by Taylor & Francis Group, LLC CRC Press is an imprint of Taylor & Francis Group, an Informa business No claim to original U.S. Government works Printed in the United States of America on acid‑free paper 10 9 8 7 6 5 4 3 2 1 International Standard Book Number‑10: 0‑8493‑9367‑1 (Hardcover) International Standard Book Number‑13: 978‑0‑8493‑9367‑9 (Hardcover) This book contains information obtained from authentic and highly regarded sources. Reprinted material is quoted with permission, and sources are indicated. A wide variety of references are listed. Reasonable efforts have been made to publish reliable data and information, but the author and the publisher cannot assume responsibility for the validity of all materials or for the conse‑ quences of their use. No part of this book may be reprinted, reproduced, transmitted, or utilized in any form by any electronic, mechanical, or other means, now known or hereafter invented, including photocopying, microfilming, and recording, or in any information storage or retrieval system, without written permission from the publishers. For permission to photocopy or use material electronically from this work, please access www. copyright.com (http://www.copyright.com/) or contact the Copyright Clearance Center, Inc. (CCC) 222 Rosewood Drive, Danvers, MA 01923, 978‑750‑8400. CCC is a not‑for‑profit organization that provides licenses and registration for a variety of users. For organizations that have been granted a photocopy license by the CCC, a separate system of payment has been arranged. Trademark Notice: Product or corporate names may be trademarks or registered trademarks, and are used only for identification and explanation without intent to infringe. Library of Congress Cataloging‑in‑Publication Data Autonomic computing : concepts, infrastructure, and applications / editor(s): Manish Parashar and Salim Hariri. p. cm. Includes bibliographical references and index. ISBN‑13: 978‑0‑8493‑9367‑9 (alk. paper) ISBN‑10: 1‑4200‑0935‑4 (alk. paper) 1. Autonomic computing. I. Parashar, Manish, 1967‑ II. Hariri, Salim. III. Title. QA76.9.A97A96 2007 004‑‑dc22 2006024028 Visit the Taylor & Francis Web site at http://www.taylorandfrancis.com and the CRC Press Web site at http://www.crcpress.com 9367_FM.indd 4 11/15/06 2:56:46 PM TEAM LinG P1: Binaya Dash November 13, 2006 10:38 9367 9367˙C000 Dedication To Gowrie and Anushka - Manish Parashar To Sonia, Lana and George - Salim Hariri TEAM LinG P1: Binaya Dash November 13, 2006 10:38 9367 9367˙C000 TEAM LinG P1: Binaya Dash November 13, 2006 10:38 9367 9367˙C000 Preface Introduction: Advances in networking and computing technologies, and software tools have resulted in an explosive growth in applications and information services that influence all aspects of our life. These sophisti- cated applications and services are complex, heterogeneous, and dynamic. Further, the underlying information infrastructure (e.g., the Internet) globally aggregates large numbers of independent computing and communication resources, data stores, and sensor networks, and is itself similarly large, het- erogeneous, dynamic, and complex. The combined scale, complexity, hetero- geneity, and dynamism of networks, systems, and applications have made our computational and information infrastructures brittle, unmanageable, and insecure. This has necessitated the investigation of an alternate paradigm for system and application design, which is based on strategies used by biologi- cal systems to deal with similar challenges — a vision that has been referred to as autonomic computing. The Autonomic Computing Paradigm has been inspired by the human auto- nomic nervous system. Its overarching goal is to realize computer and soft- ware systems and applications that can manage themselves in accordance with high-level guidance from humans. Autonomic systems are character- ized by their self-* properties including self-configuration, self-healing, self- optimization, and self-protection. Meeting the grand challenges of autonomic computing requires scientific and technological advances in a wide variety of fields, as well as new programming paradigms and software and system architectures that support the effective integration of the constituent tech- nologies. The goal of this handbook, titled “Autonomic Computing: Concepts, Infrastructure and Applications,” is to give a comprehensive overview of the state-of-the-art of this emerging research area, which many believe to be the next paradigm for designing and implementing future computing systems and services. Overview of the Handbook: The handbook is organized into four parts. Part I of the handbook focuses on the “The Autonomic Computing Paradigm” and includes chapters that present the vision, underlying concepts, challenges and requirements, and proposed architectures. In Chapter 1, Alan Ganek provides an overview of autonomic computing and its origins, evolution, and direc- tion. This chapter defines autonomic computing, i.e., creating systems that are self-aware and self-managing to help reduce management complexity, increase availability, and enhance flexibility. Starting from the premise that TEAM LinG P1: Binaya Dash November 13, 2006 10:38 9367 9367˙C000 all systems could, or indeed, should be constructed as autonomic systems, in Chapter 2, David W.Bustard andRoy Sterritt present a requirements engineer- ing perspective of autonomic computing and examine the implications of the requirements of autonomic systems from a software engineering perspective. In Chapter 3, Robbert van Renesse and Kenneth P. Birman argue that auto- nomic systems cannot be built simply by composing autonomic components, but that an autonomic system-wide monitoring and control infrastructure is required as well. In Chapter 4, Manish Parashar investigates the challenges of emerging wide-area Grid environments and applications, and motivates self-management as a means for addressing these challenges. This chapter presents autonomic Grid computing solutions and sample autonomic Grid applications. Finally,in Chapter 5, John Sweitzer and Christine Draperpresent an architecture for autonomic computing and detail its four key aspects, i.e., process definition, resource definition, technical reference architecture, and application patterns. The chapter highlights the fundamental functions of the “autonomic manager” and “touchpoint” building blocks of the architecture, and summarizes an initial set of application patterns commonly found in autonomic computing systems. Parts II and III of this handbook focus on achieving self-* properties in autonomic systems and applications. Part II presents different approaches and infrastructures for enabling autonomic behaviors. In Chapter 6, Tom De Wolf and Tom Holvoet present a taxonomy of self-* properties for decen- tralized autonomic computing systems, and use the taxonomy to guide the design and verification of self-* properties. In Chapter 7, Richard Anthony et al. investigate the use of emergent properties for constructing autonomic systems and realizing self-* properties. In Chapter 8, Sherif Abdelwahed and Nagarajan Kandasamy describes a more formal control theoretic approach using model-based control and optimization strategies to design autonomic computing systems that continually optimize their performance in response to changing workload demands and operating conditions. Since some auto- nomic applications cannot be built from scratch, it is necessary to transpar- ently introduce autonomic behaviors into existing composite systems with- out modifying the existing code. In Chapter 9, S. Masoud Sadjadi and Philip K. McKinley address this requirement and describe transparent shaping to enable dynamic adaptations of existing applications. Chapter 10 addresses the design of self-* systems in which adaptive behavior can be specified as a set of externalized adaptation strategies. In this chapter, Peter Steenkiste and An-Cheng Huang present an architecture that separates service-specific knowledge, represented as a service recipe, from generic functionality, and supports automatic service-specific optimizations of a broad class of services. Part III of the handbook presents core enabling systems, technologies, and services that support the realization of self-* properties in autonomic systems and applications. In Chapter 11, Hua Liu and Manish Parashar et al. describe the Accord programming system that extends existing programming systems to enable the development of self-managing Grid applications by allowing TEAM LinG P1: Binaya Dash November 13, 2006 10:38 9367 9367˙C000 application and system behaviors to be dynamically specified at runtime. In Chapter 12, Thomas Heinis et al. describe a self-configuring composition engine for Grid and Web services that achieves self-configuring, self-tuning, and self-healing behaviors in the presence of varying workloads. Dynamic collaboration among self-managing resourcesis a key requirement for system- level self-management. In Chapter 13, David Chess et al. establish a set of behaviors, interfaces, and patterns of interaction within the Unity system to support such dynamic collaborations. In Chapter 14, Karsten Schwan et al. describe the AutoFlow project designed to meet the critical performance requirements of distributed information flow applications. In Chapter 15, Robert Adams et al. propose an approach for the management of large scale distributed services based on scalable publish-subscribe event systems, scal- able WS-based deployment, and model-based management. The autonomic systems and prototypes described in this handbook have been typically im- plemented through middleware or through OS modifications. As an alter- nate, in Chapter 16, Lenitra Durham et al. investigate autonomic computing support at the hardware/physical layer and describe platform support for autonomics. Part IV, the final part of this handbook, focuses on specific realizations of self-* properties in autonomic systems and applications. Chapter 17, the first chapter in this part, studies how autonomic computing techniques can be used to dynamically allocate servers to application environments in a way that maximizes a global utility function. In this chapter, Daniel A. Menasce et al. present a system that exhibits self-* properties and successfully reallo- cates servers when workload changes and/or when servers fail. Chapter 18 examines how a managed execution environment can be leveraged to sup- port runtime system adaptations. In this chapter, Rean Griffith et al. describe the Kheiron adaptation framework that dynamically attaches/detaches an engine capable of performing reconfigurations and repairs on a target system while it executes. Kheiron remains transparent to the application and does not require recompilation of the application or specially compiled versions of the runtime. In Chapter 19, Arjav Chakravarti et al. describe the Organic Grid, which is a biologically inspired and fully decentralized approach to the organization of computation. Organic Grid is based on the autonomous scheduling of strongly mobile agents on a peer-to-peer network. Efficient and robust data streaming services are a critical requirement of emerging Grid applications, which are based on seamless interactions and coupling between geographically distributed application components. In Chapter 20, Viraj Bhat et al. present the design and implementation of a self-managing data-streaming service based on online control and optimization strategies. In Chapter 21, Bithika Khargharia et al. discuss the construction of an auto- nomic data center using autonomic clusters, servers and device components, and demonstrate autonomic power and performance management for a three tier data center. In Chapter 22, Guofei Jiang et al. propose a novel fault de- tection method based on trace analysis in application servers. The approach uses varied-length n-grams and automata to characterize normal traces and TEAM LinG [...]... IBM Autonomic Computing: IBM’s Perspective on the State of Information Technology http://www.research.ibm.com /autonomic/ manifesto /autonomic_ computing. pdf (accessed Dec 6, 2005) TEAM LinG P1: Binaya Dash September 29, 2006 6 20:41 9367 9367˙C001 Autonomic Computing: Concepts, Infrastructure, and Applications adapted and adjusted as customer demand or market requirements dictate Without autonomic computing, ... (HPDC) and the co-founder of the IEEE International Conference on Autonomic Computing His current research focuses on autonomic computing, self protection and self-healing of networked systems and services, and high performance distributed computing He has co-authored over 200 journal and conference research papers, and is the co-author/editor of three books, Tools and Environments for Parallel and Distributed... Excellence in Research (2004-2005), NSF CAREER Award (1999), and the Enrico Fermi Scholarship from Argonne National Laboratory (1996) His research interests include autonomic computing, parallel and distributed computing (including peer-to-peer and Grid computing) , scientific computing, and software engineering Manish is a senior member of IEEE and of the executive committee of the IEEE Computer Society... tasks within each process Through autonomic computing, an autonomic manager can analyze the request, plan how to choreograph the various tasks in and across each process, and then execute each task in the correct order, automating those tasks appropriately 1.4.1 Relating Autonomic Computing to Grid, Service-Oriented Architecture, and Virtualization Technologies Autonomic computing represents an entirely... 200 technical papers in international journals and conferences, has co-authored/edited over 15 books and proceedings, and has contributed to several others, all in the broad area of computational science and applied parallel and distributed computing Manish received a BE degree in Electronics and Telecommunications from Bombay University, India and MS and Ph.D degrees in Computer Engineering from Syracuse... Based on “Accord: A programming framework for autonomic applications , by H Liu and M Parashar, which appeared in IEEE Transactions on Systems, Man and Cybernetics, Special Issue on Engineering Autonomic Systems, Editors: R Sterritt and T Bapty, IEEE Press, 2005 Based on “Design and Evaluation of an Autonomic Workflow Engine”, by Thomas Heinis, Cesare Pautasso and Gustavo Alonso which appeared in the proceedings... Birman 4 Autonomic Grid Computing: Concepts, Requirements, and Infrastructure 49 Manish Parashar 5 Architecture Overview for Autonomic Computing 71 John W Sweitzer and Christine Draper Part II Self-* Properties — Approaches and Infrastructures 99 6 A Taxonomy for Self-∗ Properties in Decentralized Autonomic Computing ... Autonomic Computing Paradigm TEAM LinG P1: Binaya Dash September 29, 2006 20:41 9367 9367˙C001 TEAM LinG P1: Binaya Dash September 29, 2006 20:41 9367 9367˙C001 1 Overview of Autonomic Computing: Origins, Evolution, Direction Alan Ganek CONTENTS 1.1 Improving Manageability 4 1.2 The Road to Autonomic Computing 6 1.3 Defining an Autonomic Environment 6 1.4 Applying Autonomic Computing. .. IT Service Management 9 1.4.1 Relating Autonomic Computing to Grid, Service-Oriented Architecture, and Virtualization Technologies 10 1.4.1.1 Grid Computing 10 1.4.1.2 Service-Oriented Architecture (SOA) 11 1.4.1.3 Virtualization 11 1.5 Current State of Autonomic Computing 12 1.5.1 Autonomic Computing Architecture 12 1.5.2 Standards 14 1.5.3 Reference Implementations... emerging discipline of autonomic computing We do hope that it will lead to insights into the underlying concepts and issues, current approaches and research efforts, and outstanding challenges of the field, and will inspire further research in this promising area Acknowledgements: This book has been made possible due to the efforts and contributions of many individuals First and foremost, we would like . LinG Autonomic Computing Concepts, Infrastructure, and Applications 9367_FM.indd 1 11/15/06 2:56:45 PM TEAM LinG 9367_FM.indd 2 11/15/06 2:56:45 PM TEAM LinG Autonomic Computing Concepts, Infrastructure, and. trademarks, and are used only for identification and explanation without intent to infringe. Library of Congress Cataloging‑in‑Publication Data Autonomic computing : concepts, infrastructure, and applications. designing and implementing future computing systems and services. Overview of the Handbook: The handbook is organized into four parts. Part I of the handbook focuses on the “The Autonomic Computing