e s n ce i el l b a r fe s n a R a siv K A UM tr n Oracle Database no 11g: RAC a s eฺ Administration a h id ) u m co ent G ฺ l i I • Student Guide ma SVolume tud g r@ this m k va use i s to (ss D50311GC11 Edition 1.1 September 2008 D56241 Unauthorized reproduction or distribution prohibitedฺ Copyright© 2009, Oracle and/or its affiliatesฺ Author Copyright © 2008, Oracle All rights reserved James Womack Disclaimer Technical Contributors and Reviewers Christopher Andrews Troy Anthony Lothar Auert Bruce Carter Michael Cebulla Carol Colrain Jonathan Creighton Joel Goodman Arturo Gutierrez Lutz Hartmann Pete Jones David Kirby This document contains proprietary information and is protected by copyright and other intellectual property laws You may copy and print this document solely for your own use in an Oracle training course The document may not be modified or altered in any way Except where your use constitutes "fair use" under copyright law, you may not use, share, download, upload, copy, print, display, perform, reproduce, publish, license, post, transmit, or distribute this document in whole or in part without the express authorization of Oracle The information contained in this document is subject to change without notice If you find any problems in the document, please report them in writing to: Oracle University, 500 Oracle Parkway, Redwood Shores, California 94065 USA This document is not warranted to be error-free Restricted Rights Notice If this documentation is delivered to the United States Government or anyone using the documentation on behalf of the United States Government, the following notice is applicable: e s n ce i el l b a U.S GOVERNMENT RIGHTS The U.S Government’s rights to use, modify, reproduce, release, perform, display, or disclose these training materials are restricted by the terms of the applicable Oracle license agreement and/or the applicable U.S Government contract r fe s n a tr n no Miroslav Lorenc a s eฺ Barb Lundhild a h id ) u Roderick Manalac m co ent G ฺ l Sabiha Miri i ma Stud Philip Newlan g r@ this Roman Niehoff m k Erik Peterson va use i s Stefan Pommerenk to ss ( Marshall Presser AR M URick Pulliam Roland Knapp Trademark Notice Oracle is a registered trademark of Oracle Corporation and/or its affiliates Other names may be trademarks of their respective owners a siv K Srinivas Putrevu Roy Rossebo Ira Singer Linda Smalley Ranbir Singh Harald van Breederode Michael Zoll Editors Raj Kumar Richard Wallis Nita Pavitran Amitha Narayan Graphic Designer Satish Bettegowda Publishers Nita Brozowski Unauthorized or distribution prohibitedฺ Copyright© 2009, Oracle and/or its affiliatesฺ Veenareproduction Narasimhan Contents I Introduction Overview I-2 Course Objectives I-3 Typical Schedule I-4 A History of Innovation I-5 What Is a Cluster? I-6 Oracle Real Application Clusters I-7 Benefits of Using RAC I-8 Clusters and Scalability I-9 Levels of Scalability I-10 Scaleup and Speedup I-11 Speedup/Scaleup and Workloads I-12 I/O Throughput Balanced: Example I-13 Performance of Typical Components I-14 Complete Integrated Clusterware I-15 Necessity of Global Resources I-16 Global Resources Coordination I-17 Global Cache Coordination: Example I-18 Write to Disk Coordination: Example I-19 Dynamic Reconfiguration I-20 Object Affinity and Dynamic Remastering I-21 Global Dynamic Performance Views I-22 Additional Memory Requirement for RAC I-23 Efficient Internode Row-Level Locking I-24 Parallel Execution with RAC I-25 RAC Software Principles I-26 RAC Software Storage Principles I-27 RAC Database Storage Principles I-28 RAC and Shared Storage Technologies I-29 Oracle Cluster File System I-31 Automatic Storage Management I-32 CFS or Raw? I-33 Typical Cluster Stack with RAC I-34 RAC Certification Matrix I-35 R a siv K A UM e s n ce i el l b a r fe s n a tr n no a s eฺ a h id ) u m co ent G ฺ l i ma Stud g r@ this m k va use i s to (ss iii Unauthorized reproduction or distribution prohibitedฺ Copyright© 2009, Oracle and/or its affiliatesฺ RAC and Services I-36 Available Demonstrations I-37 Oracle Clusterware Installation and Configuration Objectives 1-2 Oracle RAC 11g Installation 1-3 Oracle RAC 11g Installation: Outline 1-5 Windows and UNIX Installation Differences 1-6 Preinstallation Tasks 1-7 Hardware Requirements 1-8 Network Requirements 1-9 Virtual IP Addresses and RAC 1-10 RAC Network Software Requirements 1-11 Package Requirements 1-12 Required UNIX Groups and Users 1-13 oracle User Environment 1-14 User Shell Limits 1-15 Configuring for Remote Installation 1-16 Required Directories for the Oracle Database Software 1-18 Linux Operating System Parameters 1-20 Cluster Setup Tasks 1-22 Verifying Cluster Setup with cluvfy 1-23 Installing Oracle Clusterware 1-24 Specifying the Inventory Directory 1-25 Specify Home Details 1-26 Product-Specific Prerequisite Checks 1-27 Cluster Configuration 1-28 Private Interconnect Enforcement 1-29 Oracle Cluster Registry File 1-30 Voting Disk File 1-31 Summary and Install 1-32 Run Configuration Scripts on All Nodes 1-33 End of Installation 1-34 Verifying the Oracle Clusterware Installation 1-35 Summary 1-37 Practice 1: Overview 1-38 R a siv K A UM e s n ce i el l b a r fe s n a tr n no a s eฺ a h id ) u m co ent G ฺ l i ma Stud g r@ this m k va use i s to (ss RAC Software Installation Objectives 2-2 Installing Automatic Storage Management 2-3 Installation Type 2-4 iv Unauthorized reproduction or distribution prohibitedฺ Copyright© 2009, Oracle and/or its affiliatesฺ Install Location 2-5 Hardware Cluster Installation Mode 2-6 Product-Specific Prerequisite Checks 2-7 Select Configuration Option 2-8 Privileged Operating System Groups 2-9 Summary 2-10 Execute Configuration Scripts 2-11 End of Installation 2-12 ASM Configuration 2-13 Creating ASM Disk Groups 2-17 Select a Product to Install 2-19 Select Installation Type 2-20 Install Location 2-21 Specify Cluster Installation 2-22 Products Prerequisite Check 2-23 Select Configuration Option 2-24 Privileged Operating System Groups 2-25 Check Summary 2-26 root.sh Script 2-27 Required Tasks Prior to Database Creation 2-28 Checks Before Database Creation 2-29 Summary 2-31 Practice 2: Overview 2-32 e s n ce i el l b a r fe s n a tr n no a s eฺ a h id ) u m co ent G ฺ l i ma Stud g r@ this m k va use i s to (ss RRAC Database Creation K iva s A UM Objectives 3-2 Management Agent Installation: Specify Installation Type Specify Installation Location 3-4 Specify Cluster Installation Mode 3-5 Prerequisite Check and OMS Location 3-6 Agent Registration Password 3-7 Management Agent Installation Finish 3-8 Executing the root.sh Script 3-9 Creating the Cluster Database 3-10 Node Selection 3-11 Select Database Type 3-12 Database Identification 3-13 Cluster Database Management Method 3-14 Passwords for Database Schema Owners 3-15 Storage Options for Database Files 3-16 ASM Disk Groups 3-18 v 3-3 Unauthorized reproduction or distribution prohibitedฺ Copyright© 2009, Oracle and/or its affiliatesฺ Practice 10: Overview This practice covers the following topics: • Identifying Oracle Clusterware log files • Fixing voting disk corruptions e s n ce i el l b a r fe s n a R a siv K A UM tr n no a s eฺ a h id ) u m co ent G ฺ l i ma Stud g r@ this m k e © 2008, Oracle All rights reserved a Copyright s v i u s to (ss Unauthorized reproduction or distribution prohibitedฺ Copyright© 2009, Oracle and/or its affiliatesฺ Oracle Database 11g: RAC Administration 10 - 17 e s n ce i el l b a r fe s n a R a siv K A UM tr n no a s eฺ a h id ) u m co ent G ฺ l i ma Stud g r@ this m k va use i s to (ss Unauthorized reproduction or distribution prohibitedฺ Copyright© 2009, Oracle and/or its affiliatesฺ ... Oracle and/or its affiliatesฺ RAC and Services I-36 Available Demonstrations I-37 Oracle Clusterware Installation and Configuration Objectives 1-2 Oracle RAC 11g Installation 1-3 Oracle RAC 11g. .. Unauthorized reproduction or distribution prohibitedฺ Copyright© 2009, Oracle and/or its affiliatesฺ Oracle Database 11g: RAC Administration 10 - 17 e s n ce i el l b a r fe s n a R a siv K A UM... for RAC I-23 Efficient Internode Row-Level Locking I-24 Parallel Execution with RAC I-25 RAC Software Principles I-26 RAC Software Storage Principles I-27 RAC Database Storage Principles I-28 RAC