Oracle Warehouse Builder 11g Getting Started Extract, transform, and load data to build a dynamic, operational data warehouse Bob Griesemer BIRMINGHAM - MUMBAI This material is copyright and is licensed for the sole use by Anna Indahl on 12th August 2009 PSC 94 Box 361, , APO, , 09824 Oracle Warehouse Builder 11g: Getting Started Copyright © 2009 Packt Publishing All rights reserved. No part of this book may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, without the prior written permission of the publisher, except in the case of brief quotations embedded in critical articles or reviews. Every effort has been made in the preparation of this book to ensure the accuracy of the information presented. However, the information contained in this book is sold without warranty, either express or implied. Neither the author, nor Packt Publishing and its dealers and distributors will be held liable for any damages caused or alleged to be caused directly or indirectly by this book. Packt Publishing has endeavored to provide trademark information about all of the companies and products mentioned in this book by the appropriate use of capitals. However, Packt Publishing cannot guarantee the accuracy of this information. First published: August 2009 Production Reference: 1300709 Published by Packt Publishing Ltd. 32 Lincoln Road Olton Birmingham, B27 6PA, UK. ISBN 978-1-847195-74-6 www.packtpub.com Cover Image by Parag Kadam (paragvkadam@gmail.com) This material is copyright and is licensed for the sole use by Anna Indahl on 12th August 2009 PSC 94 Box 361, , APO, , 09824 Download at Boykma.Com Credits Author Bob Griesemer Reviewers Anitha Kadaru Yasodarani Venkatesan Acquisition Editor James Lumsden Development Editor Swapna V. Verlekar Technical Editors Arani Roy Reshma Sundaresan Copy Editor Sneha Kulkarni Editorial Team Leader Abhijeet Deobhakta Project Team Leader Lata Basantani Project Coordinators Ashwin Shetty Neelkanth Mehta Indexer Rekha Nair Proofreader Chris Smith Production Coordinator Adline Swetha Jesuthas Cover Work Adline Swetha Jesuthas This material is copyright and is licensed for the sole use by Anna Indahl on 12th August 2009 PSC 94 Box 361, , APO, , 09824 Download at Boykma.Com About the Author Bob Griesemer has over 27 years of software and database engineering/DBA experience in both government and industry, solving database problems, designing and loading data warehouses, developing code, leading teams of developers, and satisfying customers. He has been working in various roles involving database development and administration with the Oracle Database with every release since Version 6 of the database from 1993 to the present. He has also been performing various tasks, including data warehouse design and implementation, administration, backup and recovery, development of Perl code for web-based database access, writing Java code utilizing JDBC, migrating legacy databases to Oracle, and developing Developer/2000 Oracle Forms applications. He is currently an Oracle Database Administrator Certied Associate, and is employed by the Northrop Grumman Corporation, where he is the Senior Database Engineer and primary data warehouse ETL specialist for a large data warehouse project. I would like to thank my two co-workers, Anitha Kadaru and Yasodarani Venkatesan, who were kind enough to review this book. With their wealth of knowledge of data warehousing and Business Intelligence, they provided invaluable comments that helped me keep the book on track. I'd like to thank David Allan of the Oracle Warehouse Builder development team at Oracle for putting up with my numerous questions and requests for clarication about various aspects of the software. Lastly and most importantly, I'd like to thank my wife Lynn and children Robby, Melanie, Hilary, Christina, Millie, and Mikey for doing without a husband and dad for major periods of time over the last year, while I worked on this book. Your understanding and support has been a big help! This material is copyright and is licensed for the sole use by Anna Indahl on 12th August 2009 PSC 94 Box 361, , APO, , 09824 Download at Boykma.Com About the Reviewers Anitha Kadaru is employed with Northrop Grumman and has more than 12 years of experience in leading and supporting Information Technology (IT) development, including 10 years of experience of directly supporting the Decision Support Systems (DSS). She provides expertise in a broad range of Common Off-The-Shelf (COTS) applications for Business Intelligence (BI), data integration, and data architectures, and she is expert in all phases of system lifecycle development for the DSS applications. She has in-depth technical knowledge and exceptional analytical skills with implementing the COTS solutions in data warehousing, the ETL, and the BI technical areas. She has expertise in data engineering with years of data analysis, data design, dimensional modeling, and data management expertise. Yasodarani Venkatesan is employed by Northrop Grumman as a Data Warehouse Analyst on a Healthcare project. In the past 11 years, she has worked on several large and small data warehousing projects in sales, logistics, nance, healthcare, and HR domain areas. She has expertise in designing and modeling star and snowake schema design, designing and implementing the ETL processes for converting/transforming data, designing and implementing metadata layers in the Business Intelligence (BI) applications, and quality assurance. This material is copyright and is licensed for the sole use by Anna Indahl on 12th August 2009 PSC 94 Box 361, , APO, , 09824 Download at Boykma.Com This material is copyright and is licensed for the sole use by Anna Indahl on 12th August 2009 PSC 94 Box 361, , APO, , 09824 Download at Boykma.Com Table of Contents Preface 1 Chapter 1: An Introduction to Oracle Warehouse Builder 7 Introduction to data warehousing 7 Introduction to our ctional organization 8 What is a data warehouse? 8 Where does OWB t in? 10 Installation of the database and OWB 11 Downloading the Oracle software 11 A word about hardware and operating systems 12 Installing Oracle database software 13 Conguring the listener 18 Creating the database 20 Installing the OWB standalone software 28 OWB components and architecture 32 Conguring the repository and workspaces 35 Summary 42 Chapter 2: Dening and Importing Source Data Structures 43 Preliminary analysis 44 ACME Toys and Gizmos source data 44 The POS transactional source database 45 The web site order management database 48 An overview of Warehouse Builder Design Center 50 Importing/dening source metadata 54 Creating a project 55 Creating a module 55 Creating an Oracle Database module 56 Creating a SQL Server database module 61 This material is copyright and is licensed for the sole use by Anna Indahl on 12th August 2009 PSC 94 Box 361, , APO, , 09824 Download at Boykma.Com Table of Contents [ ii ] Importing source metadata from a database 76 Dening source metadata manually with the Data Object Editor 84 Importing source metadata from les 89 Summary 102 Chapter 3: Designing the Target Structure 103 Data warehouse design 103 Dimensional design 104 Cube and dimensions 104 Implementation of a dimensional model in a database 106 Relational implementation (star schema) 106 Multidimensional implementation (OLAP) 109 Designing the ACME data warehouse 110 Identifying the dimensions 110 Designing the cube 111 Data warehouse design in OWB 114 Creating a target user and module 114 Create a target user 115 Create a target module 118 OWB design objects 120 Summary 122 Chapter 4: Creating the Target Structure in OWB 123 Creating dimensions in OWB 123 The Time dimension 124 Creating a Time dimension with the Time Dimension Wizard 126 The Product dimension 133 Product Attributes (attribute type) 133 Product Levels 134 Product Hierarchy (highest to lowest) 134 Creating the Product dimension with the New Dimension Wizard 135 The Store dimension 142 Store Attributes (attribute type), data type and size, and (Identier) 142 Store Levels 142 Store Hierarchy (highest to lowest) 142 Creating the Store dimension with the New Dimension Wizard 143 Creating a cube in OWB 145 Creating a cube with the wizard 145 Using the Data Object Editor 149 Summary 154 Chapter 5: Extract, Transform, and Load Basics 155 ETL 156 Manual ETL processes 156 Staging 157 This material is copyright and is licensed for the sole use by Anna Indahl on 12th August 2009 PSC 94 Box 361, , APO, , 09824 Download at Boykma.Com Table of Contents [ iii ] To stage or not to stage 158 Conguration of a staging area 159 Mappings and operators in OWB 160 The canvas layout 165 OWB operators 168 Source and target operators 170 Data ow operators 172 Pre/post-processing operators 175 Summary 176 Chapter 6: ETL: Putting it Together 177 Designing and building an ETL mapping 177 Designing our staging area 178 Designing the staging area contents 178 Building the staging area table with the Data Object Editor 179 Designing our mapping 186 Review of the Mapping Editor 186 Creating a mapping 187 Summary 212 Chapter 7: ETL: Transformations and Other Operators 213 STORE mapping 214 Adding source and target operators 214 Adding Transformation Operators 217 Using a Key Lookup operator 227 Creating an external table 228 Creating and loading a lookup table 229 Retrieving the key to use for a Lookup Operator 233 Adding a Key Lookup operator 238 PRODUCT mapping 242 SALES cube mapping 245 Dimension attributes in the cube 246 Measures and other attributes in the cube 249 Mapping values to cube attributes 250 Mapping measures' values to a cube 250 Mapping PRODUCT and STORE dimension values to the cube 251 Mapping DATE_DIM values to the cube 252 Features and benets of OWB 258 Summary 259 Chapter 8: Validating, Generating, Deploying, and Executing Objects 261 Validating 262 Validating in the Design Center 262 Validating from the editors 264 This material is copyright and is licensed for the sole use by Anna Indahl on 12th August 2009 PSC 94 Box 361, , APO, , 09824 Download at Boykma.Com Table of Contents [ iv ] Validating in the Data Object Editor 265 Validating in the Mapping Editor 266 Generating 270 Generating in the Design Center 270 Generating from the editors 275 Generating in the Data Object Editor 276 Generating in the Mapping Editor 277 Deploying 282 The Control Center Service 283 Deploying in the Design Center and Data Object Editor 284 The Control Center Manager 288 The Control Center Manager window overview 289 Deploying in the Control Center Manager 298 Executing 300 Deploying and executing remaining objects 303 Deployment Order 304 Execution order 306 Summary 307 Chapter 9: Extra Features 309 Additional editing features 310 Metadata change management 310 Recycle Bin 310 Cut, copy, and paste 313 Snapshots 318 Metadata Loader (MDL) exports and imports 326 Synchronizing objects 331 Changes to tables 332 Changes to dimensional objects and auto-binding 339 Warehouse Builder online resources 343 Summary 344 Index 345 This material is copyright and is licensed for the sole use by Anna Indahl on 12th August 2009 PSC 94 Box 361, , APO, , 09824 Download at Boykma.Com [...]... to get started, the Oracle Warehouse Builder is a great application to use to build your warehouse The Oracle Warehouse Builder (OWB) is a tool provided by Oracle that can be used at every stage of the implementation of a data warehouse right from the initial design and creation of the table structure to ETL and data-quality auditing We will build a basic data warehouse using Oracle Warehouse Builder. .. Introduction to Oracle Warehouse Builder A word about hardware and operating systems When installing software of this magnitude, we have to decide whether we'll have to buy additional hardware and a different operating system to run the database and OWB OWB will run in the following databases: • • • • Oracle Database 11g R1 Standard Edition Oracle Database 11g R1 Enterprise Edition Oracle Database 10g... APO, , 09824 An Introduction to Oracle Warehouse Builder We are installing the full database, which now automatically includes the Warehouse Builder client and database components If we had an older version of the database (10g R2 for example) that did not include the Warehouse Builder software, or if we wanted to run the client on a different workstation than where the database software is installed,... information on data warehouses, but you can read any number of other books for much more detailed material on the topic Our purpose in this book is to introduce the Oracle Warehouse Builder and use it to design and build our first data warehouse So, let's see how it fits in to this discussion of data warehousing Where does OWB fit in? The Oracle Warehouse Builder is a tool provided by Oracle, which can... is Oracle' s feature for databases for automatically managing the layout and storage of database files on the system These are both topics for a more advance book on the Oracle Database We will be creating a database using an existing template 2 This step will offer the following three options for a database template to select: °° General Purpose or Transaction Processing °° Custom Database °° Data Warehouse. .. but for production-ready data warehouses a database configured specifically as a data warehouse should be used 3 This step of the database creation will ask for a database name The name of the database must be one to eight characters in length Any more than that will generate an error when trying to proceed to the next screen This is an Oracle database limitation The database name can also include... APO, , 09824 An Introduction to Oracle Warehouse Builder If this database is being created for business use, a good naming scheme would reflect the purpose of the database Since we're creating this database for the data warehouse of ACME Toys and Gizmos Company, we'll choose a name that reflects this—ACME for the company name and DW for data warehouse, resulting in a database name of ACMEDW It is important... writing Oracle Database 11g Release 1—and the corresponding version of OWB that (as of this release) is included with the database install If you have that version of the database installed already, you can skip this section and move right on to the next If not, then keep reading as we discuss the installation of the database software Downloading the Oracle software We can download the Oracle database. .. to Oracle Warehouse Builder To change or not change the default listener port Putting aside the annoyance, the Oracle people might have to suffer as there are valid security reasons why we might want to change that port number Since it is so common, the people accustomed to working with the Oracle database aren't the only people who know that port number Hackers looking to break into an Oracle database. .. configured, but we have not created a database We chose not to install the starter database because that defaults to a general purpose transactional database, and we want one that is oriented toward a data warehouse We can install a new database using Database Configuration Assistant, which Oracle provides to walk us step-by-step through the process of creating a database It is launched from the Windows . and need a way to get started, the Oracle Warehouse Builder is a great application to use to build your warehouse. The Oracle Warehouse Builder (OWB) is a tool provided by Oracle that can be used. the sole use by Anna Indahl on 12th August 2009 PSC 94 Box 361, , APO, , 09824 Oracle Warehouse Builder 11g: Getting Started Copyright © 2009 Packt Publishing All rights reserved. No part of this. Oracle Warehouse Builder 11g Getting Started Extract, transform, and load data to build a dynamic, operational data warehouse Bob Griesemer BIRMINGHAM -