Pro Data Backup and Recovery ■ ■ ■ Steven Nelson www.it-ebooks.info Pro Data Backup and Recovery Copyright © 2011 by Steven Nelson All rights reserved. No part of this work may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying, recording, or by any information storage or retrieval system, without the prior written permission of the copyright owner and the publisher. ISBN-13 (pbk): 978-1-4302-2662-8 ISBN-13 (electronic): 978-1-4302-2663-5 Printed and bound in the United States of America (POD) Trademarked names, logos, and images may appear in this book. Rather than use a trademark symbol with every occurrence of a trademarked name, logo, or image we use the names, logos, and images only in an editorial fashion and to the benefit of the trademark owner, with no intention of infringement of the trademark. The use in this publication of trade names, trademarks, service marks, and similar terms, even if they are not identified as such, is not to be taken as an expression of opinion as to whether or not they are subject to proprietary rights. Publisher and President: Paul Manning Lead Editors: Frank Pohlmann and Michelle Lowman Technical Reviewer: Russell Brown Editorial Board: Steve Anglin, Mark Beckner, Ewan Buckingham, Gary Cornell, Jonathan Gennick, Jonathan Hassell, Michelle Lowman, Matthew Moodie, Jeff Olson, Jeffrey Pepper, Frank Pohlmann, Douglas Pundick, Ben Renow-Clarke, Dominic Shakeshaft, Matt Wade, Tom Welsh Coordinating Editor: Mary Tobin Copy Editor: Nancy Sixsmith Compositor: MacPS, LLC Indexer: Carol Burbo Artist: April Milne Cover Designer: Anna Ishchenko Distributed to the book trade worldwide by Springer Science+Business Media, LLC., 233 Spring Street, 6th Floor, New York, NY 10013. Phone 1-800-SPRINGER, fax 201-348-4505, e-mail orders-ny@springer-sbm.com, or visit www.springeronline.com. For information on translations, please e-mail rights@apress.com, or visit www.apress.com. Apress and friends of ED books may be purchased in bulk for academic, corporate, or promotional use. eBook versions and licenses are also available for most titles. For more information, reference our Special Bulk Sales–eBook Licensing web page at www.apress.com/info/bulksales. The information in this book is distributed on an “as is” basis, without warranty. Although every precaution has been taken in the preparation of this work, neither the author(s) nor Apress shall have any liability to any person or entity with respect to any loss or damage caused or alleged to be caused directly or indirectly by the information contained in this work. www.it-ebooks.info v Contents Contents at a Glance iv About the Author xi About the Technical Reviewer xii Acknowledgments xiIi ■Chapter 1: Introduction to Backup and Recovery 1 Who Should Read this Book? 1 Backup and Recovery Concepts 2 Backups 2 Archives 9 Service and Recovery Objectives: Definitions 13 Summary 16 ■Chapter 2: Backup Software 17 Software: CommVault Simpana 17 History and Background 17 Terminology 17 Symantec NetBackup 28 History and Background 28 NetBackup Master Servers 29 Media Servers 32 Clients 32 Data Flow within the NetBackup Environm ents 33 Summary 35 www.it-ebooks.info ■ CONTENTS vi ■Chapter 3: Physical Backup Media 37 Tape 37 Digital Linear Tape (DLT) 38 Linear Tape Open (LTO) 38 Sun/StorageTek T10000 (T10k) 38 Tape Storage Characteristics 38 Disk 50 RAID 10 50 RAID 5 51 RAID 6 52 RAID Implementation and Disk Perform ance 52 Network Attached Storage (NAS) 59 Summary 65 ■Chapter 4: Virtual Backup Media 67 Virtual Tape Libraries 67 VTL Types 74 Virtual Tape Allocation Models 77 Why VTL? 78 Other Virtualized Media and a Look Ahead 85 ■Chapter 5: New Media Technologies 87 Deduplication 87 Fixed-Block Deduplication 92 Variable-Block Deduplication 93 Data Type Limitations: Media, Mystery, and M other Nature 93 Deduplication Types and Term s 94 Continuous Data Protection/Rem ote Replication 105 Summary 110 ■Chapter 6: Software Architectures—CommVault 111 General Configuration 111 Disk and MagLib types 111 www.it-ebooks.info ■ CONTENTS vii Disk Writers 112 Multiplexing 113 Fill/Spill versus Spill/Fill 114 Storage Policies 115 Data Interface Pairs 116 CommCell with Single Target 116 CommCell with Single MediaAgent 116 Advanced Storage Connectivity 121 CommCell with Multiple MediaAgents 124 Network Resources 125 Storage Resources 130 Multiple CommCells 136 Summary 138 ■Chapter 7: Software Architectures—NetBackup 139 General Configuration 139 Multiplexing/Multistreaming 140 Inline Deduplication (Twinning) 140 Buffer Tuning Parameters 142 SIZE_DATA_BUFFERS/NUMBER_DATA_BUFFERS 142 NET_BUFFER_SZ 143 Creating Secondary Copies (Vault/bpduplicate) 143 Generic Configurations 144 NetBackup Master with a Single Target 144 NetBackup Master with a Single M edia Server 144 NetBackup Master with multiple M edia Servers 151 Multiple Storage Domains 166 Summary 168 ■Chapter 8: Application Backup Strategies 169 General Strategies 169 www.it-ebooks.info ■ CONTENTS viii File Systems 170 Normal File Systems 170 High Density File Systems (HDFSs) 174 Block-Level Backups 175 Source-Based Deduplication 176 File Systems Summary 177 Databases 177 Database Log Backups 178 Locally Controlled Database Backups 178 Pre- and Post-Scripts 178 Snapshot Backups 179 SQL Server 182 Oracle 187 Mail Servers 192 Exchange 192 Lotus Notes 198 Other Applications 199 Virtual Machines 200 Summary 202 ■Chapter 9: Putting It All Together: Sample Backup Environments 203 Cloud/Backup as a Service 203 Security and BaaS 204 BaaS Costs 204 Single Backup Servers 205 Selection of Backup Targets 207 Performance Considerations 210 Client Performance Considerations 212 Single Server/Single Media Writer 214 CommVault MediaAgent Approach 216 Single Master/Multiple Media Writer 218 www.it-ebooks.info ■ CONTENTS ix Deduplication: When and Where? 233 Target Deduplication 234 Source Deduplication 234 Remote Office (RO) Deployments 236 Remote Office (RO) 237 Regional Site (RS) 238 Regional Datacenter (RDC) 239 Remote Office Wrap-Up 244 Long-Distance Backups 244 Transnational Backups 246 Summary 246 ■Chapter 10: Monitoring and Reporting 247 Backup Software 249 Success/Failure 250 Failure Codes 250 Client Backup Speed 250 Amount of Data Protected 251 Count of Current Tape Media 251 Disk Storage Capacity 251 Location of Last Catalog Backup 251 Backup Servers 252 CPU Utilization 252 Memory Utilization 252 Network Utilization 253 Backup Media Utilization 254 Optional Elements 255 Client Performance 255 Network Performance 256 SAN/Disk Performance 257 Deduplication Ratios 259 www.it-ebooks.info ■ CONTENTS x Summary 259 ■ Chapter 11: Summary 261 Good Backup Is Important! 261 Defending Costs 262 One Size Does Not Fit All… 262 ■Index: 265 www.it-ebooks.info iv Contents at a Glance Contents v About the Author xi About the Technical Reviewer xii Acknowledgments xiii ■Chapter 1: Introduction to Backup and Recovery 1 ■Chapter 2: Backup Software 17 ■Chapter 3: Physical Backup Media 37 ■Chapter 4: Virtual Backup Media 67 ■Chapter 5: New Media Technologies 87 ■Chapter 6: Software Architectures—CommVault 111 ■Chapter 7: Software Architectures—NetBackup 139 ■Chapter 8: Application Backup Strategies 169 ■Chapter 9: Putting It All Together: Sample Backup Environments 203 ■Chapter 10: Monitoring and Reporting 247 ■Chapter 11: Summary 261 ■Index 265 www.it-ebooks.info www.it-ebooks.info [...]... Monitoring backup completion and providing basic notifications of errors • Tracking both the backup and media ages and comparing them against retention, expiring backups and media as necessary • Tracking the movement of backup data between pieces of media as well as copies of backup data • Protecting the metadata associated with the CommCell for which it is responsible In addition, the CommServe can, and. .. represent a complete snapshot of the data that is intended to be protected Full backups provide the baseline for all other levels of backup In addition, two different levels of backups capture changes relative to the full backup The differential backup, also known as the cumulative incremental backup, captures backups that have occurred since the last full backup This type of backup is typically used in environments... issue with backups of database systems, but can also affect all types of software applications When architecting backup systems, it is important to consider data to be backed up as well as data that will be archived or stored for long periods Although backups and archives are related, they are distinctly different in character Backups should be used to provide short- and medium-term protection of data for... purposes of restoration in the event of data loss, whereas archives provide long-term storage of data in immutable formats, on static or protected media The data classification is critical for the proper design of backup systems needed to provide the level of protection required by the organization Service and Recovery Objectives: Definitions When designing a backup solution, there are three key measures... INTRODUCTION TO BACKUP AND RECOVERY software that will allow you to build or upgrade backup systems to grow and meet the changing needs of your organization Although these configurations can be applied to many different brands of backup software, this book focuses only on the two major backup vendors: Symantec NetBackup and CommVault Simpana These two vendors represent similar approaches to performing backups,... performing the backups might be able to help increase the backup speed by offloading the backups from the primary storage Other techniques such as using data replication, either application- or array-based, can also provide ways to provide data protection within specified RTO windows The point is to ensure that the data that is the focus of the RTO specification is at least provided initial protection... point of the backup, the CommVault CommServe is the end point The CommServe provides the control functionality needed for all operations within the CommCell, and is responsible for a number of different functions: • Maintaining backup schedules and executing backups on schedule • Managing backup media devices and media inventory/capacity • Managing backup media and allocating media resources to backups... command examples within this book as necessary to illustrate particular use cases, but there is an assumption that the commands used will already be familiar to the reader Backup and Recovery Concepts Backup and recovery is a topic that might seem basic at first glance, but it seems to be a little confusing to many people Backups and archives tend to be used interchangeably, representing some type of data. .. the data rate need to be taken into account but the time for the backup setup and data writing also needs to be taken In the previous example, if there is a requirement to protect the data every 8 hours, but it takes 8.5 hours to back up the data, including media loads and other overhead, the RPO has not been met because there would be 30 minutes of data in the overlap that would not necessarily be protected... devices are available and the backup software used to create the backup to the media can still read the backup, the application that was originally used to create the data will almost certainly not exist or function on existing hardware or operating systems even short time spans removed from the 12 www.it-ebooks.info CHAPTER 1 ■ INTRODUCTION TO BACKUP AND RECOVERY date of the backup creation This typically . Pro Data Backup and Recovery ■ ■ ■ Steven Nelson www.it-ebooks.info Pro Data Backup and Recovery Copyright © 2011 by Steven. Introduction to Backup and Recovery 1 Who Should Read this Book? 1 Backup and Recovery Concepts 2 Backups 2 Archives 9 Service and Recovery Objectives: Definitions 13 Summary 16 ■Chapter 2: Backup Software. common language and understanding of the functions and roles of both backups and archives. ■ Note Where the difference between backups and archives gets particularly confusing is when backups are