1309 SQL server 2012 data integration recipes

1K 478 0
1309 SQL server 2012 data integration recipes

Đang tải... (xem toàn văn)

Tài liệu hạn chế xem trước, để xem đầy đủ mời bạn chọn Tải xuống

Thông tin tài liệu

... loading data from these sources into SQL Server There are a number of ways in which data can be pushed or pulled from MS Office sources into SQL Server These include: • Using T -SQL (OPENDATASOURCE... (C: SQL2 012DIRecipesCH01AddExcelLinkedServer .Sql) : EXECUTEmaster.dbo.sp_addlinkedserver @SERVER = 'Excel' ,@SRVPRODUCT = 'ACE 12.0' ,@PROVIDER = 'Microsoft.ACE.OLEDB.12.0' ,@DATASRC = 'C: SQL2 012DIRecipesCH01CarSales.xlsx'... the source data, only using the linked server name and worksheet (or range) name in four-part notation using a T -SQL snippet like (C: SQL2 012DIRecipesCH01SelectEXcelLinkedServer .Sql) : SELECT

Ngày đăng: 11/07/2018, 16:58

Từ khóa liên quan

Mục lục

  • SQL Server 2012 Data Integration Recipes

    • Contents at a Glance

    • Contents

    • About the Author

    • About the Technical Reviewers

    • Acknowledgments

    • Introduction

    • Chapter 1: Sourcing Data from MS Office Applications

      • 1-1. Ensuring Connectivity to Access and Excel

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 1-2. Importing Data from Excel

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 1-3. Modifying Excel Data During a Load

        • Problem

        • Solution

          • Querying the Source Data

          • Altering the Destination Table Name

          • Replacing the Data in the Destination Table

          • Enabling Identity Insert

          • Adjusting Column Mappings

          • Changing Field Types for New Tables

          • Creating an SQL Server Integration Services (SSIS) Package from the Import/Export Wizard

        • How It Works

        • Hints, Tips, and Traps

      • 1-4. Specifying the Excel Data to Load During an Ad-Hoc Import

        • Problem

        • Solution

        • How It Works

      • 1-5. Planning for Future Use of a Linked Server

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 1-6. Reading Data Automatically from an Excel Worksheet

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 1-7. Loading Excel Data as Part of a Structured ETL Process

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 1-8. Importing Excel 2007/2010 Data Using SSIS 2005

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 1-9. Handling Source Data Issues When Importing Excel Worksheets Using SSIS

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 1-10. Pushing Access Data into SQL Server

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 1-11. Importing Multiple Access Tables

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 1-12. Ad Hoc Imports of Access Data

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 1-13. Obtaining Access Data Without Regular Imports

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 1-14. Importing Access Data as Part of a Regular ETL Process

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 1-15. Convert a Complex Access Database to SQL Server

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 1-16. Resolving Complex Data Migration Problems During an Access to SQL Server Upgrade

        • Problem

        • Solution

          • Use SSMA to Alter Data Types

          • Use SSMA to Migrate Data for a Single Table

          • Use SSMA to Create a Report on a Table or Tables

          • Use SSMA to Apply Custom Data Type Mapping for a Project

          • Use SSMA to Create T-SQL Scripts of Destination Tables

          • Use SSMA to Find All the Access Databases on Any Drives to Which Your Computer is Connected

        • How It Works

        • Hints, Tips, and Traps

      • Summary

    • Chapter 2: Flat File Data Sources

      • 2-1. Importing Data From a Text File

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 2-2. Importing a Delimited Text File

        • Problem

        • Solution

        • How It Works

      • 2-3. Automatically Determining Data Types

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 2-4. Importing Fixed-Width Text Files

        • Problem

        • Solution

        • How It Works

      • 2-5. Importing Text Files Using T-SQL

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 2-6. Mapping a Source File

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 2-7. Importing Data Using T-SQL in Anticipation of Using a Linked Server

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 2-8. Accessing a Text File As a Linked Server Table

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 2-9. Importing Flat Files from the Command Line

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 2-10. Importing Large Text Files Using T-SQL and Putting the Emphasis on Speed

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 2-11. Creating a Format File for Complex Flat File Loads Using Bulk Insert or BCP

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 2-12. Performing a BULK INSERT with a Format File

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 2-13. Loading a Text File Fast Using T-SQL

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 2-14. Executing BULK INSERT from SSIS

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 2-15. Handling Complex Flat File Formats with a Row Prefix in SSIS

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 2-16. Pre-Parsing and Staging File Subsets in SSIS

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 2-17. Handling Irregular Numbers of Columns in the Source File Using SQL Server 2012

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 2-18. Handling Embedded Qualifiers in SQL Server 2012

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 2-19. Handling Irregular Numbers of Columns in the Source File in SQL Server 2005 and 2008

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 2-20. Determining the Number of Columns in a Source File

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 2-21. Preparing CSV Files for Import

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • Summary

    • Chapter 3: XML Data Sources

      • 3-1. Loading XML Files for Storage in SQL Server

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 3-2. Loading XML Data into Rows and Columns

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 3-3. Shredding an XML File into an SQL Server Table

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 3-4. Importing XML Data as Part of an ETL Process

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 3-5. Importing Complex XML Files

        • Problem

        • Solution

        • How It Works

      • 3-6. Importing Multiple XML Files into SQL Server

        • Problem

        • Solution

        • How It Works

      • 3-7. Flattening an XML File to Prepare It for Import

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 3-8. Importing XML Data from Very Large Files, Putting a Priority on Speed

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 3-9. Loading Multiple Tables at Once from a Single XML Source File

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 3-10. Loading and Shredding Relational Tables from an XML Source File

        • Problem

        • Solution

        • How It Works

      • 3-11. Overcoming Bulk Loading Challenges for XML Files

        • Problem

        • Solution

        • How It Works

      • 3-12. Running SQLXML Bulk Loader As Part of a Regular ETL Process

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 3-13. Validating an XML Document Against a Schema File As Part of a Scripted Solution

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 3-14. Validating an XML Document Against a Schema File in SSIS

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • Summary

    • Chapter 4: SQL Databases

      • Preamble: Installing and Configuring OLEDB and ODBC Providers

        • Network and Firewall issues

        • Database Security

        • Data Type Mapping

      • 4-1. Configuring Your Server to Connect to Oracle

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 4-2. Importing Data from Oracle As a Regular Process

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 4-3. Accelerating Oracle Data Import

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 4-4. Importing Oracle Data on an “Ad Hoc” Basis

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 4-5. Migrating Multiple Oracle Tables and Views

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 4-6. Loading DB2 Data on a Regular Basis

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 4-7. Importing DB2 Data Without SSIS

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 4-8. Sourcing Data from MySQL on a Regular Basis

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 4-9. Importing MySQL Data on an “Ad Hoc” Basis

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 4-10. Importing MySQL Data Using SSIS 2005 and 2008

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 4-11. Migrating Complete Tables from MySQL

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 4-12. Loading Data from Sybase Adaptive Server Enterprise (ASE)

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 4-14. Importing Sybase ASE Data on an “Ad Hoc” Basis

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 4-15. Importing Sybase ASE Data on a Regular Basis

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 4-16. Loading Teradata Data

        • Problem

        • Solution

        • How It Works

      • 4-17. Sourcing Data from PostgreSQL

        • Problem

        • Solution

        • How It Works

      • Summary

    • Chapter 5: SQL Server Sources

      • 5-1. Loading Ad Hoc Data from Other SQL Server Instances

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 5-2. Reading Data from Another SQL Server Instance over a Permanent Connection

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 5-3. Loading Large Data Sets Using T-SQL

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 5-4. Load Data Exported from SQL Server from the Command Line

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 5-5. Loading SQL Server Data from a Native SQL Server File

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 5-6. Transferring Data Between SQL Server Databases Regularly

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 5-7. Porting a Tiny Amount of Data Between SQL Server Databases

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 5-8. Copying and Pasting Between Tables

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 5-9. Loading Data as Fast as Possible in an ETL Process

        • Problem

        • Solution

        • How It Works

      • 5-10. Importing and Exporting All the Tables in a Database

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 5-11. Loading Data from Different Versions of SQL Server

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 5-12. Copying Entire Databases

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 5-13. Transferring a Complex Subset of Data Between Databases

        • Problem

        • Solution

        • How It Works

      • 5-14. Loading Data into SQL Server Azure Interactively

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 5-15. Loading Data into SQL Server Azure as Part of a Regular ETL Process

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 5-16. Loading Data into SQL Server Azure from the Command Line

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 5-17. Loading Ad Hoc Data into SQL Server Azure

        • Problem

        • Solution

        • How It Works

      • 5-18. Transferring Tables Between Databases

        • Problem

        • Solution

        • How It Works

      • Summary

    • Chapter 6: Miscellaneous Data Sources

      • 6-1. Importing Data from SQL Server Analysis Services

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 6-2. Importing Data from an Analysis Services Cube on a Regular Basis

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 6-3. Querying an OLAP Source on an Ad Hoc Basis

        • Problem

        • Solution

        • How It Works

      • 6-4. Loading Images and Documents into an SQL Server Table

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 6-5. Importing Multiple Files into an SQL Server Table

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 6-6. Importing Files into SQL Server on a Regular Basis

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 6-7. Importing Files with Their Attributes into SQL Server

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 6-8. Loading Visual FoxPro Files

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 6-9. Importing Data from dBase

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 6-10. Loading Data from Web Services

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 6-11. Importing Windows Management Instrumentation Data

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 6-12. Importing Data over ODBC

        • Problem

        • Solution

          • ODBC in SSIS 2012

          • Configuring an ODBC DSN

          • File DSNs

          • File DSNs in SSIS 2012

          • ODBC and SSIS 2005/2008

          • File DSNs in SSIS 2005/2008

          • “DSN-less” ODBC Connections

          • Exporting and Importing System and User DSNs

        • How It Works

        • Hints, Tips, and Traps

      • 6-13. Linking to 32-bit data sources from a 64-bit SQL Server

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • Summary

    • Chapter 7: Exporting Data from SQL Server

      • 7-1. Exporting Data Occasionally in Various Formats

        • Problem

        • Solution

        • How It Works

        • A Few Variations on the Theme of the Export Wizard

          • SQL Statement

          • Flat File

          • Excel

          • Access

          • Relational Databases

          • Column Mappings

        • Hints, Tips, and Traps

      • 7-2. Exporting Data As a Delimited Text File

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 7-3. Exporting Data to a Fixed-Width Text File

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 7-4. Exporting Text Files from the Command Line

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 7-5. Exporting Data Using BCP Without Recourse to the Command Line

        • Problem

        • Solution

          • Running BCP from SSIS

          • Running BCP from SQL Server Agent

        • How It Works

        • Hints, Tips, and Traps

      • 7-6. Exporting Data As Text Files from T-SQL

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 7-7. Exporting Data to Another SQL Server Database

        • Problem

        • Solution

        • How It Works

      • 7-8. Exporting Text Files Regularly from T-SQL

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 7-9. Exporting and Compressing Multiple Tables

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 7-10. Exporting a Tiny Dataset As XML

        • Problem

        • Solution

        • How It Works

      • 7-11. Exporting a Larger Dataset As XML

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 7-12. Exporting Large Datasets As XML

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 7-13. Creating an XML Schema

        • Problem

        • Solution

        • How It Works

      • 7-14. Shaping XML Export Data

        • Problem

        • Solution

          • No Highest-Level Element Name

          • Defining the Highest-Level Element Name

          • Adding a ROOT Element

          • Defining Attributes

          • Outputting More Complex Nested XML

        • How It Works

      • 7-15. Exporting XML Data on a Regular Basis

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 7-16. Routinely Exporting Small XML Datasets

        • Problem

        • Solution

        • How It Works

      • 7-17. Exporting Data to Excel Using T-SQL

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 7-18. Exporting Data to Access Using T-SQL

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 7-19. Exporting Data Securely to Excel from T-SQL

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 7-20. Exporting Data Securely to Access from T-SQL

        • Problem

        • Solution

        • Hints, Tips, and Traps

      • 7-21. Exporting Data to Excel Using SSIS

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 7-22. Exporting Data to Access Using SSIS

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 7-23. Pulling Data from Office Applications

        • Problem

        • Solution

          • Linking Excel to SQL Server Databases

          • Access Linked or Imported Tables

          • Linking Word to SQL Server

          • Using PowerPivot

        • How It Works

        • Hints, Tips, and Traps

      • 7-24. Exporting Files Stored in SQL Server Using T-SQL

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 7-25. Exporting Files Stored in SQL Server on a Regular Basis

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 7-26. Exporting Data from SSAS Using T-SQL on an Occasional Basis

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 7-27. Exporting Data from SSAS Using T-SQL on a More Regular Basis

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 7-28. Exporting an SSAS Dimension Using SSIS

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 7-29. Exporting the Result of an MDX Query in SSIS

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 7-30. Exporting Data to Other Relational Databases Using T-SQL

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 7-31. Exporting Data to Other Relational Databases Using SSIS

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 7-32. Exporting Data from SQL Server Azure

        • Problem

        • Solution

          • Using SSIS

          • Using BCP

          • Using the Import/Export Data Wizard

        • How It Works

        • Hints, Tips, and Traps

      • Summary

    • Chapter 8: Metadata

      • 8-1. Listing Available Tables from a Linked Server

        • Problem

        • Solution

        • How It Works

      • 8-2. Listing the Columns Available When Using a Linked Server

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 8-3. Discovering Flat File Metadata

        • Problem

        • Solution

        • How It Works

      • 8-4. Returning Simple SQL Server Metadata

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 8-5. Gathering Tailored SQL Server Metadata

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 8-6. Analyzing SQL Server Table Metadata

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 8-7. Analyzing SQL Server Column Metadata

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 8-8. Displaying Microsoft Access Metadata

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 8-9. Reading MySQL Metadata

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 8-10. Displaying Oracle Metadata from SSIS

        • Problem

        • Solution

        • How It Works

      • 8-11. Querying Oracle Metadata Using T-SQL

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 8-12. Understanding the Oracle Data Dictionary

        • Problem

        • Solution

          • Core Column Data

          • Constraints

          • Primary Keys

          • Indexes

          • Referential Integrity Constraints

          • Triggers

        • How It Works

      • 8-13. Displaying DB2 Metadata

        • Problem

        • Solution

        • How It Works

      • 8-14. Obtaining SQL Server Metadata Using .NET

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • Summary

    • Chapter 9: Data Transformation

      • 9-1. Converting Data Types

        • Problem

        • Solution

        • How It Works

      • 9-2. Removing Duplicates from Data

        • Problem

        • Solution

        • How It Works

      • 9-3. Deduplicating Large Recordsets

        • Problem

        • Solution

        • How It Works

      • 9-4. Deduplicating Data in an ETL Data Flow

        • Problem

        • Solution

        • How It Works

      • 9-5. Subsetting Column Data Using T-SQL

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 9-6. Generating Fixed-Length Column Data Subsets Using SSIS

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 9-7. Generating Variable-Length Column Data Subsets

        • Problem

        • Solution

        • How It Works

      • 9-8. Concatenating Source Data Using T-SQL

        • Problem

        • Solution

        • How It Works

      • 9-9. Concatenating Data Using SSIS

        • Problem

        • Solution

        • How It Works

      • 9-10. Duplicating Columns

        • Problem

        • Solution

        • How It Works

      • 9-11. Converting Strings to Uppercase or Lowercase

        • Problem

        • Solution

        • How It Works

      • 9-12. Converting Strings to Title Case

        • Problem

        • Solution

          • Title Case Using SSIS

          • Title Case Using T-SQL

        • How It Works

        • Hints, Tips, and Traps

      • 9-13. PIVOTing Data in T-SQL

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 9-14. Pivoting Data in SSIS with SQL Server 2012

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 9-15. Pivoting Data in SSIS with SQL Server 2005 and 2008

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 9-16. Consolidating Multiple Identical Data Sources in T-SQL

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 9-17. Consolidating Multiple Identical Data Sources in SSIS

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 9-18. Normalizing Data Inside a Single Table Using T-SQL

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 9-19. Normalizing Data Inside a Single Table Using SSIS

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 9-20. Normalizing Data into Multiple Relational Tables Using T-SQL

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 9-21. Normalizing Data into Multiple Relational Tables Using SSIS

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 9-22. Denormalizing Data by Referencing Lookup Tables in T-SQL

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 9-23. Denormalizing Data by Referencing Lookup Tables in SSIS

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 9-24. Processing Type 1 Slowly Changing Dimensions (SCDs) Using T-SQL

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 9-25. Handling Type 2 Slowly Changing Dimensions in T-SQL

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 9-26. Handling Type 2 Slowly Changing Dimensions with SSIS

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 9-27. Handling Type 3 Slowly Changing Dimensions Using T-SQL

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 9-28. Handling Type 4 Slowly Changing Dimensions Using T-SQL

        • Problem

        • Solution

        • How It Works

      • 9-29. Handling Type 4 Slowly Changing Dimensions with SSIS

        • Problem

        • Solution

        • How It Works

      • 9-30. Cleansing Data As Part of an ETL Process

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • Summary

    • Chapter 10: Data Profiling

      • 10-1. Profiling Data Attributes

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 10-2. Profiling Domain and Value Distribution

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 10-3. Profiling External Data

        • Problem

        • Solution

        • How It Works

      • 10-4. Profiling External Data Faster

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 10-5. Running and Logging a Complete DataProfile

        • Problem

        • Solution

        • How It Works

      • 10-6. Profiling Data Quickly in SSIS

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 10-7. Creating Custom Data Profiles with SSIS

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 10-8. Using the SSIS Data Profiling Task on non-SQL Server Data Sources

        • Problem

        • Solution

        • How It Works

      • 10-9. Reading Profile Data

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 10-10. Storing SSIS Profile Data in a Database

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 10-11. Tailoring Specific Source Data Profiles in SSIS

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 10-12. Domain Analysis in SSIS

        • Problem

        • Solution

        • Hints, Tips, and Traps

      • 10-13. Performing Multiple Domain Analyses

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 10-14. Pattern Profiling in a Data Flow

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 10-15. Pattern Profiling Using T-SQL

        • Problem

        • Solution

        • How It Works

      • 10-16. Profiling Data Types

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 10-17. Controlling Data Flow via Profile Metadata

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • Summary

    • Chapter 11: Delta Data Management

      • Preamble: Why Bother with Delta Data?

      • Delta Data Approaches

        • Detecting Changes at Source

        • Detecting Changes During the ETL Load

      • 11-1. Loading Delta Data as Part of a Structured ETL Process

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 11-2. Loading Data Changes Using a Linked Server

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 11-3. Loading Data Changes From a Small Source Table as Part of a Structured ETL Process

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 11-4. Detecting and Loading Delta Data Only

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 11-5. Performing Delta Data Upserts with Other SQL Databases

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 11-6. Handling Data Changes Without Writing to the Source Server

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 11-7. Detecting Data Changes with Limited Source Database Access

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 11-8. Detecting and Loading Delta Data Using T-SQL and a Linked Server When MERGE Is Not Practical

        • Problem

        • Solution

        • How It Works

      • 11-9. Detecting, Logging, and Loading Delta Data

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 11-10. Detecting Differences in Rowcounts, Metadata, and Column Data

        • Problem

        • Solution

          • Metadata and Rowcounts

          • Row Differences

          • Column Differences

          • Create a T-SQL Script to Make the Destination Table Identical to the Source Table

        • How It Works

        • Hints, Tips, and Traps

      • Summary

    • Chapter 12: Change Tracking and Change Data Capture

      • 12-1. Detecting Source Table Changes with Little Overhead and No Custom Framework

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 12-2. Pulling Changes into a Destination Table with Change Tracking

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • Using Change Tracking as Part of a Structured ETL Process

        • Problem

        • Solution

        • How It Works

      • 12-4. Detecting Changes to Source Data Using the SQL Server Transaction Log

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 12-5. Applying Change Data Capture with SSIS

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 12-6. Using Change Data Capture with Oracle Source Data

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • Summary

    • Chapter 13: Organising And Optimizing Data Loads

      • 13-1. Loading Multiple Files

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 13-2. Selecting Multiple Text Files to Import

        • Problem

        • Solution

        • How It Works

        • Hints, Tips and Traps

      • 13-3. Loading Multiple Files Using Complex Selection Criteria

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 13-4. Ordering and Filtering File Loads

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 13-5. Loading Multiple Flat Files in Parallel

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 13-6. Loading Source Files with Load Balancing

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 13-7. Loading Data to Parallel Destinations

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 13-8. Using a Single Data File As a Multiple Data Source for Parallel Destination Loads

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 13-9. Reading and Writing Data from a Database Source in Parallel

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 13-10. Inserting Records in Parallel and in Bulk

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 13-11. Creating Self-Optimizing Parallel Bulk Inserts

        • Problem

        • Solution

        • How It Works

      • 13-12. Loading Files in Controlled Batches

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 13-13. Executing SQL Statements and Procedures in Parallel Using SSIS

        • Problem

        • Solution

        • How It Works

      • 13-14. Executing SQL Statements and Procedures in Parallel Without SSIS

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 13-15. Executing SQL Statements and Procedures in Parallel Using SQL Server Agent

        • Problem

        • Solution

        • Hints, Tips, and Traps

      • Summary

    • Chapter 14: ETL Process Acceleration

      • 14-1. Accelerating SSIS Lookups

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 14-2. Disabling and Rebuilding Nonclustered Indexes in a Destination Table

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 14-3. Persisting Destination Database Index Metadata

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 14-4. Scripting and Executing DROP Statements for Destination Database Indexes

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 14-5. Scripting and Executing CREATE Statements for Destination Database Indexes

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 14-6. Storing Metadata, and Then Scripting and Executing DROP and CREATE Statements for Destination Database XML Indexes

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 14-7. Finding Missing Indexes

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 14-8. Managing Check Constraints

        • Problem

        • Solution

        • How It Works

      • 14-9. Managing Foreign Key Constraints

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 14-10. Optimizing Bulk Loads

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • Summary

    • Chapter 15: Logging and Auditing

      • 15-1. Logging Events from T-SQL

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 15-2. Logging Data from SSIS

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 15-3. Customizing SSIS Logging

        • Problem

        • Solution

        • How It Works

      • 15-4. Saving and Applying Complex SSIS Logging Details

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 15-5. Extending SSIS Logging to an SQL Server Destination

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 15-6. Logging Information from an SSIS Script Task

        • Problem

        • Solution

        • How It Works

      • 15-7. Logging from T-SQL to the SSIS Log Table

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 15-8. Handling Errors in T-SQL

        • Problem

        • Solution

        • How It Works

      • 15-9. Handling Errors in SSIS

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 15-10. Creating a Centralized Logging Framework

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 15-11. Logging to a Centralized Framework When Using SSIS Containers

        • Problem

        • Solution

        • How It Works

      • 15-12. Logging to a Centralized Framework When Using SSIS Script Tasks and Components

        • Problem

        • Solution

        • How It Works

      • 15-13. Logging to a Text or XML File from T-SQL

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 15-14. Logging Counters in T-SQL

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 15-15. Logging Counters from SSIS

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 15-16. Creating an SSIS Catalog

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 15-17. Reading Logged Events and Counters from the SSIS Catalog

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 15-18. Analyzing Events and Counters In-Depth via the SSIS Catalog

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 15-19. Creating a Process Control Framework

        • Problem

        • Solution

        • How It Works

      • 15-20. Linking the SSIS Catalog to T-SQL Logging

        • Problem

        • Solution

        • How It Works

      • 15-21. Baselining ETL Processes

        • Problem

        • Solution

        • How It Works

      • 15-22. Auditing an ETL Process

        • Problem

        • Solution

        • How It Works

        • Hints, Tips, and Traps

      • 15-23. Logging Audit Data

        • Problem

        • Solution

          • Auditing Inserts

          • Auditing Updates

          • Auditing Deletes

        • How It Works

        • Hints, Tips, and Traps

      • Summary

    • Appendix A

      • SQL Server Data Types

      • SSIS Data Types

      • Default Data Mapping in the Import/Export Wizard

      • MSSQL9 to MSSQL8

      • MSSQL to DB2

      • MSSQL to IBMDB2

      • MSSQL to Jet4

      • MSSQL to SSIS11

      • OracleClient to MSSQL

      • OracleClient to MSSQL11

      • OracleClient to SSIS11

      • Oracle to MSSQL

      • Oracle to MSSQL11

      • Oracle to SSIS11

      • SQLClient9 to MSSQL8

      • SQLClient to DB2

      • SQLClient to IBMDB2

      • SQLClient to MSSQL11

      • SQLClient to Oracle

      • SQLClient to SSIS

      • SSIS11 to DB2

      • SSIS11 to IBMDB2

      • SSIS11 to MSSQL

      • DB2 to MSSQL

      • SSIS to Jet

      • DB2 to MSSQL11

      • SSIS to Oracle

      • DB2 to SSIS11

      • IBMDB2 to MSSQL

      • IBMDB2 to MSSQL11

      • IBMDB2 to SSIS11

      • Jet to MSSQL8

      • Jet to SSIS

      • ACE to SSIS

      • Excel to SQL Server and SSIS Data Mapping

      • Access to SQL Server and SSIS Data Mapping

      • Oracle to SQL Server and SSIS Data Mapping

      • Oracle to SQL Server Replication Data Type Mapping

      • MySQL Data Types

      • Sybase to SQL Server Data Type Conversion

    • Appendix B

      • Sample Databases and Scripts

      • Sample Databases and Files

        • CarSales

        • Creating the CarSales Database

        • CarSales_Staging

        • CarSales_DW

        • The CarSales SSAS Cube

        • Restoring the CarSales_Cube SSAS Database

        • CarSales_Logging

      • Directory Structure for the Sample Files

    • Index

Tài liệu cùng người dùng

  • Đang cập nhật ...

Tài liệu liên quan