Contents

Title and Copyright Information

Preface

• Audience
• Documentation Accessibility
• Related Documents
• Conventions

1 Introduction to Analyzing and Cleansing Data

• Cleansing and Analyzing Data Overview
  • About the Data Profiler
  • About the Data Cleanser
  • Data Profiling and Cleansing Process Overview
  • Required Format for Flat Data Files

2 Data Profile and Data Cleanser Generation

• Processing Data Profiler and Data Cleanser Data
  • Generating Data Profiler and Data Cleanser Data
    • To Generate Data Profiler and Data Cleanser Data
  • Configuring the Environment
    • To Configure the Environment
  • Extracting the Legacy Data
  • Determining the Fields to Analyze
  • Defining the Data Analysis Rules
    • To Define Data Analysis Rules
  • Performing the Initial Data Analysis
    • To Perform the Initial Data Analysis
  • Reviewing the Data Profiler Reports
  • Configuring the Data Cleansing Rules
    • To Configure the Data Cleansing Rules
  • Cleansing the Legacy Data
    • To Cleanse the Data
  • Performing Frequency Analyses on Cleansed Data
  • Adjusting the Master Index Configuration
• Setting Data Profiler Rules Syntax
  • Data Profiler Processing Attributes
  • Data Profiler Global Variables
  • Simple Frequency Analysis Rules
  • Constrained Frequency Analysis Rules
  • Pattern Frequency Analysis Rules
• Setting Data Cleanser Rules Syntax
  • Data Cleanser Processing Attributes
  • Data Cleanser Global Variables
  • Data Validation Rules
    • dataLength
    • dateRange
    • matchFromFile
    • patternMatch
    • range
    • reject
    • return
    • validateDBField
  • Data Transformation Rules
    • assign
    • patternReplace
    • replace
    • truncate
  • Conditional Data Rules
    • dataLength
    • equals
    • isnull
    • matches
    • Conditional Operators
• Viewing Data Profiler Report Samples
  • Simple Frequency Analysis Report Samples
  • Constrained Frequency Analysis Report Samples
  • Pattern Frequency Analysis Report Samples