Configure Incremental Processing in a Data Flow

Configure incremental processing to load only new or updated records from a database. You can deploy incremental processing if your data is sourced from a database (using a database connection).

Before you start, create a connection to one of the supported databases, for example Oracle, Oracle Autonomous Data Warehouse, Apache Hive, Hortonworks Hive, or Map R Hive.
  1. Specify a new data indicator in the data source. See Specify a New Data Indicator for a Data Source.
  2. Apply incremental processing in your data flow. See Apply Incremental Processing in a Data Flow.