Configure Incremental Processing in a Data Flow

Configure incremental processing to load only new or updated records from a database. You can deploy incremental processing if your data is sourced from a database (using a database connection).

Incremental processing keeps your data up-to-date, providing better quality insights.

Before you start, create a connection to one of the supported databases, for example Oracle, Oracle Autonomous Data Warehouse, Apache Hive, Hortonworks Hive, or Map R Hive.

1. Specify a new data indicator in the data source. See Specify a New Data Indicator for a Data Source.
2. Apply incremental processing in your data flow. See Apply Incremental Processing in a Data Flow.