2 Data Processing Workflows

This section describes how Data Processing discovers data in Hive tables and prepares it for ingest into the Dgraph.

• Overview of workflows
  This topic provides an overview of Data Processing workflows.
• Workflow for loading new data
  This topic discusses the workflow that runs inside Data Processing component of BDD when new data is loaded.
• Working with Hive tables
  Hive tables contain the data for the Data Processing workflows.
• Sampling and attribute handling
  When creating a new data set, you can specify the maximum number of records that the Data Processing workflow should process from the Hive table.
• Data type discovery
  When Data Processing retrieves data from a Hive table, the Hive data types are mapped to Dgraph data types when the data is ingested into the Dgraph.
• Studio creation of Hive tables
  Hive tables can be created from Studio.