The Dgraph HDFS Agent acts as a data transport layer between the Dgraph and an HDFS environment.
The Dgraph HDFS Agent plays two important roles:
- Takes part in the ingesting of records into the Dgraph. It does so by first reading records from HDFS that have been output by a Data Processing workflow and then sending the records to the Dgraph's Bulk Load interface.
- Takes part in the exporting of data from Studio back into HDFS. The exported data can be in the form of either a local file or an HDFS Avro file that can be used to create a Hive table.