1. Administration and Configuration Guide
  2. Data Management Tools (DMT) Module Configurations
  3. Data Mapping Configurations
  4. Data Movement from File to HDFS Target (F2H)

Data Movement from File to HDFS Target (F2H)

This section talks about the configurations required for data movement involving Hive based Source or Target (F2H).
  • HDFS-File to HDFS Target
  • Local Flat File to HDFS Target
  1. From DMT Configurations window, select Is Hive Local as Yes if HiveServer is running locally to OFSAA, else select No, from the drop-down list.
    For more information, see the DMT Configurations section in the OFS Analytical Applications Infrastructure User Guide.
  2. From the Register Cluster tab in the DMT Configurations window, register a cluster with Target Information domain name as the Cluster Name for the following scenarios:
    • If Flat File is local and Is Hive Local is set as No
    • If Flat File is Remote and Is Hive Local is set as Yes
    Step 2: Copy the required Jars
    Copy the following Third Party Jars from the CDH installation libraries into the $FIC_HOME/ext/lib folder:
    • htrace-core-3.0.4.jar
    • commons-cli-1.2.jar
    • hadoop-hdfs-2.6.0-cdh5.4.4.jar

    Note:

    The version of Jars depends on the CDH version and the Drivers used. From CDH 5.8.4 version onwards, htrace-core4-4.0.1-incubating.jar should be copied.