4.4.1.13 Creating a Network File System (NFS) Target
To create an NFS target:
- On the Catalog page, click Create New Item.
- Hover the mouse over Target and select NFS from the submenu.
- On the Type Properties screen, enter the following details:
- Name: Enter a unique name for the target. This is a mandatory field.
- Display Name: Enter a display name for the target. If left blank, the Name field value is copied.
- Description
- Tags
- Target Type: The selected target is displayed.
- Click Next.
- On the Target Details screen, enter the following details:
-
File Name: Enter the name of the file to be stored on the local file system or NFS. The file name is prefixed with timestamp and extension, when finally stored.
-
NFS Path: Enter the shared file path which is accessible from the Spark cluster nodes.
-
File Roll Interval: Enter the roll-over interval to write a new file. The interval can be in 1000ms, 10s, 1m, or 1.5h format.
-
File Roll Max Size: Enter the roll-over file size to create a new file. The size can be in 1000, 10k, 1m, or 1g format.
-
Storage Format: Select a storage format from the drop-down list.
-
- Click Next.
- On the Storage Format screen, enter the shape details, based on the storage format you have selected.
- For FILE:
-
File Format: Select a file format from the drop-down list.
- Avro Codec: Select a compression codec from the drop-down list. This option is enabled if you have selected the file format as AVRO or AVRO Object Container Format.
-
- For PARQUET:
- PARQUET Compression: Select a compression codec from the drop-down list.
- For ORC:
- ORC Compression: Select a compression codec from the drop-down list.
- For FILE:
- Click Next.
- On the Shape screen, select one of the methods to define the shape:
-
Select Existing Shape: Select one of the existing shapes from the drop-down list.
-
Manual Shape: Select this option to manually infer the fields from a stream or file. You can also add to, or remove fields from, an existing shape. Enter the following details:
- Shape Name: Enter a name for the shape.
- Clear Fields: Click to delete all the fields in the shape.
- Field Name: Add the necessary fields.
- Field Type: Select the field data type from the drop-down list.
-
- Click Save.
Note:
In case of JSON, AVRO, AVRO OCF schema files would be written underNFS Path/SCHEMA
folder.