6.3 Execute Mapping in Streaming Mode

This topic provides the steps to enable execute the mapping in the streaming mode. Streaming needs checkpointing information for a fault-tolerant storage system to recover from failures.

1. Click the Topology tab.
2. In the Physical Architecture tree, under Technologies, right-click Spark Python and then click New Data Server.
3. In the Definition tab, specify the details of the Spark data server.

   See Spark Data Server Definition for more information.

4. In the Properties tab, specify the properties for the Spark data server.

   See Spark Data Server Properties for more information.

5. Create a mapping using the data store.
6. Enable the Streaming flag in the Physical design of a mapping.
7. Enable the spark.checkpointing to set the Checkpointing directory.
   Every mapping will have its unique checkpointing directory.
8. Execute the mapping and set the context for physical design.

   Note:

   In the User Interface Designer by default, the Last executed physical design in the mapping execution dialog is pre-selected.