[/map {"- map/map "}) [/map/topicref {"- map/topicref "}) [/map/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicmeta/navtitle {"- topic/navtitle "}) Data Processing Configuration (navtitle][/map/topicref/topicmeta/linktext {"- map/linktext "}) Data Processing Configuration (linktext][/map/topicref/topicmeta/shortdesc {"- map/shortdesc "}) This section describes configuration for date formats and configuration for Spark. It also discusses how to add a SerDe JAR to the Data Processing workflows. (shortdesc] (topicmeta][/map/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Date format configuration (navtitle][/map/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Date format configuration (linktext][/map/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) The dateFormats.txt file provides a list of date formats supported by Data Processing workflows. This topic lists the defaults used in this file. You can add or remove a date format from this file if you use the formats supported by it. (shortdesc] (topicmeta] (topicref][/map/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Spark configuration (navtitle][/map/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Spark configuration (linktext][/map/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) Data Processing uses a Spark configuration file, sparkContext.properties. This topic describes how Data Processing obtains the settings for this file and includes a sample of the file. It also describes options you can adjust in this file to tweak the amount of memory required to successfully complete a Data Processing workflow. (shortdesc] (topicmeta] (topicref][/map/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Adding a SerDe JAR to DP workflows (navtitle][/map/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Adding a SerDe JAR to DP workflows (linktext][/map/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) This topic describes the process of adding a custom Serializer-Deserializer (SerDe) to the Data Processing (DP) classpath, instead of the SerDe class that is shipped in the Data Processing package. (shortdesc] (topicmeta] (topicref] (topicref] (map]