[/map {"- map/map "}) [/map/title {"- topic/title "}) Transforming a Project Data Set (title] [/map/topicref {"- map/topicref "}) [/map/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicmeta/navtitle {"- topic/navtitle "}) Transforming a Project Data Set (navtitle][/map/topicref/topicmeta/linktext {"- map/linktext "}) Transforming a Project Data Set (linktext][/map/topicref/topicmeta/shortdesc {"- map/shortdesc "}) The Transform page provides options for correcting and enriching a project data set. (shortdesc] (topicmeta][/map/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) About transforming data (navtitle][/map/topicref/topicref/topicmeta/linktext {"- map/linktext "}) About transforming data (linktext][/map/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) The Transform page allows you to make corrections and enhancements to a project data set. The transformations are within the scope of the project and do not affect the data set in the Catalog for other Studio users. (shortdesc] (topicmeta] (topicref][/map/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Selecting the data to transform (navtitle][/map/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Selecting the data to transform (linktext][/map/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) The Transform displays the project data set. You can select a single data set on a tabbed page, or a linked data set if you have enabled linking. (shortdesc] (topicmeta] (topicref][/map/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Toggling the Transform data grid view (navtitle][/map/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Toggling the Transform data grid view (linktext][/map/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) Most of the Transform page consists of the data grid. In the grid, each column represents an attribute from the project data set. (shortdesc] (topicmeta] (topicref][/map/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Filtering and sorting the displayed attributes and values (navtitle][/map/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Filtering and sorting the displayed attributes and values (linktext][/map/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) Transform provides sorting and filtering options to help you focus on the attributes you want to work with. (shortdesc] (topicmeta] (topicref][/map/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Deleting records from the project data set (navtitle][/map/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Deleting records from the project data set (linktext][/map/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) You can use the refinement state as a basis for deleting records from the project data set. You can either delete records that match the refinement state, or delete records that do NOT match the refinement state. (shortdesc] (topicmeta] (topicref][/map/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Adding transformations to a transformation script (navtitle][/map/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Adding transformations to a transformation script (linktext][/map/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) You can add any number of transformations to a transformation script. The script can include quick transformations, available from the attribute menu, and also custom transformations that you create in the Transformation Editor. (shortdesc] (topicmeta][/map/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Overview of transforming an attribute (navtitle][/map/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Overview of transforming an attribute (linktext][/map/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) Both quick transforms and custom transforms follow the same basic flow. (shortdesc] (topicmeta] (topicref][/map/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Adding an attribute (navtitle][/map/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Adding an attribute (linktext][/map/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) You can add a new attribute to a project data set by specifying Groovy code to produce the attribute and by specifying a new attribute name and data type for the result. You then preview the change. If the result is what you expect, you can add it to the transformation script. (shortdesc] (topicmeta] (topicref][/map/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Changing the data type for an attribute (navtitle][/map/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Changing the data type for an attribute (linktext][/map/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) You can change the data type assigned to an attribute. (shortdesc] (topicmeta] (topicref][/map/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Editing attribute values (navtitle][/map/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Editing attribute values (linktext][/map/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) Some of the available transformations are used to make basic changes to attribute values. (shortdesc] (topicmeta][/map/topicref/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Displaying whitespace characters in attribute values (navtitle][/map/topicref/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Displaying whitespace characters in attribute values (linktext][/map/topicref/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) To help gauge the amount of cleanup that might be needed, you can display spaces, tabs, and paragraph breaks as whitespace characters. (shortdesc] (topicmeta] (topicref][/map/topicref/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Changing the capitalization of string values (navtitle][/map/topicref/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Changing the capitalization of string values (linktext][/map/topicref/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) When you change the capitalization, the transformation is immediately added to the transformation script. There is no configuration, and the change always overwrites the selected attribute. (shortdesc] (topicmeta] (topicref][/map/topicref/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Trimming spaces from string values (navtitle][/map/topicref/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Trimming spaces from string values (linktext][/map/topicref/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) The Trim transformation removes white spaces from the beginning or end of string attribute values. (shortdesc] (topicmeta] (topicref][/map/topicref/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Performing mathematical operations on numeric values (navtitle][/map/topicref/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Performing mathematical operations on numeric values (linktext][/map/topicref/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) For numeric attributes, you can perform mathematical operations. The available operations change based on whether the attribute is specifically an integer, long, or double value. (shortdesc] (topicmeta] (topicref][/map/topicref/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Selecting subsets of date/time values (navtitle][/map/topicref/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Selecting subsets of date/time values (linktext][/map/topicref/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) For date/time attributes, you can truncate the date/time values to only include a specific subset of the date/time units. (shortdesc] (topicmeta] (topicref] (topicref][/map/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Splitting and grouping values (navtitle][/map/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Splitting and grouping values (linktext][/map/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) Transform allows you to split attribute values into two separate attributes, or create groups or bins of attribute values. (shortdesc] (topicmeta][/map/topicref/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Splitting string attribute values (navtitle][/map/topicref/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Splitting string attribute values (linktext][/map/topicref/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) The split transformation creates two new attributes from the original value. You can only split string attributes. (shortdesc] (topicmeta] (topicref][/map/topicref/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Grouping attribute values (navtitle][/map/topicref/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Grouping attribute values (linktext][/map/topicref/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) Grouping attribute values takes the attribute values and puts them into groups, with each group given a unique name. (shortdesc] (topicmeta] (topicref][/map/topicref/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Binning numeric attribute values (navtitle][/map/topicref/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Binning numeric attribute values (linktext][/map/topicref/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) The binning transformation takes values for a numeric attribute and groups them into bins. The bins are then used as the values of a new attribute. (shortdesc] (topicmeta] (topicref] (topicref][/map/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Creating a custom transformation script (navtitle][/map/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Creating a custom transformation script (linktext][/map/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) You can create a custom transformation script by writing custom Groovy code in the Transformation Editor. (shortdesc] (topicmeta] (topicref] (topicref][/map/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Managing and executing the transformation script (navtitle][/map/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Managing and executing the transformation script (linktext][/map/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) The transformation script tracks and executes the transformations. (shortdesc] (topicmeta][/map/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Reordering, editing, and deleting transformations (navtitle][/map/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Reordering, editing, and deleting transformations (linktext][/map/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) The transformation script is contained in a collapsible panel at the right of the Transform page. (shortdesc] (topicmeta] (topicref][/map/topicref/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Running the transformation script against the project data set (navtitle][/map/topicref/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Running the transformation script against the project data set (linktext][/map/topicref/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) The project data set is not affected by the transformations until you run the transformation script against the project's data set. Studio commits the transformations to the data sample that is currently associated with the project. Also, if you later change the sample size, the transformations that you have already applied are automatically applied to the sample. (shortdesc] (topicmeta] (topicref] (topicref][/map/topicref/topicref {"- map/topicref "}) [/map/topicref/topicref/topicmeta {"- map/topicmeta "}) [/map/topicref/topicref/topicmeta/navtitle {"- topic/navtitle "}) Creating a new data set from the transformed data (navtitle][/map/topicref/topicref/topicmeta/linktext {"- map/linktext "}) Creating a new data set from the transformed data (linktext][/map/topicref/topicref/topicmeta/shortdesc {"- map/shortdesc "}) After running a transformation script, you can create a new data set in the Catalog based on the transformed project data. This is sometimes called forking a data set. (shortdesc] (topicmeta] (topicref] (topicref] (map]