You use the Ignore Tokens tab to ignore, during a data load or dimension build, all data-source fields that match a specified string and, thus, you avoid loading the specified string. The specification that you set in the Ignore Tokens tab is applied throughout the data source, not to only one column.
In the “Tokens to ignore” box, you enter or edit the text string that you want to ignore.
You click the New button to enter a row, you press the Enter key to define a search operation, and you click the Delete button to delete the selected row.
Define tokens to be ignored if you do not want to load certain text strings in the data source.