Refreshing Data that You Added

After you add data, the data might change, so you must refresh the data from its source.

Note:

Rather than refresh a data source, you can replace it by loading a new data source with the same name as the existing one. However, replacing a data source can be destructive and is discouraged. Don’t replace a data source unless you understand the consequences:

  • Replacing a data source breaks projects that use the existing data source if the old column names and data types aren’t all present in the new data source.

  • Any data wrangling (modified and new columns added in the data stage), is lost and projects using the data source are likely to break.

You can refresh data from all source types: databases, files, and Oracle Applications.

Databases

For databases, the SQL statement is rerun and the data is refreshed.

CSV

To refresh a CSV file, you must ensure that it contains the same columns that are already matched with the date source. If the CSV file that you reload is missing some columns, then you’ll get an error stating that your data reload has failed due to one or more missing columns. You can refresh a CSV file that contains new columns, but after refreshing, the new columns are marked as hidden and don’t display in the Data Elements pane for existing projects using the data source. To fix this issue, you can use the data source’s Inspect option to unhide the new columns and make them available to existing projects.

Excel

To refresh a Microsoft Excel file, you must ensure that the newer spreadsheet file contains a sheet with the same name as the original one. In addition, the sheet must contain the same columns that are already matched with the date source. If the Excel file that you reload is missing some columns, then you’ll get an error stating that your data reload has failed due to one or more missing columns. You can refresh an Excel file that contains new columns, but after refreshing, the new columns are marked as hidden and don’t display in the Data Elements pane for existing projects using the data source. To fix this issue, you can use the data source’s Inspect option to unhide the new columns and make them available to existing projects.

Oracle Applications

You can reload data and metadata for Oracle Applications data sources, but if the Oracle Applications data source uses logical SQL, reloading data only reruns the statement, and any new columns or refreshed data won’t be pulled into the project. Any new columns come into projects as hidden so that existing projects that use the data source aren’t affected. To be able to use the new columns in projects, you must unhide them in data sources after you refresh. This behavior is the same for file-based data sources.

  1. In the Data Sources page, go to the Display pane and select the All Data Sources tab.
  2. Select the data source and click Options, then select Reload Data.
  3. In the Reload Data dialog, inspect the data properties and update its details.
  4. If you’re reloading a spreadsheet and the file is no longer in the same location or has been deleted, then the Reload Data dialog prompts you to locate and select a new file to reload into the data source.
  5. The Reload Data dialog indicates that your data was reloaded successfully. Click OK.
The original data is overwritten with new data, which is displayed in visualizations after they are refreshed.