Migrate File-based Data to Oracle Analytics Cloud

Users can upload data files (for example, spreadsheets) to Oracle Analytics Cloud and Oracle Analytics Server to create datasets. When you migrate to a different Oracle Analytics Cloud environment, you can opt to migrate the uploaded data files too. If snapshot restore can’t migrate data files because of network or storage access issues, you can use the Oracle Analytics Cloud data migration command-line utility (CLI) migrate-oac-data.jar to move your data files to the target environment. The CLI utility also migrates map plug-ins and extension files users upload for their visualizations.

Run the data migration utility if you restore a snapshot in Oracle Analytics Cloud that contains data files and see Restore succeeded with errors - data restore failed or a similar message. This message occurs when:
  • You migrate between Oracle Cloud regions (Oracle Analytics Cloud only).
  • You migrate content from Oracle Analytics Server or Oracle Cloud Infrastructure Classic.
  • Network connectivity or storage access issues block data file migration during the restore.

Choose one of these methods to run the data migration utility:

  • Transfer data files directly from the source environment to the target environment in a single step. (Oracle Analytics Cloud only)
  • Download the data files locally to a ZIP file, and then upload the ZIP file into the target environment. (Oracle Analytics Cloud and Oracle Analytics Server migration)
  1. Check your environment details.
    • Verify that the source environment is on the same update as, or an earlier update than, the target environment.

    • Confirm that both the source and target environments are running.

    • Check thatOracle Analytics Cloud is configured with valid storage credentials.

    • From the local environment where you plan to run the data migration utility, verify that you can access both the source and target environments.

    • (Oracle Analytics Server only) Run the data migration utility on a machine inside your Oracle Analytics Server environment).
    • Locate the snapshot (.bar) you previously downloaded that contains your file-based data. For example, /tmp/20190307095216.bar.
  2. Download the data migration CLI utility.
    1. In your target Oracle Analytics Cloud, click Navigator Navigator icon used to display the Navigator, click Console, and then click Snapshots.
    2. Click the Page menu Page menu , and select Download Data Migration Utility.
      Follow the instructions to save the migrate-oac-data.zip file locally.
  3. Unzip migrate-oac-data.zip.

    The ZIP file contains three files:

    • migrate-oac-data.jar
    • config.properties
    • readme
  4. (Oracle Analytics Cloud migration only.) If you want to transfer data files directly from the source Oracle Analytics Cloud environment to the target Oracle Analytics Cloud environment in a single step, configure the section [MigrateData] in config.properties.

    Source environment - Oracle Analytics Cloud

    [MigrateData]
    # Migrate data files from a source Oracle Analytics Cloud environment (OAC) to a target Oracle Analytics Cloud environment.
        # Specify the source environment as Oracle Analytics Cloud.
          SOURCE_ENVIRONMENT=OAC
        # Source Oracle Analytics Cloud URL. For example: https://sourcehost.com:443 or http://sourcehost.com:9704
          SOURCE_URL=http(s)://<Source Oracle Analytics Cloud Host>:<Source Port>

    Target environment - Oracle Analytics Cloud

        # Name of a user with Administrator permissions in the source environment. For example: SourceAdmin
          SOURCE_USERNAME=<Source Administrator User Name>
        # Location of the source snapshot (.bar file). For example:  /tmp/20190307095216.bar
          BAR_PATH=<Path to Source Snapshot>
        # Target Oracle Analytics Cloud URL. For example: https://targethost.com:443 or http://targethost.com:9704
          TARGET_URL=http(s)://<Target Oracle Analytics Cloud Host>:<Target Port>
        # Name of a user with Administrator permissions in the target environment. For example: TargetAdmin
          TARGET_USERNAME=<Target Administrator User Name>
  5. (Oracle Analytics Cloud or Oracle Analytics Server migration.) If you want to download the data files from your source environment (Oracle Analytics Cloud or Oracle Analytics Server) to a ZIP file, and then upload the ZIP file into the target environment, configure sections [DownloadDataFiles] and [UploadDataFiles] in config.properties.

    Source environment - Oracle Analytics Cloud

    [DownloadDataFiles]
    #Download Data Files: Download data files from Oracle Analytics Cloud storage to a local repository
        # Specify the source environment as Oracle Analytics Cloud.
          SOURCE_ENVIRONMENT=OAC
        # Source Oracle Analytics Cloud URL. For example: https://sourcehost.com:443 or http://sourcehost.com:9704
          SOURCE_URL=http(s)://<Source Oracle Analytics Cloud Host>:<Source Port>

    Source environment - Oracle Analytics Server

    [DownloadDataFiles]
    #Download Data Files: Download data files from Oracle Analytics Server storage to a local repository
        # Specify the source environment as Oracle Analytics Server.
          SOURCE_ENVIRONMENT=OAS
        # Source Oracle Analytics Server URL. For example: https://sourcehost.com:443 or http://sourcehost.com:9704
          SOURCE_URL=http(s)://<Source Oracle Analytics Server Host>:<Source Port>

    Target environment - Oracle Analytics Cloud

        # Name of a user with Administrator permissions in the source environment. For example: SourceAdmin
          SOURCE_USERNAME=<Source Administrator User Name>
        # Location of the source snapshot (.bar file). For example:  /tmp/20190307095216.bar
          BAR_PATH=<Path to Source Snapshot>
        # Local data file directory. Make sure you have enough space to download the data files to this directory. For example: /tmp/mydatafiledir 
          DATA_FRAGMENTS_DIRECTORY=<Data Files Directory>
         # Data fragment size. Data files are downloaded in fragments. Default fragment size is 500MB.
          MAX_DATA_FRAGMENT_SIZE_IN_MB=500
    [UploadDataFiles]
    #Upload data files: Upload data files to the target Oracle Analytics Cloud. 
        # Target Oracle Analytics Cloud URL. For example: https://targethost.com:443 or http://targethost.com:9704
          TARGET_URL=http(s)://<Target Oracle Analytics Cloud Host>:<Target Port>
        # Name of a user with Administrator permissions in the target environment. For example: TargetAdmin
          TARGET_USERNAME=<Target Administrator User Name>
        # Local directory containing the data files you want to upload. For example: /tmp/mydatafiledir
          DATA_FRAGMENTS_DIRECTORY=<Data Files Directory>
        # Location of the source snapshot (.bar file). For example:  /tmp/20190307095216.bar
          BAR_PATH=<Path to Source Snapshot>
  6. Run the migrate-oac-data.jar file in your local environment.

    Syntax:

    migrate-oac-data.jar [-config configfile] [-d] [-help] [-m]  [-u]

    Where:

    • -config configfile : Name of the config.properties file

    • -d : Downloads data locally using information in config.properties

    • -help : Displays help

    • -m : Migrates data using source and target information in the config.properties file

    • -u : Uploads data using information in the config.properties file

    • (Oracle Analytics Server only) -DDOMAIN_HOME: Oracle Analytics Server Domain_Home. For example: /Oracle_Home/user_projects/domains/bi

    • (Oracle Analytics Server only) -Djava.io.tmpdir: Path to the Java temporary directory. For example: ./tmp

    Migrate from Oracle Analytic Cloud:

    For example, to migrate data files in a single step:

    java -jar migrate-oac-data.jar -m -config config.properties

    For example, to download data files locally:

    java -jar migrate-oac-data.jar -d -config config.properties

    For example, to upload data files:

    java -jar migrate-oac-data.jar -u -config config.properties

    Migrate from Oracle Analytic Server:

    For example, to download data files locally:

    java -jar -Djava.io.tmpdir=./tmp -DDOMAIN_HOME=<OAS Domain Home> migrate-oac-data.jar -d -config config.properties

    For example, to upload data files:

    java -jar -Djava.io.tmpdir=./tmp migrate-oac-data.jar -u -config config.properties
  7. Sign in to your target Oracle Analytics Cloud.
  8. To expose the data files in Oracle Analytics Cloud, restore the snapshot that you used to migrate the rest of your content for a second time. This time, you must select the Custom restore option.
    1. In Console, click Snapshots.
    2. Select the snapshot containing your data files.
    3. Select the Custom restore option, and then select the option File-based data.
    4. Deselect all other options.
    5. Click Restore.
  9. Verify that your data files are available.