Integrate Oracle Analytics with Oracle Cloud Infrastructure Vision

Integrate Oracle Analytics with Oracle Cloud Infrastructure (OCI) Vision to analyze images or videos to detect faces, objects, or labels without needing machine learning or artificial intelligence expertise. For example, you might want to identify cars in photographs or faces in videos.

Topics:

Overview to Integrating Oracle Analytics with Vision

Vision is one of several artificial intelligence (AI) services provided by Oracle Cloud Infrastructure. It gives you the power to apply machine learning and artificial intelligence without needing data science expertise.


Description of vision_inaction.png follows
Description of the illustration vision_inaction.png

Integrating Oracle Analytics with Vision enables you to analyze images and videos to detect objects, text, faces, and so on. You perform this AI analysis by invoking a Vision service from a data flow in Oracle Analytics.

Oracle Analytics supports pre-trained models.

Summary

Analysis Type Images Videos
Classification Yes No
Faces Yes Yes
Label No Yes
Object Yes Yes
Text Yes Yes

Pre-trained models

  • Face Detection - Identify the existence of faces in images or videos. For example, you might want to hide the identity of people in images by adding a blur to the image using face location information returned by this model.

  • Image Classification - Use a fixed category set to assign labels to images (not videos).

  • Label Detection - Identify the existence of labels in videos.

  • Object Detection - Finds instance of real-world objects or specific patterns in images or videos, for example, cats, dogs, bicycles, aircraft, or labels.

  • Text Detection - Detect text in images or videos. Convert printed or handwritten text into a digital format.

Custom-trained models

Custom-trained models are calibrated and fine-tuned to detect images and patterns for specific purposes. For example, whereas a pre-trained model might identify electric circuits, you can design a custom-trained model to identify the electric components that make up an electric circuit, for example, resistors, LEDs, diodes, and capacitors. See Vision Tutorials.

Policies Required to Integrate OCI Vision with Oracle Analytics

To integrate Oracle Analytics with OCI Vision, make sure that you have the required security policies.

The OCI user that you specify in the connection between Oracle Analytics Cloud and your OCI tenancy must have read, write, and delete permissions on the compartment containing the OCI resources you want to use. Ensure that the OCI user belongs to a user group with the following minimum OCI security policies. When you connect to an OCI tenancy from Oracle Analytics, you can use either an OCI API key or resource principal.

Note:

Oracle Cloud IDs (OCIDs) are resource identifiers used in OCI.

Note:

For resource principal, to include all Analytics instances under a compartment, specify {request.principal.type='analyticsinstance', request.principal.compartment.id='<compartmentA_ocid>'} instead of {request.principal.id='<analytics_instance_ocid>'}.
API Key Policies Resource Principal Policies
Allow group <group_name> to manage ai-service-vision-family in tenancy Allow any-user to manage ai-service-vision-family in tenancy where all {request.principal.id='<analytics_instance_ocid>'}
Allow group <group_name> to read buckets in compartment <compartment_name> Allow any-user to read buckets in compartment <compartment_name> where all {request.principal.id='<analytics_instance_ocid>'}
Allow group <group_name> to manage objects in compartment <compartment_name> where target.bucket.name='<staging_bucket_name>' Allow any-user to manage objects in compartment <compartment_name> where all {request.principal.id='<analytics_instance_ocid>', target.bucket.name='<staging_bucket_name>'}
Allow group <group_name> to read objects in compartment <compartment_name> where target.bucket.name='<images_bucket_name>' Allow any-user to read objects in compartment <compartment_name> where all {request.principal.id='<analytics_instance_ocid>', target.bucket.name='<images_bucket_name>'}
Allow group <group_name> to read objectstorage-namespaces in tenancy Allow any-user to read objectstorage-namespaces in tenancy where all {request.principal.id='<analytics_instance_ocid>'}

Typical Workflow to Integrate Oracle Analytics with Vision

Perform these tasks required to integrate Oracle Analytics with Vision and perform object detection, image classification, or text detection.

Task Description More Information
Review prerequisites Make sure that the user connecting from Oracle Analytics to the OCI tenancy has the required security policies. Policies Required to Integrate OCI Vision with Oracle Analytics
Connect to OCI Vision Create a reusable connection to your Vision service. Create a Connection to Your Oracle Cloud Infrastructure Tenancy
Prepare the images or videos to analyze Review the prerequisites for images and videos.

Then create a dataset that references the images or videos that you want to analyze, and upload it to Oracle Analytics.

Prerequisites for Images and Videos for Analysis with an OCI Vision Model

Prepare Images or Videos for Analysis with an OCI Vision Model
Make a model available in Oracle Analytics Register a Vision model in Oracle Analytics to make it available to data flows. Make a Vision Model Available in Oracle Analytics
Process your images or videos Use a data flow to apply the Vision to analyze the images or videos. Use Oracle Cloud Infrastructure Vision Models in Oracle Analytics
Analyze the results Use the dataset generated by your data flow to analyze the results. Output Data Generated for Face Detection, Object Detection, Image Classification, and Text Detection Analysis Models

Prerequisites for Images and Videos for Analysis with an OCI Vision Model

Before you start processing images or videos using a Vision model in Oracle Analytics, follow these prerequisites.

Overview

You use buckets in OCI Object Storage to store the images that you want to analyze, then create a dataset to access these images in Oracle Analytics.

In most cases, input images and Vision models are stored in the same Oracle Cloud account (tenancy). If your input images and Vision model are stored on different tenancies, you must ensure that the visibility of the storage bucket containing your input images is public and the input dataset for the data flow contains individual image URLs (as described in step 4). To learn how to make a bucket public, see Change the visibility of a bucket.

Images

Data flows in Oracle Analytics can process up to 20,000 images in one run. If you have more than 20,000 images to process, in OCI's Object Storage & Archive Storage create multiple buckets containing no more than 20,000 images in each one. Then, create a separate dataset and data flow for each bucket, and use a Sequence to sequentially process multiple data flows.

Videos

  • Supported video formats: .mov, .mp4, .h264, .mkv, .webm.
  • Up to 20 GB and 10 hours duration.
  • Individual videos can be up to 1GB.
  • Each Oracle Analytics data flow run can process around 50 minutes of video. The exact limit depends on video file size, resolution, and format.

Prepare Images or Videos for Analysis with an OCI Vision Model

You use buckets in OCI Object Storage to store the images that you want to analyze, then create a dataset to access these images in Oracle Analytics.

In most cases, input images and Vision models are stored in the same Oracle Cloud account (tenancy). If your input images and Vision model are stored on different tenancies, you must ensure that the visibility of the storage bucket containing your input images is public and the input dataset for the data flow contains individual image URLs (as described in step 4). To learn how to make a bucket public, see Change the visibility of a bucket.

  1. In OCI Console, navigate to Object Storage & Archive Storage, and create a bucket to store your images.
    Description of vision_bucket_nav.png follows
    Description of the illustration vision_bucket_nav.png

  2. Upload your images or videos to the bucket.
    Make sure that the bucket contains no extraneous files. Oracle Analytics processes every file in the bucket.
    The bucket can be private or public, but must be accessible to the OCI user and comply with OCI's generic limits on images. See OCI documentation. You use the URL Path (URI) value to reference for images and videos.
  3. To process every image or video in a bucket, add the bucket URL to a CSV file.
    1. In Object Storage, select the bucket to display the images in the Objects dialog.
    2. Copy the URL from the browser's URL bar.
    3. Create a CSV file with fields for ID, Bucket Name, and Bucket URL.
    4. Paste the bucket URL into the CSV file as the Bucket URL value.
      If you have more than 20,000 images, you typically create multiple buckets of up to 20,000 images and create a separate dataset for each bucket.
  4. To reference images individually, create a CSV file with fields ID, Image Name, and File Location, and populate the file with the unique IDs, names, and URIs of the images to analyze.
    Description of vision_create_dataset.png follows
    Description of the illustration vision_create_dataset.png

  5. To reference videos individually, create a CSV file with fields ID and URL, and populate the file with the unique ID and URIs of the videos to analyze.
    Description of video-csv-file-example.png follows
    Description of the illustration video-csv-file-example.png

  6. In Oracle Analytics, click Create, then Dataset, and upload the CSV file that you created in Step 3, 4, or 5.
See Create a Dataset from a File Uploaded from Your Computer.

Make a Vision Model Available in Oracle Analytics

Make a Vision model available in Oracle Analytics so that you can analyze images or videos to perform object detection, image classification, or text detection using data flows.

Before you start, create a connection to your OCI tenancy. See Create a Connection to Your Oracle Cloud Infrastructure Tenancy.
  1. In OCI Object Storage, create a bucket in a compartment using a suitable name (for example, MyVisionModelStagingBucket).
    This staging bucket:
    • Must be created in the accessible compartment.
    • Must be created before registering a model.
    • Can have private visibility.
    • Can be used for multiple models.
    • Can be changed in the Inspect screen.
  2. In the Oracle Analytics home page, click Page Menu Page Menu ellipsis, select Register Model/Function, and then select OCI Vision Models.
  3. At the Register a Vision Model dialog, under From a Connection click the connection that you created in Create a Connection to Your Oracle Cloud Infrastructure Tenancy.
    Description of register-vision-model.png follows
    Description of the illustration register-vision-model.png

    A list of available models is displayed.
  4. In the list of available models, click the model you want to apply to your image data.
    For example, to detect cars in photographs, select Pretrained Object Detection, or to detect faces in videos, select Pretrained Video Face Detection.
    When select a model, an information panel pops up displaying the model details.
    Description of vision_models_2.png follows
    Description of the illustration vision_models_2.png

  5. In Model Name, specify a name to identify the model in Oracle Analytics.
  6. In Staging Bucket Name, enter the name that you specified in Step 1 (for example, MyVisionModelStagingBucket).
  7. Click Register.
Tip: To review the registered model, from the Oracle Analytics home page, navigate to Machine Learning, then Models.