Oracle Cloud Infrastructure Documentation

Creating a Routing Profile

Create a routing profile for an on-demand model in OCI Generative AI.

    1. On the Routing profiles list page, select Create routing profile. If you need help finding the list page, see Listing Routing Profiles.
    2. Enter a name for the routing profile.
    3. (Optional) Enter a description for the routing profile.
    4. Select the compartment in which to create the routing profile. The default compartment is the same as the list page, but you can select any compartment that you have permission to work in.
    5. (Optional) In the Tags section, select Add tag and assign tags to the routing profile. See Resource Tags.
    6. In the Configuration section, select one on-demand model from Model select.
    7. From Target OCI regions, select one or more regions where the selected model is available.
      Only the regions available for the selected model can be included in the routing profile. For model availability, see Generative AI Models by Region.
    8. Select Create.
    The routing profile appears on the Routing profiles list page. Select its name to view its details.

  • Use the routing-profile create command and required parameters to create a routing profile:

    oci generative-ai routing-profile create --compartment-id <compartment-OCID> --display-name "<routing-profile-name>" [OPTIONS]

    To configure model and region selection, use the optional --model-routing-policy and --region-routing-policy parameters. Provide each policy as a valid JSON string or a JSON file using the file:// syntax.

    For a complete list of parameters and values for CLI commands, see the CLI Command Reference.

  • Run the CreateRoutingProfile operation to create a routing profile.