Managing Routing Profiles

Routing profiles define how OCI Generative AI routes on-demand model requests across user-selected OCI regions.

A routing profile specifies one supported on-demand model and one or more target OCI regions within the same realm where that model is available. When you reference the routing profile in a supported inference request, Generative AI routes the request only among the target regions in the profile.

Use routing profiles to access a selected on-demand model across an approved regional scope without building application-side cross-region routing. For the regional availability of each model, see Generative AI Models by Region.

You can perform the following tasks to create and manage routing profiles:

• Creating a routing profile
• Listing routing profiles
• Getting a routing profile's details
• Updating a routing profile
• Moving a routing profile
• Deleting a routing profile