1. How do I use AI Agent Studio?
  2. Add Your LLM

Add Your LLM

Oracle provides a set of LLMs that you can use when creating an agent, node, or workflow. You can also use other LLMs by adding their credentials in AI Agent Studio.

If the model you want to use isn't listed for a supported provider, you can submit a request through My Oracle Cloud Support to have the model added.
Important: Oracle updates the list of Bring Your Own LLM options on a monthly basis and may remove models that have been deprecated, based on the information provided by the respective model providers. You're responsible for obtaining and managing all the required third-party provider credentials, associated service costs, and custom model configurations. You must also monitor model lifecycle changes, keep configurations up-to-date, and complete any required migrations to supported model versions within the timelines specified by the model provider.
You can add an LLM from any of these supported providers:
  • OpenAI (through Microsoft Azure)
  • Gemini Enterprise Agent Platform (through Google Vertex AI)
  • Google Gemini (through direct API)
  • Anthropic (through Google Vertex AI)
  • Oracle Cloud Infrastructure
  • OpenAI (through direct API)
To add the credentials for available LLMs, do these steps:
  1. Go to AI Agent Studio and open the Credentials Credentials tab.
  2. In the LLM subtab, select Add LLM.
  3. Add the details and save it.
    • Provider: Select the provider you need from the available options.
    • Model: Choose the model you need from the available options.
    • Name: Enter a name.
    • Code: Enter a code.
    • Description: Describe the configuration details.
    • Basic URL: Enter the endpoint URL that will receive requests for the LLM.
    • API Key: Add the API key for the selected model.
Your LLM now appears in the LLM tab, and you can select it when creating agents, nodes, or workflows.
To request a new LLM model, do these steps:
  1. Create a service request through My Oracle Cloud Support.
  2. Add the details for the approver.
    • Supported provider name shown in AI Agent Studio
    • Requested model and version
    • Business use case
    • Required timeline
  3. Submit your request.

The time required to make a requested model available in AI Agent Studio depends on the complexity of the model integration. In most cases, requests are completed within two to four weeks. Each request is reviewed, and an estimated availability timeline is provided as part of the service request process. The model will appear in the Models list, where you can add LLMs.