12.1 Configuring a Generative AI Service

Specify a Generative AI service by choosing the provider, endpoint, model, and credentials your apps use.

A generative AI service accepts a natural language prompt and returns a response based on its training. Most services offer multiple models, each of which has been fine-tuned in a particular way to prioritize certain use cases. To integrate AI into your app, start by configuring a Generative AI service definition. It specifies which service you want to work with, its REST API endpoint URL, and the model name you want to use. You can do this in the APEX Builder under App Builder > Workspace Utilities > All Workspace Utilities > Generative AI.

APEX supports working with Generative AI services from Oracle Cloud Infrastructure (OCI), Open AI, Cohere, Google Gemini, Anthropic Claude, Mistral AI, Ollama, as well as services that implement an Open AI compatible API. After selecting an AI Provider, give the service definition a name and a unique identifier called the Static ID that you'll use when working with the service programmatically with the APEX_AI package. In the Settings section, enable the Used by App Builder switch if you want the APEX Assistant in the builder to use this AI service. Leave this switch disabled if you only want your own applications to use this AI service definition.

The (Test Connection) button lets you verify that everything is working before clicking (Create).