Generate Text with a Generative AI Action

You can use AI to ask questions and receive responses with a generative AI action. Oracle Cloud Infrastructure Generative AI provides answers or information to the questions you ask by generating text.

Capabilities

OCI Generative AI is a fully managed AI service that offers customizable large language models (LLMs) for chat. You can prompt the OCI Generative AI chat model to generate text. Oracle Integration supports using OCI Generative AI in an integration with the generative AI action.

See Generative AI.

The OCI Generative AI’s chat model enables you to brainstorm ideas, get answers to questions, write descriptions or content, explain concepts, and much more.

Prerequisites

See Prerequisites for information on the prerequisites you must satisfy in the Oracle Cloud Infrastructure Console.

Invoke Oracle Cloud Infrastructure Generative AI from an Integration

  1. Add a Generative AI action to an integration in either of the following ways:
    • On the side of the canvas, click Actions Integration actions icon and drag the OCI Generative AI action to the appropriate location.
    • Click Add icon at the location where you want to add the OCI Generative AI action, then select OCI Generative AI.
  2. Enter a name and optional description, then click Continue.
  3. Select the following information, then click Continue.
    Element Description
    Region

    Select the region you want to use.

    Note: Ensure you select the region in which OCI is provisioned for you.

    Compartment

    Select the Oracle Cloud Infrastructure compartment in which your Oracle Integration is installed.

    Model
    Select a model for your chat conversation.
    • If you select GENERIC (llama), all the Meta Llama models are listed for selection in the Model ID field.
    • If you select COHERE, all the Cohere models are listed for selection in the Model ID field.

    In the Model ID field, select the model you want to use.

  4. On the Summary page, click Finish.
  5. Open the mapper and define the mappings between the source and target elements as needed.
  6. Expand the topmost request node in the Target section.
  7. Within the topmost request node in the Target section, expand Request Wrapper, expand Chat Request, expand Messages, and then expand Content.

  8. Within Content, right-click Text, and select Create target node.

  9. Click Design View Switch view icon in the Expression Builder.

  10. You can prompt the OCI Generative AI chat model to generate text by specifying your request in the Expression Builder for the Text element. In the Expression Builder, enter the question you want to ask or specify what information you need (for example, 'Tell me about ELE').

    Note:

    In the mapper, you can optionally override the following values you initially selected when you performed Step 3:
    • Compartment Id: Use this to specify a compartment Id to override the default compartment that was selected for the model to be deployed.
    • Api Format: Use this to override the default API format used for model serving.
    • Model Id: Use this to override the initially selected model identifier.

    Currently, the generative AI action version supports the following servingType: ON_DEMAND.

    You can also configure the mappings for other fields as needed in the mapper, including optionally tuning the parameters such as Top p, Temperature, and so on.

  11. Exit the mapper.

    The generative AI action is now configured.