Configure Token Terms and Billing Settings

Use the token terms and billings settings to monitor AI token consumption and configure how Oracle Analytics Cloud handles token overages for generative AI features.

Before you manage token usage settings, ensure that these prerequisites are met.

  • You have the BI Service Administrator application role or belong to an application role with the Manage LLMs permission to manage token usage for your organization.
  • Your OCI administrator set up AI token billing for additional token usage. See Enable Overage Billing for AI Tokens.
Oracle Analytics Cloud AI features consume tokens when users interact with large language models (LLMs) to perform actions such as natural language querying, AI-assisted analysis, catalog description generation, and agentic workflows. Some AI features consume significantly more tokens than others.
The Token Usage Settings dialog's Terms and Billing tab helps you understand current usage, monitor remaining allowance, and control whether additional token consumption is permitted after the monthly allowance is exhausted.

Note:

In addition to or instead of allowing overages, you may want to review AI usage patterns and consider if disabling some of the AI Assistant features makes sense, or switching AI to use the legacy model, which doesn't charge tokens for generative AI features.
If you enable overage usage:
  • AI requests continue after the monthly allowance is consumed.
  • Additional usage is billed using OCI Generative AI pricing.
  • Charges are applied to the OCI compartment where Oracle Analytics Cloud is deployed.
If you disable overage usage:
  • AI requests stop after the monthly allowance is consumed.
  • Users may receive messages instructing them to contact an administrator.
It's also important that you understands customer compartment billing. The Enrollment and Compartment section of the Token Usage Settings dialog identifies the OCI compartment that the overage charges are billed against. Depending on the OCI configuration, you may be able to select from more than one available compartments.
For information about OCI Generative AI pricing, go to the OCI Price List.
  1. On your home page, click Navigator Navigator icon used to display the Navigator, then click Console.
  2. Under Extensions and Enrichments, click Generative AI.
  3. In Registered Gen AI Services, click Options and select Token Usage Settings.
  4. In the Terms and Billings tab, click Allow overage after allowance is consumed and specify the maximum allowed overage usage.
  5. If more than one compartment is available, select which customer compartment you want overage charges billed against.
  6. Click Save.