Oracle Cloud Infrastructure Documentation

Getting an Endpoint's Metrics in Generative AI

Get metrics for an endpoint in OCI Generative AI.

  1. In the navigation bar of the Console, select a region with Generative AI, for example, US Midwest (Chicago) or UK South (London). See which models are offered in your region.
  2. Open the navigation menu  and select Analytics & AI. Under AI Services, select Generative AI.
  3. Select the compartment that contains the endpoint that you want to see its metrics.
  4. Select Endpoints.
  5. Select the name of the endpoint that you want to see metrics for.
  6. Under Resources, select Endpoint metrics.
    For details about the Endpoint metrics and to use the Monitoring service to create your own charts and get notified when these metrics meet alarm-specific triggers, see Metric Details in Generative AI.