Adding a Model to a Private Endpoint
Learn how to attach an endpoint with a custom or pretrained model to a private endpoint in OCI Generative AI.
You can attach one or more endpoints to a private endpoint.
Create Endpoint
- On the Private Endpoints list page, select the private endpoint that you want to work with. If you need help finding the list page for private endpoints, see Listing Private Endpoints.
- Select Endpoints and then select Create endpoint.
Endpoint Information
Hosting configuration
Networking resources
The private endpoint is preselected. Guardrails
Use the endpoint create command and required parameters to create an endpoint:
oci generative-ai endpoint create --model-id <model-OCID> --compartment-id <compartment-OCID> --dedicated-ai-cluster-id <hosting-dedicated-AI-cluster-OCID> [OPTIONS]
For a complete list of parameters and values for CLI commands, see the CLI Command Reference.
Note
For pretrained models, instead of an OCID, you can use the model name exactly as listed in the Console's playground. You can also find this OCI model name, in the model's detail page in Pretrained Foundational Models in Generative AI.Run the CreateEndpoint operation to create an endpoint.
Note
For pretrained models, instead of an OCID, you can use the model name exactly as listed in the Console's playground. You can also find this OCI model name, in the model's detail page in Pretrained Foundational Models in Generative AI.