14.19 MODEL

The model command configures OCI Generative AI models, ingests documents into Oracle vector tables, and removes vectors associated with ingested documents.

For prerequisites, and workflows, see Using the Model Command for Retrieval-Augmented Generation.

Syntax

MODEL CONFIG -list [-debug] [-verbose]
MODEL CONFIG CHAT-MODEL <model-options> [-debug] [-verbose]
MODEL CONFIG EMBEDDING-MODEL <model-options> [-debug] [-verbose]
MODEL INGEST -path <file-or-directory> -table <vector-table> [-debug] [-verbose]
MODEL DELETE -file-path <file> -table <vector-table> [-debug] [-verbose]
Command Description
model config -list Displays the saved model configuration
model config chat-model Configures the OCI chat model.
model config embedding-model Configures the OCI embedding model.
model ingest Embeds documents into a vector table.
model delete Removes the vectors for one previously ingested document.

See:

14.19.1 MODEL CONFIG

MODEL CONFIG CHAT MODEL

Syntax

MODEL CONFIG CHAT-MODEL -model-name <model-id>
-serving-type <ON-DEMAND|DEDICATED> -compartment-id <compartment-ocid>
[-config-path <oci-config-file>] [-debug] [-verbose]

Options

Option Required Description
-model-name |-mn Yes OCI model or dedicated endpoint identifier.
-serving-type |-st Yes Serving type. Valid values are ON-DEMAND and DEDICATED.
-compartment-id |-ci Yes OCID of the OCI compartment containing or providing access to the model.
-config-path |-ocp No Path to an OCI configuration file.
-debug |-d No Enables diagnostic output.
-verbose |-v No Enables informational output.

MODEL CONFIG EMBEDDING MODEL

Syntax

MODEL CONFIG EMBEDDING-MODEL -model-name <model-id>
-serving-type <ON-DEMAND|DEDICATED> -compartment-id <compartment-ocid>
[-config-path <oci-config-file>] [-debug] [-verbose]

Options

Option Required Description
-model-name |-mn Yes OCI embedding model or dedicated endpoint identifier.
-serving-type |-st Yes Serving type. Valid values are ON-DEMAND and DEDICATED.
-compartment-id |-ci Yes OCID of the OCI compartment.
-config-path |-ocp No Path to an OCI configuration file.
-debug |-d No Enables diagnostic output.
-verbose |-v No Enables informational output.

14.19.2 MODEL INGEST

Use model ingest to generate vector embeddings for local documents and store the document chunks and their corresponding embeddings in an Oracle vector table.

Syntax

MODEL INGEST -path <file-or-directory>
-table <vector-table> [-debug] [-verbose]

Options

Option Required Description
-path | -fp Yes Path to file or directory to ingest.
-table | -tb Yes Name of the target vector table.
-debug | -d No Enables diagnostic output.
-verbose | -v No Displays scanning, model, and file progress information.

14.19.3 MODEL DELETE

Use model delete to remove vectors associated with a previously ingested document.

Syntax

MODEL DELETE -file-path <file>
-table <vector-table> [-debug] [-verbose]

Options

Option Required Description
-file-path |-fp Yes Path to the previously ingested file.
-table |-tb Yes Vector table containing the document.
-debug |-d No Enables diagnostic output.
-verbose |-v No Displays deletion progress.