DedicatedServingMode¶

class oci.generative_ai_inference.models.DedicatedServingMode(**kwargs)¶

Bases: ServingMode

The model’s serving mode is dedicated serving and has an endpoint on a dedicated AI cluster.

Attributes:

`SERVING_TYPE_DEDICATED`	A constant which can be used with the serving_type property of a ServingMode.
`SERVING_TYPE_ON_DEMAND`	A constant which can be used with the serving_type property of a ServingMode.
`endpoint_id`	[Required] Gets the endpoint_id of this DedicatedServingMode.
`serving_type`	[Required] Gets the serving_type of this ServingMode.

Methods:

`__init__`(**kwargs)	Initializes a new DedicatedServingMode object with values from keyword arguments.
`get_subtype`(object_dictionary)	Given the hash representation of a subtype of this class, use the info in the hash to return the class of the subtype.

SERVING_TYPE_DEDICATED = 'DEDICATED'¶: A constant which can be used with the serving_type property of a ServingMode. This constant has a value of “DEDICATED”

SERVING_TYPE_ON_DEMAND = 'ON_DEMAND'¶: A constant which can be used with the serving_type property of a ServingMode. This constant has a value of “ON_DEMAND”

__init__(**kwargs)¶

Initializes a new DedicatedServingMode object with values from keyword arguments. The default value of the serving_type attribute of this class is DEDICATED and it should not be changed. The following keyword arguments are supported (corresponding to the getters/setters of this class):

Parameters

serving_type (str) – The value to assign to the serving_type property of this DedicatedServingMode. Allowed values for this property are: “ON_DEMAND”, “DEDICATED”
endpoint_id (str) – The value to assign to the endpoint_id property of this DedicatedServingMode.

property endpoint_id¶

[Required] Gets the endpoint_id of this DedicatedServingMode. The OCID of the endpoint to use.

Returns: The endpoint_id of this DedicatedServingMode.
Return type: str

static get_subtype(object_dictionary)¶: Given the hash representation of a subtype of this class, use the info in the hash to return the class of the subtype.

property serving_type¶

[Required] Gets the serving_type of this ServingMode. The serving mode type, which is either on-demand serving or dedicated serving.

Allowed values for this property are: “ON_DEMAND”, “DEDICATED”

Returns: The serving_type of this ServingMode.
Return type: str