Namespace OnDemandServingMode

The model's serving mode is on-demand serving on a shared infrastructure.

Properties

Methods

Properties

modelId

modelId: string

The unique ID of a model to use. You can use the {@link #listModels(ListModelsRequest) listModels} API to list the available models.

Const servingType

servingType: string = "ON_DEMAND"

Methods

getDeserializedJsonObj

getDeserializedJsonObj(obj: ServingMode): object

- Defined in lib/generativeaiinference/lib/model/serving-mode.ts:53
Parameters
- obj: ServingMode
Returns object

getJsonObj

getJsonObj(obj: ServingMode): object

- Defined in lib/generativeaiinference/lib/model/serving-mode.ts:32
Parameters
- obj: ServingMode
Returns object