AllocatableGpuSummary

class oci.generative_ai.models.AllocatableGpuSummary(**kwargs)

Bases: object

Information about allocatable GPUs that can be used to launch dedicated AI clusters.

Methods:

__init__(**kwargs)

Initializes a new AllocatableGpuSummary object with values from keyword arguments.

Attributes:

compute_shape

[Required] Gets the compute_shape of this AllocatableGpuSummary.

gpu_allocations

[Required] Gets the gpu_allocations of this AllocatableGpuSummary.

max_allocatable_gpu_units

[Required] Gets the max_allocatable_gpu_units of this AllocatableGpuSummary.

total_available_gpu_units

[Required] Gets the total_available_gpu_units of this AllocatableGpuSummary.

total_used_gpu_units

[Required] Gets the total_used_gpu_units of this AllocatableGpuSummary.

__init__(**kwargs)

Initializes a new AllocatableGpuSummary object with values from keyword arguments. The following keyword arguments are supported (corresponding to the getters/setters of this class):

Parameters
  • compute_shape (str) – The value to assign to the compute_shape property of this AllocatableGpuSummary.

  • total_available_gpu_units (int) – The value to assign to the total_available_gpu_units property of this AllocatableGpuSummary.

  • total_used_gpu_units (int) – The value to assign to the total_used_gpu_units property of this AllocatableGpuSummary.

  • max_allocatable_gpu_units (int) – The value to assign to the max_allocatable_gpu_units property of this AllocatableGpuSummary.

  • gpu_allocations (list[oci.generative_ai.models.GpuAllocation]) – The value to assign to the gpu_allocations property of this AllocatableGpuSummary.

property compute_shape

[Required] Gets the compute_shape of this AllocatableGpuSummary. The compute shape for the allocatable GPUs.

Returns

The compute_shape of this AllocatableGpuSummary.

Return type

str

property gpu_allocations

[Required] Gets the gpu_allocations of this AllocatableGpuSummary. The GPU allocation details for the compute shape. Each item represents one underlying capacity allocation.

Returns

The gpu_allocations of this AllocatableGpuSummary.

Return type

list[oci.generative_ai.models.GpuAllocation]

property max_allocatable_gpu_units

[Required] Gets the max_allocatable_gpu_units of this AllocatableGpuSummary. The largest contiguous number of GPU units available from one reservation-backed host for the compute shape. This includes an unused reserved host that must be provisioned before workloads can be scheduled.

Returns

The max_allocatable_gpu_units of this AllocatableGpuSummary.

Return type

int

property total_available_gpu_units

[Required] Gets the total_available_gpu_units of this AllocatableGpuSummary. The total number of available GPU units for the compute shape.

Returns

The total_available_gpu_units of this AllocatableGpuSummary.

Return type

int

property total_used_gpu_units

[Required] Gets the total_used_gpu_units of this AllocatableGpuSummary. The total number of used GPU units for the compute shape.

Returns

The total_used_gpu_units of this AllocatableGpuSummary.

Return type

int