AllocatableGpuSummary

class oci.generative_ai.models.AllocatableGpuSummary(**kwargs)

Bases: object

Information about allocatable GPUs that can be used to launch dedicated AI clusters.

Methods

__init__(**kwargs) Initializes a new AllocatableGpuSummary object with values from keyword arguments.

Attributes

compute_shape [Required] Gets the compute_shape of this AllocatableGpuSummary.
gpu_allocations [Required] Gets the gpu_allocations of this AllocatableGpuSummary.
max_allocatable_gpu_units [Required] Gets the max_allocatable_gpu_units of this AllocatableGpuSummary.
total_available_gpu_units [Required] Gets the total_available_gpu_units of this AllocatableGpuSummary.
total_used_gpu_units [Required] Gets the total_used_gpu_units of this AllocatableGpuSummary.
__init__(**kwargs)

Initializes a new AllocatableGpuSummary object with values from keyword arguments. The following keyword arguments are supported (corresponding to the getters/setters of this class):

Parameters:
  • compute_shape (str) – The value to assign to the compute_shape property of this AllocatableGpuSummary.
  • total_available_gpu_units (int) – The value to assign to the total_available_gpu_units property of this AllocatableGpuSummary.
  • total_used_gpu_units (int) – The value to assign to the total_used_gpu_units property of this AllocatableGpuSummary.
  • max_allocatable_gpu_units (int) – The value to assign to the max_allocatable_gpu_units property of this AllocatableGpuSummary.
  • gpu_allocations (list[oci.generative_ai.models.GpuAllocation]) – The value to assign to the gpu_allocations property of this AllocatableGpuSummary.
compute_shape

[Required] Gets the compute_shape of this AllocatableGpuSummary. The compute shape for the allocatable GPUs.

Returns:The compute_shape of this AllocatableGpuSummary.
Return type:str
gpu_allocations

[Required] Gets the gpu_allocations of this AllocatableGpuSummary. The GPU allocation details for the compute shape. Each item represents one underlying capacity allocation.

Returns:The gpu_allocations of this AllocatableGpuSummary.
Return type:list[oci.generative_ai.models.GpuAllocation]
max_allocatable_gpu_units

[Required] Gets the max_allocatable_gpu_units of this AllocatableGpuSummary. The largest contiguous number of GPU units available from one reservation-backed host for the compute shape. This includes an unused reserved host that must be provisioned before workloads can be scheduled.

Returns:The max_allocatable_gpu_units of this AllocatableGpuSummary.
Return type:int
total_available_gpu_units

[Required] Gets the total_available_gpu_units of this AllocatableGpuSummary. The total number of available GPU units for the compute shape.

Returns:The total_available_gpu_units of this AllocatableGpuSummary.
Return type:int
total_used_gpu_units

[Required] Gets the total_used_gpu_units of this AllocatableGpuSummary. The total number of used GPU units for the compute shape.

Returns:The total_used_gpu_units of this AllocatableGpuSummary.
Return type:int