New Hardware Unit Shapes Available for Cohere and Meta Models in OCI Generative AI

New hardware unit shapes are available for hosting select Cohere and Meta models on dedicated AI clusters in OCI Generative AI. The new unit shape names begin with a Cohere_ or Meta_ prefix and identify the underlying hardware and number of required hardware units.

Cohere models

• Cohere Command A (cohere.command-a-03-2025)
• Cohere Command A Reasoning (cohere.command-a-reasoning)
• Cohere Command A Vision (cohere.command-a-vision)
• Cohere Embed 4 (cohere.embed-v4.0)
• Cohere Rerank 4 Pro (cohere.rerank-v4.0-pro)
• Cohere Rerank 4 Fast (cohere.rerank-v4.0-fast)

Meta models

• Meta Llama 4 Maverick (meta.llama-4-maverick-17b-128e-instruct-fp8)
• Meta Llama 4 Scout (meta.llama-4-scout-17b-16e-instruct)
• Meta Llama 3.3 (70B) (meta.llama-3.3-70b-instruct and meta.llama-3.3-70b-instruct-fp8-dynamic)

Legacy generic shapes

The earlier generic unit shapes for these Cohere and Meta models are legacy shapes and are being retired. During the retirement period, existing dedicated AI clusters that use a legacy shape continue to work, and the legacy shapes remain available through the API only. For new dedicated AI clusters, select one of the new provider-prefixed hardware unit shapes available for the model and region.

Hardware unit shape availability varies by model and region. For supported shapes, regions, and service limit names, see Hardware Unit Shapes by Region.