Tool Support

OCI Generative AI has tool support for the pretrained chat models, enabling them to integrate with external tools and APIs to enhance their responses.

A tool call can help a model produce contextually relevant responses and also broadens its utility, enabling the model to handle complex queries and perform tasks requiring external data and processing. For example, using tool calls, you can have a model fetch real-time data, run code, and interact with databases. Tool support is available only through the API.

• For Meta Llama models, see the new tools attribute in the GenericChatRequest API reference.

• For Cohere models, see the tools attribute in the CohereChatRequest API reference.