Namespace Oci.GenerativeaiinferenceService.Models
Classes
AssistantMessage
Represents a single instance of assistant message.
BaseChatRequest
The base class to use for the chat inference request.
BaseChatRequestModelConverter
BaseChatResponse
The base class that creates the chat response.
BaseChatResponseModelConverter
ChatChoice
Represents a single instance of the chat response.
ChatContent
The base class for the chat content.
ChatContentModelConverter
ChatDetails
Details of the conversation for the model to respond.
ChatResult
The response to the chat conversation.
Choice
Represents a single instance of the generated text.
Citation
A section of the generated response which cites the documents that were used for generating the response.
CohereChatBotMessage
A message that represents a single chat dialog as CHATBOT role.
CohereChatRequest
Details for the chat request for Cohere models.
CohereChatResponse
The response to the chat conversation.
CohereLlmInferenceRequest
Details for the text generation request for Cohere models.
CohereLlmInferenceResponse
The generated text result to return.
CohereMessage
A message that represents a single chat dialog.
CohereMessageModelConverter
CohereParameterDefinition
A definition of tool parameter.
CohereSystemMessage
A message that represents a single chat dialog as SYSTEM role.
CohereTool
A definition of tool (function).
CohereToolCall
A tool call generated by the model.
CohereToolMessage
A message that represents a single chat dialog as TOOL role.
CohereToolResult
The result from invoking tools recommended by the model in the previous chat turn.
CohereUserMessage
A message that represents a single chat dialog as USER role.
DedicatedServingMode
The model's serving mode is dedicated serving and has an endpoint on a dedicated AI cluster.
EmbedTextDetails
Details for the request to embed texts.
EmbedTextResult
The generated embedded result to return.
GenerateTextDetails
Details for the request to generate text.
GenerateTextResult
The generated text result to return.
GeneratedText
The text generated during each run.
GenericChatRequest
Details for the chat request.
GenericChatResponse
The response for a chat conversation.
LlamaLlmInferenceRequest
Details for the text generation request for Llama models.
LlamaLlmInferenceResponse
The generated text result to return.
LlmInferenceRequest
The base class for the inference requests.
LlmInferenceRequestModelConverter
LlmInferenceResponse
The base class for inference responses.
LlmInferenceResponseModelConverter
Logprobs
Includes the logarithmic probabilities for the most likely output tokens and the chosen tokens.
For example, if the log probability is 5, the API returns a list of the 5 most likely tokens. The API returns the log probability of the sampled token, so there might be up to logprobs+1 elements in the response.
Message
A message that represents a single chat dialog.
MessageModelConverter
OnDemandServingMode
The model's serving mode is on-demand serving on a shared infrastructure.
SearchQuery
The generated search query.
ServingMode
The model's serving mode, which is either on-demand serving or dedicated serving.
ServingModeModelConverter
SummarizeTextDetails
Details for the request to summarize text.
SummarizeTextResult
Summarize text result to return to caller.
SystemMessage
Represents a single instance of system message.
TextContent
Represents a single instance of text in the chat content.
TokenLikelihood
An object that contains the returned token and its corresponding likelihood.
UserMessage
Represents a single instance of user message.