static GenericChatRequest.Builder |
GenericChatRequest.builder() |
Create a new builder.
|
GenericChatRequest.Builder |
GenericChatRequest.Builder.copy(GenericChatRequest model) |
|
GenericChatRequest.Builder |
GenericChatRequest.Builder.frequencyPenalty(Double frequencyPenalty) |
To reduce repetitiveness of generated tokens, this number penalizes new tokens based on
their frequency in the generated text so far.
|
GenericChatRequest.Builder |
GenericChatRequest.Builder.isEcho(Boolean isEcho) |
Whether to include the user prompt in the response.
|
GenericChatRequest.Builder |
GenericChatRequest.Builder.isParallelToolCalls(Boolean isParallelToolCalls) |
Whether to enable parallel function calling during tool use.
|
GenericChatRequest.Builder |
GenericChatRequest.Builder.isStream(Boolean isStream) |
Whether to stream back partial progress.
|
GenericChatRequest.Builder |
GenericChatRequest.Builder.logitBias(Object logitBias) |
Modifies the likelihood of specified tokens that appear in the completion.
|
GenericChatRequest.Builder |
GenericChatRequest.Builder.logProbs(Integer logProbs) |
Includes the logarithmic probabilities for the most likely output tokens and the chosen
tokens.
|
GenericChatRequest.Builder |
GenericChatRequest.Builder.maxCompletionTokens(Integer maxCompletionTokens) |
An upper bound for the number of tokens that can be generated for a completion, including
visible output tokens and reasoning tokens.
|
GenericChatRequest.Builder |
GenericChatRequest.Builder.maxTokens(Integer maxTokens) |
The maximum number of tokens that can be generated per output sequence.
|
GenericChatRequest.Builder |
GenericChatRequest.Builder.messages(List<Message> messages) |
The series of messages in a chat request.
|
GenericChatRequest.Builder |
GenericChatRequest.Builder.metadata(Object metadata) |
Set of 16 key-value pairs that can be attached to an object.
|
GenericChatRequest.Builder |
GenericChatRequest.Builder.numGenerations(Integer numGenerations) |
The number of of generated texts that will be returned.
|
GenericChatRequest.Builder |
GenericChatRequest.Builder.prediction(Prediction prediction) |
|
GenericChatRequest.Builder |
GenericChatRequest.Builder.presencePenalty(Double presencePenalty) |
To reduce repetitiveness of generated tokens, this number penalizes new tokens based on
whether they’ve appeared in the generated text so far.
|
GenericChatRequest.Builder |
GenericChatRequest.Builder.reasoningEffort(GenericChatRequest.ReasoningEffort reasoningEffort) |
Constrains effort on reasoning for reasoning models.
|
GenericChatRequest.Builder |
GenericChatRequest.Builder.responseFormat(ResponseFormat responseFormat) |
|
GenericChatRequest.Builder |
GenericChatRequest.Builder.seed(Integer seed) |
If specified, the backend will make a best effort to sample tokens deterministically, so
that repeated requests with the same seed and parameters yield the same result.
|
GenericChatRequest.Builder |
GenericChatRequest.Builder.stop(List<String> stop) |
List of strings that stop the generation if they are generated for the response text.
|
GenericChatRequest.Builder |
GenericChatRequest.Builder.streamOptions(StreamOptions streamOptions) |
|
GenericChatRequest.Builder |
GenericChatRequest.Builder.temperature(Double temperature) |
A number that sets the randomness of the generated output.
|
GenericChatRequest.Builder |
GenericChatRequest.toBuilder() |
|
GenericChatRequest.Builder |
GenericChatRequest.Builder.toolChoice(ToolChoice toolChoice) |
|
GenericChatRequest.Builder |
GenericChatRequest.Builder.tools(List<ToolDefinition> tools) |
A list of tools the model may call.
|
GenericChatRequest.Builder |
GenericChatRequest.Builder.topK(Integer topK) |
An integer that sets up the model to use only the top k most likely tokens in the
generated output.
|
GenericChatRequest.Builder |
GenericChatRequest.Builder.topP(Double topP) |
If set to a probability 0.0 < p < 1.0, it ensures that only the most likely tokens, with
total probability mass of p, are considered for generation at each step.
|
GenericChatRequest.Builder |
GenericChatRequest.Builder.verbosity(GenericChatRequest.Verbosity verbosity) |
Constrains the verbosity of the model’s response.
|
GenericChatRequest.Builder |
GenericChatRequest.Builder.webSearchOptions(WebSearchOptions webSearchOptions) |
|