aidputils.agents.tools.service.genai_service¶

class aidputils.agents.tools.service.genai_service.GenAIService(config, signer, service_endpoint)[source]¶

Bases: object

generate_embedding_text(embedding_model_name, list_text)[source]¶

generate_response(conf, runtime_params, result_list)[source]¶

static build_message(model_provider, msg_content)[source]¶

static extract_chat_response(chat_response, model_provider)[source]¶

static get_llm_default_prompt()[source]¶

static get_llm_default_model_name()[source]¶

classmethod get_genai_client(endpoint, signer)[source]¶: Return a cached GenerativeAiInferenceClient for the given endpoint and signer, or construct one if needed.