agents::LLMOptions Struct Reference

Options for LLM API calls. More...

#include <llm_interface.h>

Public Attributes
double	temperature = 0.7
	The temperature of the LLM.
int	max_tokens = 1024
	The maximum number of tokens.
double	top_p = 1.0
	The top p of the LLM.
double	presence_penalty = 0.0
	The presence penalty of the LLM.
double	frequency_penalty = 0.0
	The frequency penalty of the LLM.
int	timeout_ms = 30000
	The timeout in milliseconds.
std::vector< String >	stop_sequences
	The stop sequences of the LLM.
std::optional< JsonObject >	response_schema
	Response schema for structured output (JSON schema)
std::optional< String >	response_mime_type
	Response MIME type for structured output.

Detailed Description

Options for LLM API calls.

Examples

actor_agent_example.cpp.

Member Data Documentation

response_mime_type

std::optional<String> agents::LLMOptions::response_mime_type

Response MIME type for structured output.

Note

Use "application/json" for JSON output, "text/x.enum" for enum output