foresthub::core::Options Struct Reference

Model-specific generation options. More...

#include <options.hpp>

Public Member Functions
Options &	WithMaxTokens (int max_tokens)
	Set the maximum number of tokens to generate.
Options &	WithTemperature (float temperature)
	Set the sampling temperature.
Options &	WithTopK (int top_k)
	Set the top-k sampling limit.
Options &	WithTopP (float top_p)
	Set the nucleus sampling cutoff.
Options &	WithFrequencyPenalty (float frequency_penalty)
	Set the frequency penalty.
Options &	WithPresencePenalty (float presence_penalty)
	Set the presence penalty.
Options &	WithSeed (int seed)
	Set the random seed for deterministic output.

Public Attributes
foresthub::Optional< int >	max_tokens
	Maximum tokens to generate.
foresthub::Optional< float >	temperature
	Randomness (0.0 to 1.0).
foresthub::Optional< int >	top_k
	Maximum tokens to consider.
foresthub::Optional< float >	top_p
	Nucleus sampling cutoff.
foresthub::Optional< float >	frequency_penalty
	Reduces repetition.
foresthub::Optional< float >	presence_penalty
	Encourages new concepts.
foresthub::Optional< int >	seed
	Seed for deterministic generation.

Detailed Description

Model-specific generation options.

---

The documentation for this struct was generated from the following file:

• include/foresthub/core/options.hpp