TTMSMCPSamplingRequest.MaxTokens Property

Upper limit on the number of tokens the model may generate for the reply.

API unit family: TMS.MCP.Sampling Declaring type: TTMSMCPSamplingRequest Type: Integer

Syntax

property MaxTokens: Integer;

Remarks

Defaults to 1000, and an assigned value of zero or less is raised to 1. Reaching the limit ends the reply with the ssrMaxTokens stop reason.