TTMSMCPSamplingRequest.MaxTokens Property
Upper limit on the number of tokens the model may generate for the reply.
API unit family: TMS.MCP.Sampling
Declaring type: TTMSMCPSamplingRequest
Type: Integer
Syntax
property MaxTokens: Integer;
__property int MaxTokens = {read=FMaxTokens, write=SetMaxTokens, nodefault};
Remarks
Defaults to 1000, and an assigned value of zero or less is raised to 1. Reaching the limit ends the reply with the ssrMaxTokens stop reason.