TTMSMCPSamplingModelPreferences Class

Guidance for the client on which model to pick for a completion request, combining name hints with the relative weight given to cost, speed and capability.

API unit family: TMS.MCP.Sampling Inherits from: TPersistent

Syntax

TTMSMCPSamplingModelPreferences = class(TPersistent)

Remarks

All three weights run from 0 to 1 and default to 0.5; a value outside that range is clamped to it. The guidance is advisory, since the client makes the final choice.

Properties

Name	Description
CostPriority	Weight given to keeping the cost of the completion low, from 0 (unimportant) to 1 (most important).
Hints	Suggested models, in the order they were added.
IntelligencePriority	Weight given to the capability of the model, from 0 (unimportant) to 1 (most important).
SpeedPriority	Weight given to receiving the completion quickly, from 0 (unimportant) to 1 (most important).

Methods

Name	Description
AddHint	Adds a suggested model name and returns the hint that was created for it.
ToJSON	Builds the payload representation of the preferences.