TTMSMCPSamplingModelHint Class
Suggests a model, or a family of models, that the client should prefer when it serves a completion request.
API unit family: TMS.MCP.Sampling
Inherits from: TPersistent
Syntax
TTMSMCPSamplingModelHint = class(TPersistent)
class PASCALIMPLEMENTATION TTMSMCPSamplingModelHint : public System::Classes::TPersistent
Remarks
Hints are advisory: the client owns the model connection and decides which model actually runs, and may substitute a comparable one. Add hints through TTMSMCPSamplingModelPreferences.AddHint.
Properties
| Name | Description |
|---|---|
| Name | Name of the suggested model. |
Methods
| Name | Description |
|---|---|
| ToJSON | Builds the payload representation of the hint. |