TTMSFNCMemoCustomLanguageTokenizer Class
A collection of named tokenizer states that together define the complete lexing state machine for a custom language.
API unit family: TMSFNCMemoCustomLanguage
Inherits from: TTMSFNCOwnedCollection
Syntax
TTMSFNCMemoCustomLanguageTokenizer = class(TTMSFNCOwnedCollection)
Properties
| Name | Description |
|---|---|
| Items | Returns the tokenizer state at the given zero-based index. |
Methods
| Name | Description |
|---|---|
| Add | Appends a new empty tokenizer state to the collection. |
| Insert | Inserts a new empty tokenizer state at the specified position. |