Table of Contents

TTMSFNCMemoCustomLanguageTokenizer.Add Method

Appends a new empty tokenizer state to the collection.

API unit family: TMSFNCMemoCustomLanguage Declaring type: TTMSFNCMemoCustomLanguageTokenizer

Overloads

Overload 1

Appends a new empty tokenizer state to the collection.

function Add: TTMSFNCMemoCustomLanguageTokenizerItem; overload;

Returns

The newly created TTMSFNCMemoCustomLanguageTokenizerItem instance.

Overload 2

Appends a new tokenizer state with the specified name.

function Add(AName: string): TTMSFNCMemoCustomLanguageTokenizerItem; overload;

Parameters

Name Description
AName Unique name of the tokenizer state (e.g. root).

Returns

The newly created TTMSFNCMemoCustomLanguageTokenizerItem instance.