FinderIndexerHelper::tokenize

Method to tokenize a text string.

Signature

public function tokenize(string $input, [string $lang = false, [boolean $phrase = false]] )

Parameters

$input

The input to tokenize.

$lang

The language of the input.

$phrase

Flag to indicate whether input could be a phrase. [optional]

Returns

array

An array of FinderIndexerToken objects.