tokenize

NAME

tokenize(): Outputs ordered result set of tokens of given text

TYPE

Procedure

DESCRIPTION

This procedure splits given text using given delimiter, and returns to tokens as a result set.

The number of tokens is limited by the number of values in the numbers table.

SYNOPSIS

tokenize(txt TEXT CHARSET utf8, delimiter_text VARCHAR(255) CHARSET utf8)

Input:

  • txt: text to be tokenized.
  • delimiter_text: delimiter by which to tokenize (can be of any length, including an empty text).

EXAMPLES

Tokenize a given text:

call tokenize('the quick brown fox', ' ');
+---+-------+
| n | token |
+---+-------+
| 1 | the   |
| 2 | quick |
| 3 | brown |
| 4 | fox   |
+---+-------+

ENVIRONMENT

MySQL 5.1 or newer

SEE ALSO

get_num_tokens(), split_token(), prettify_message()

AUTHOR

Shlomi Noach
 
common_schema documentation