You are looking at documentation for an older release.
Not what you want? See the
current release documentation.
UAX Email URL Tokenizeredit
A tokenizer of type uax_url_email which works exactly like the
standard tokenizer, but tokenizes emails and urls as single tokens.
The following are settings that can be set for a uax_url_email
tokenizer type:
| Setting | Description |
|---|---|
| The maximum token length. If a token is seen that
exceeds this length then it is discarded. Defaults to |