8.3.33. tokenizer_list

8.3.33.1. 概要

tokenizer_list command lists tokenizers in a database.

8.3.33.2. 構文

tokenizer_list command takes no parameter.

tokenizer_list

8.3.33.3. 使い方

以下は簡単な使用例です。

実行例:

tokenizer_list
# [
#   [
#     0,
#     0.0,
#     0.0
#   ],
#   [
#     {
#       "name": "TokenMecab"
#     },
#     {
#       "name": "TokenDelimit"
#     },
#     {
#       "name": "TokenUnigram"
#     },
#     {
#       "name": "TokenBigram"
#     },
#     {
#       "name": "TokenTrigram"
#     },
#     {
#       "name": "TokenBigramSplitSymbol"
#     },
#     {
#       "name": "TokenBigramSplitSymbolAlpha"
#     },
#     {
#       "name": "TokenBigramSplitSymbolAlphaDigit"
#     },
#     {
#       "name": "TokenBigramIgnoreBlank"
#     },
#     {
#       "name": "TokenBigramIgnoreBlankSplitSymbol"
#     },
#     {
#       "name": "TokenBigramIgnoreBlankSplitSymbolAlpha"
#     },
#     {
#       "name": "TokenBigramIgnoreBlankSplitSymbolAlphaDigit"
#     },
#     {
#       "name": "TokenDelimitNull"
#     }
#   ]
# ]

It returns tokenizers in a database.

8.3.33.4. 戻り値

tokenizer_list command returns tokenizers. Each tokenizers has an attribute that contains the name. The attribute will be increased in the feature:

[HEADER, tokenizer]

HEADER

HEADER については 出力形式 を参照してください。

tokenizer

tokenizer is an array of tokenizer. Tokenizer is an object that has the following attributes.

名前

説明

name Tokenizer name.

8.3.33.5. 参考