8.3.33. tokenizer_list¶
8.3.33.1. 概要¶
tokenizer_list command lists tokenizers in a database.
8.3.33.3. 使い方¶
以下は簡単な使用例です。
実行例:
tokenizer_list
# [
# [
# 0,
# 0.0,
# 0.0
# ],
# [
# {
# "name": "TokenMecab"
# },
# {
# "name": "TokenDelimit"
# },
# {
# "name": "TokenUnigram"
# },
# {
# "name": "TokenBigram"
# },
# {
# "name": "TokenTrigram"
# },
# {
# "name": "TokenBigramSplitSymbol"
# },
# {
# "name": "TokenBigramSplitSymbolAlpha"
# },
# {
# "name": "TokenBigramSplitSymbolAlphaDigit"
# },
# {
# "name": "TokenBigramIgnoreBlank"
# },
# {
# "name": "TokenBigramIgnoreBlankSplitSymbol"
# },
# {
# "name": "TokenBigramIgnoreBlankSplitSymbolAlpha"
# },
# {
# "name": "TokenBigramIgnoreBlankSplitSymbolAlphaDigit"
# },
# {
# "name": "TokenDelimitNull"
# }
# ]
# ]
It returns tokenizers in a database.
8.3.33.4. 戻り値¶
tokenizer_list command returns tokenizers. Each tokenizers has an attribute that contains the name. The attribute will be increased in the feature:
[HEADER, tokenizer]
HEADER
HEADER については 出力形式 を参照してください。
tokenizer
tokenizer is an array of tokenizer. Tokenizer is an object that has the following attributes.
名前
説明
name Tokenizer name.