12 lines
218 B
Markdown
12 lines
218 B
Markdown
# transformer
|
|
|
|
Transformer based tokenizer.
|
|
|
|
```{eval-rst}
|
|
.. currentmodule:: hanlp.components.tokenizers.transformer
|
|
|
|
.. autoclass:: hanlp.components.tokenizers.transformer.TransformerTaggingTokenizer
|
|
:members:
|
|
|
|
```
|