wehub/hankcs--hanlp
1
0
Fork 0
Code Issues Pull Requests Actions Deployments Models Agent Notes Packages Projects Releases Wiki Activity
Files
main
hankcs--hanlp/docs/api/hanlp/layers/transformers/tokenizer.md
T
wehub-resource-sync 1fad2ccf05 chore: import upstream snapshot with attribution
2026-07-13 12:37:18 +08:00

127 B
Raw Permalink Blame History

tokenizer


.. autoclass:: hanlp.transform.transformer_tokenizer.TransformerSequenceTokenizer
	:members:
Reference in New Issue View Git Blame Copy Permalink