Files
paddlepaddle--paddlenlp/docs/zh/source/paddlenlp.transformers.codegen.tokenizer.rst
wehub-resource-sync 2aaeece67c
Codestyle Check / Lint (push) Has been cancelled
Codestyle Check / Check bypass (push) Has been cancelled
Pipelines-Test / Pipelines-Test (push) Has been cancelled
chore: import upstream snapshot with attribution
2026-07-13 13:37:14 +08:00

8 lines
173 B
ReStructuredText

tokenizer
===============================================
.. automodule:: paddlenlp.transformers.codegen.tokenizer
:members:
:no-undoc-members:
:show-inheritance: