tokenizer\_utils\_base
====================================================

.. automodule:: paddlenlp.transformers.tokenizer_utils_base
   :members:
   :no-undoc-members:
   :show-inheritance:
   :special-members: __call__