{ "

GPT-NeoX Tokenizer

\n

This initializes a Hugging Face tokenizer from the downloaded vocabulary.

\n": "

GPT-neox Tokenizer

\n

\u8fd9\u4f1a\u4ece\u4e0b\u8f7d\u7684\u8bcd\u6c47\u8868\u4e2d\u521d\u59cb\u5316\u4e00\u4e2a Hugging Face \u5206\u8bcd\u5668\u3002

\n", "

Load NeoX Tokenizer

\n\n": "

\u52a0\u8f7d neOX \u5206\u8bcd\u5668

\n\n", "GPT-NeoX Tokenizer": "GPT-neox Tokenizer", "Loads the GPT-NeoX tokenizer": "\u52a0\u8f7d GPT-NEOX \u5206\u8bcd\u5668" }