{ "

GPT-NeoX Checkpoints

\n": "

GPT-\u30cd\u30aa\u30c3\u30af\u30b9\u30c1\u30a7\u30c3\u30af\u30dd\u30a4\u30f3\u30c8

\n", "

Download all checkpoint files

\n": "

\u3059\u3079\u3066\u306e\u30c1\u30a7\u30c3\u30af\u30dd\u30a4\u30f3\u30c8\u30d5\u30a1\u30a4\u30eb\u3092\u30c0\u30a6\u30f3\u30ed\u30fc\u30c9

\n", "

Get files to download

\n\n": "

\u30c0\u30a6\u30f3\u30ed\u30fc\u30c9\u3059\u308b\u30d5\u30a1\u30a4\u30eb\u3092\u53d6\u5f97

\n\n", "

Load a pair of checkpoint files

\n\n": "

1 \u7d44\u306e\u30c1\u30a7\u30c3\u30af\u30dd\u30a4\u30f3\u30c8\u30d5\u30a1\u30a4\u30eb\u3092\u30ed\u30fc\u30c9\u3059\u308b

\n

\u30ed\u30fc\u30c9\u3055\u308c\u305f\u30d1\u30e9\u30e1\u30fc\u30bf\u30c6\u30f3\u30bd\u30eb\u3092\u8fd4\u3057\u307e\u3059\u3002

\n", "

Load a parameter by merging the partitions along first dimension

\n\n": "

1 \u756a\u76ee\u306e\u6b21\u5143\u306b\u6cbf\u3063\u3066\u30d1\u30fc\u30c6\u30a3\u30b7\u30e7\u30f3\u3092\u30de\u30fc\u30b8\u3057\u3066\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u30ed\u30fc\u30c9\u3057\u307e\u3059

\n\n", "

Load a parameter by merging the partitions along second dimension

\n\n": "

2 \u756a\u76ee\u306e\u6b21\u5143\u306b\u6cbf\u3063\u3066\u30d1\u30fc\u30c6\u30a3\u30b7\u30e7\u30f3\u3092\u30de\u30fc\u30b8\u3057\u3066\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u30ed\u30fc\u30c9\u3057\u307e\u3059

\n\n", "

Load an un-partitioned parameter

\n

This does a sanity check to make use both partitions are the same

\n\n": "

\u30d1\u30fc\u30c6\u30a3\u30b7\u30e7\u30f3\u5316\u3055\u308c\u3066\u3044\u306a\u3044\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u30ed\u30fc\u30c9\u3059\u308b

\n

\u3053\u308c\u306b\u3088\u308a\u3001\u4e21\u65b9\u306e\u30d1\u30fc\u30c6\u30a3\u30b7\u30e7\u30f3\u304c\u540c\u3058\u3067\u3042\u308b\u3053\u3068\u3092\u78ba\u8a8d\u3059\u308b\u305f\u3081\u306e\u30b5\u30cb\u30c6\u30a3\u30c1\u30a7\u30c3\u30af\u304c\u884c\u308f\u308c\u307e\u3059\u3002

\n\n", "

Load biases that are partitioned which gets added on reduce

\n\n": "

\u5206\u5272\u3055\u308c\u305f\u8ca0\u8377\u30d0\u30a4\u30a2\u30b9\u304c\u30ea\u30c7\u30e5\u30fc\u30b9\u6642\u306b\u8ffd\u52a0\u3055\u308c\u308b

\n\n", "

\n": "

\n", "

Download

\n": "

[\u30c0\u30a6\u30f3\u30ed\u30fc\u30c9]

\n", "

Download path

\n": "

\u30c0\u30a6\u30f3\u30ed\u30fc\u30c9\u30d1\u30b9

\n", "

Embedding layer

\n": "

\u57cb\u3081\u8fbc\u307f\u30ec\u30a4\u30e4\u30fc

\n", "

Empty states (not used)

\n": "

\u7a7a\u306e\u72b6\u614b (\u672a\u4f7f\u7528)

\n", "

Final normalization layer and readout layer

\n": "

\u6700\u7d42\u6b63\u898f\u5316\u5c64\u3068\u8aad\u307f\u51fa\u3057\u5c64

\n", "

Get files to download

\n": "

\u30c0\u30a6\u30f3\u30ed\u30fc\u30c9\u3059\u308b\u30d5\u30a1\u30a4\u30eb\u3092\u53d6\u5f97

\n", "

Iterate

\n": "

\u7e70\u308a\u8fd4\u3057

\n", "

Layer checkpoints

\n": "

\u30ec\u30a4\u30e4\u30fc\u30c1\u30a7\u30c3\u30af\u30dd\u30a4\u30f3\u30c8

\n", "

Log

\n": "

\u30ed\u30b0

\n", "

Parent url

\n": "

\u4fdd\u8b77\u8005\u306e URL

\n", "

Transformer layers

\n": "

\u30c8\u30e9\u30f3\u30b9\u30d5\u30a9\u30fc\u30de\u30fc\u5c64

\n", "

Vocabulary and configs

\n": "

\u8a9e\u5f59\u3068\u69cb\u6210

\n", "Code to download checkpoints and helpers to load them.": "\u30c1\u30a7\u30c3\u30af\u30dd\u30a4\u30f3\u30c8\u3068\u305d\u308c\u3089\u3092\u30ed\u30fc\u30c9\u3059\u308b\u30d8\u30eb\u30d1\u30fc\u3092\u30c0\u30a6\u30f3\u30ed\u30fc\u30c9\u3059\u308b\u30b3\u30fc\u30c9\u3002", "GPT-NeoX Checkpoints": "GPT-\u30cd\u30aa\u30c3\u30af\u30b9\u30c1\u30a7\u30c3\u30af\u30dd\u30a4\u30f3\u30c8" }