{ "

MNIST example to test the optimizers

\n": "

\u30aa\u30d7\u30c6\u30a3\u30de\u30a4\u30b6\u3092\u30c6\u30b9\u30c8\u3059\u308b\u305f\u3081\u306e MNIST \u306e\u4f8b

\n", "

Configurable Experiment Definition

\n": "

\u8a2d\u5b9a\u53ef\u80fd\u306a\u5b9f\u9a13\u5b9a\u7fa9

\n", "

The model

\n": "

\u30e2\u30c7\u30eb

\n", "

Create a configurable optimizer. We can change the optimizer type and hyper-parameters using configurations.

\n": "

\u8a2d\u5b9a\u53ef\u80fd\u306a\u30aa\u30d7\u30c6\u30a3\u30de\u30a4\u30b6\u30fc\u3092\u4f5c\u6210\u3057\u307e\u3059\u3002\u69cb\u6210\u3092\u4f7f\u7528\u3057\u3066\u30aa\u30d7\u30c6\u30a3\u30de\u30a4\u30b6\u306e\u30bf\u30a4\u30d7\u3068\u30cf\u30a4\u30d1\u30fc\u30d1\u30e9\u30e1\u30fc\u30bf\u3092\u5909\u66f4\u3067\u304d\u307e\u3059

\u3002\n", "

Add global step if we are in training mode

\n": "

\u30c8\u30ec\u30fc\u30cb\u30f3\u30b0\u30e2\u30fc\u30c9\u306e\u5834\u5408\u306f\u30b0\u30ed\u30fc\u30d0\u30eb\u30b9\u30c6\u30c3\u30d7\u3092\u8ffd\u52a0

\n", "

Calculate the accuracy

\n": "

\u7cbe\u5ea6\u306e\u8a08\u7b97

\n", "

Calculate the gradients

\n": "

\u52fe\u914d\u306e\u8a08\u7b97

\n", "

Calculate the loss

\n": "

\u640d\u5931\u306e\u8a08\u7b97

\n", "

Clear the gradients

\n": "

\u30b0\u30e9\u30c7\u30fc\u30b7\u30e7\u30f3\u3092\u30af\u30ea\u30a2

\n", "

Get the batch

\n": "

\u30d0\u30c3\u30c1\u3092\u5165\u624b

\n", "

Log the loss

\n": "

\u640d\u5931\u3092\u8a18\u9332\u3059\u308b

\n", "

Log the parameter and gradient L2 norms once per epoch

\n": "

\u30d1\u30e9\u30e1\u30fc\u30bf\u30fc\u3068\u52fe\u914d\u306e L2 \u30ce\u30eb\u30e0\u3092\u30a8\u30dd\u30c3\u30af\u3054\u3068\u306b 1 \u56de\u8a18\u9332\u3057\u307e\u3059\u3002

\n", "

Optimize if we are in training mode

\n": "

\u30c8\u30ec\u30fc\u30cb\u30f3\u30b0\u30e2\u30fc\u30c9\u306e\u5834\u5408\u306f\u6700\u9069\u5316

\n", "

Run the model and specify whether to log the activations

\n": "

\u30e2\u30c7\u30eb\u3092\u5b9f\u884c\u3057\u3001\u30a2\u30af\u30c6\u30a3\u30d9\u30fc\u30b7\u30e7\u30f3\u3092\u30ed\u30b0\u306b\u8a18\u9332\u3059\u308b\u304b\u3069\u3046\u304b\u3092\u6307\u5b9a\u3057\u307e\u3059

\n", "

Save logs

\n": "

\u30ed\u30b0\u3092\u4fdd\u5b58

\n", "

Specify the optimizer

\n": "

\u30aa\u30d7\u30c6\u30a3\u30de\u30a4\u30b6\u30fc\u3092\u6307\u5b9a

\n", "

Take optimizer step

\n": "

\u6700\u9069\u5316\u306e\u4e00\u6b69\u3092\u8e0f\u307f\u51fa\u3059

\n", "MNIST example to test the optimizers": "\u30aa\u30d7\u30c6\u30a3\u30de\u30a4\u30b6\u3092\u30c6\u30b9\u30c8\u3059\u308b\u305f\u3081\u306e MNIST \u306e\u4f8b", "This is a simple MNIST example with a CNN model to test the optimizers.": "\u3053\u308c\u306f\u3001CNN \u30e2\u30c7\u30eb\u3092\u4f7f\u7528\u3057\u3066\u30aa\u30d7\u30c6\u30a3\u30de\u30a4\u30b6\u30fc\u3092\u30c6\u30b9\u30c8\u3059\u308b\u7c21\u5358\u306a MNIST \u306e\u4f8b\u3067\u3059\u3002" }