Beta values _^_0_^_ for Adam
\n": "Adam_^_0_^_ \u7684 Beta \u503c
\n", "Epsilon _^_0_^_ for adam
\n": "Epsilon_^_0_^_ \u4ee3\u8868\u4e9a\u5f53
\n", "Learning rate _^_0_^_
\n": "\u5b66\u4e60\u7387_^_0_^_
\n", "Model embedding size for Noam optimizer
\n": "Noam \u4f18\u5316\u5668\u7684\u6a21\u578b\u5d4c\u5165\u5927\u5c0f
\n", "Momentum for SGD
\n": "\u65b0\u52a0\u5761\u5143\u7684\u52bf\u5934
\n", "Number of warmup optimizer steps
\n": "\u9884\u70ed\u4f18\u5316\u5668\u6b65\u9aa4\u6570
\n", "Optimizer
\n": "\u4f18\u5316\u5668
\n", "Parameters to be optimized
\n": "\u8981\u4f18\u5316\u7684\u53c2\u6570
\n", "Total number of optimizer steps (for cosine decay)
\n": "\u4f18\u5316\u5668\u6b65\u957f\u603b\u6570\uff08\u4f59\u5f26\u8870\u51cf\uff09
\n", "Weight decay
\n": "\u4f53\u91cd\u8870\u51cf
\n", "Whether the adam update is optimized (different epsilon)
\n": "adam \u66f4\u65b0\u662f\u5426\u7ecf\u8fc7\u4f18\u5316\uff08\u4e0d\u540c\u7684 epsilon\uff09
\n", "Whether to degenerate to SGD in AdaBelief
\n": "\u662f\u5426\u5728 AdaBeLief \u4e2d\u9000\u5316\u4e3a\u65b0\u52a0\u5761\u5143
\n", "Whether to use AMSGrad
\n": "\u662f\u5426\u4f7f\u7528 AmsGrad
\n", "Whether to use Rectified Adam in AdaBelief
\n": "\u662f\u5426\u5728 AdaBelief \u4e2d\u4f7f\u7528\u6574\u6539\u8fc7\u7684\u4e9a\u5f53
\n", "Whether weight decay is absolute or should be multiplied by learning rate
\n": "\u4f53\u91cd\u8870\u51cf\u662f\u7edd\u5bf9\u7684\u8fd8\u662f\u5e94\u8be5\u4e58\u4ee5\u5b66\u4e60\u901f\u7387
\n", "Whether weight decay is decoupled; i.e. weight decay is not added to gradients
\n": "\u6743\u91cd\u8870\u51cf\u662f\u5426\u89e3\u8026\uff1b\u5373\u6743\u91cd\u8870\u51cf\u4e0d\u6dfb\u52a0\u5230\u68af\u5ea6\u4e2d
\n", "Configurable optimizer module": "\u53ef\u914d\u7f6e\u7684\u4f18\u5316\u5668\u6a21\u5757", "This implements a configurable module for optimizers.": "\u8fd9\u4e3a\u4f18\u5316\u5668\u5b9e\u73b0\u4e86\u4e00\u4e2a\u53ef\u914d\u7f6e\u7684\u6a21\u5757\u3002" }