{ "

Train a ConvMixer on CIFAR 10

\n

This script trains a ConvMixer on CIFAR 10 dataset.

\n

This is not an attempt to reproduce the results of the paper. The paper uses image augmentations present in PyTorch Image Models (timm) for training. We haven't done this for simplicity - which causes our validation accuracy to drop.

\n": "

\u5728 CIFA R 10 \u4e0a\u8bad\u7ec3 convMixer

\n

\u6b64\u811a\u672c\u5728 CIFAR 10 \u6570\u636e\u96c6\u4e0a\u8bad\u7ec3 ConvMixer\u3002

\n

\u8fd9\u5e76\u4e0d\u662f\u8bd5\u56fe\u91cd\u73b0\u8bba\u6587\u7684\u7ed3\u679c\u3002\u672c\u6587\u4f7f\u7528 PyTorch \u56fe\u50cf\u6a21\u578b (timm) \u4e2d\u5b58\u5728\u7684\u56fe\u50cf\u589e\u5f3a\u8fdb\u884c\u8bad\u7ec3\u3002\u4e3a\u4e86\u7b80\u5355\u8d77\u89c1\uff0c\u6211\u4eec\u6ca1\u6709\u8fd9\u6837\u505a\u2014\u2014\u8fd9\u4f1a\u5bfc\u81f4\u6211\u4eec\u7684\u9a8c\u8bc1\u7cbe\u5ea6\u4e0b\u964d\u3002

\n", "

Configurations

\n

We use _^_0_^_ which defines all the dataset related configurations, optimizer, and a training loop.

\n": "

\u914d\u7f6e

\n

\u6211\u4eec\u4f7f\u7528_^_0_^_\u5b83\u6765\u5b9a\u4e49\u6240\u6709\u4e0e\u6570\u636e\u96c6\u76f8\u5173\u7684\u914d\u7f6e\u3001\u4f18\u5316\u5668\u548c\u8bad\u7ec3\u5faa\u73af\u3002

\n", "

Create model

\n": "

\u521b\u5efa\u6a21\u578b

\n", "

\n": "

\n", "

Create ConvMixer

\n": "

\u521b\u5efa\u6df7\u97f3\u5668

\n", "

Create configurations

\n": "

\u521b\u5efa\u914d\u7f6e

\n", "

Create experiment

\n": "

\u521b\u5efa\u5b9e\u9a8c

\n", "

Do not augment images for validation

\n": "

\u4e0d\u8981\u6269\u5145\u56fe\u50cf\u4ee5\u8fdb\u884c\u9a8c\u8bc1

\n", "

Kernel size of the depth-wise convolution, _^_0_^_

\n": "

\u6df1\u5ea6\u5377\u79ef\u7684\u5185\u6838\u5927\u5c0f\uff0c_^_0_^_

\n", "

Load configurations

\n": "

\u88c5\u8f7d\u914d\u7f6e

\n", "

Number of ConvMixer layers or depth, _^_0_^_

\n": "

ConvMixer \u5c42\u6570\u6216\u6df1\u5ea6\uff0c_^_0_^_

\n", "

Number of channels in patch embeddings, _^_0_^_

\n": "

\u8865\u4e01\u5d4c\u5165\u4e2d\u7684\u901a\u9053\u6570\uff0c_^_0_^_

\n", "

Number of classes in the task

\n": "

\u4efb\u52a1\u4e2d\u7684\u7c7b\u6570

\n", "

Optimizer

\n": "

\u4f18\u5316\u5668

\n", "

Set model for saving/loading

\n": "

\u8bbe\u7f6e\u4fdd\u5b58/\u52a0\u8f7d\u7684\u6a21\u578b

\n", "

Simple image augmentations

\n": "

\u7b80\u5355\u7684\u56fe\u50cf\u589e\u5f3a

\n", "

Size of a patch, _^_0_^_

\n": "

\u8865\u4e01\u7684\u5927\u5c0f\uff0c_^_0_^_

\n", "

Start the experiment and run the training loop

\n": "

\u5f00\u59cb\u5b9e\u9a8c\u5e76\u8fd0\u884c\u8bad\u7ec3\u5faa\u73af

\n", "

Training epochs and batch size

\n": "

\u8bad\u7ec3\u5468\u671f\u548c\u6279\u6b21\u5927\u5c0f

\n", "Train ConvMixer on CIFAR 10": "\u5728 CIFAR 10 \u4e0a\u8bad\u7ec3 ConvMixer" }