wehub-resource-sync
64 lines
1.2 KiB
Markdown
64 lines
1.2 KiB
Markdown
# dataset
|
|
|
|
This module provides base definition for datasets, dataloaders and samplers.
|
|
|
|
## datasets
|
|
|
|
```{eval-rst}
|
|
.. currentmodule:: hanlp.common
|
|
|
|
.. autoclass:: hanlp.common.dataset.Transformable
|
|
:members:
|
|
|
|
.. autoclass:: hanlp.common.dataset.TransformableDataset
|
|
:members:
|
|
:special-members:
|
|
:exclude-members: __init__, __repr__
|
|
```
|
|
|
|
## dataloaders
|
|
|
|
```{eval-rst}
|
|
.. currentmodule:: hanlp.common
|
|
|
|
.. autoclass:: hanlp.common.dataset.PadSequenceDataLoader
|
|
:members:
|
|
:special-members:
|
|
:exclude-members: __init__, __repr__
|
|
|
|
.. autoclass:: hanlp.common.dataset.PrefetchDataLoader
|
|
:members:
|
|
:special-members:
|
|
:exclude-members: __init__, __repr__
|
|
```
|
|
|
|
## samplers
|
|
|
|
```{eval-rst}
|
|
.. currentmodule:: hanlp.common
|
|
|
|
.. autoclass:: hanlp.common.dataset.BucketSampler
|
|
:members:
|
|
|
|
.. autoclass:: hanlp.common.dataset.KMeansSampler
|
|
:members:
|
|
|
|
.. autoclass:: hanlp.common.dataset.SortingSampler
|
|
:members:
|
|
```
|
|
|
|
## sampler builders
|
|
|
|
```{eval-rst}
|
|
.. currentmodule:: hanlp.common
|
|
|
|
.. autoclass:: hanlp.common.dataset.SamplerBuilder
|
|
:members:
|
|
|
|
.. autoclass:: hanlp.common.dataset.SortingSamplerBuilder
|
|
:members:
|
|
|
|
.. autoclass:: hanlp.common.dataset.KMeansSamplerBuilder
|
|
:members:
|
|
|
|
``` |