wehub-resource-sync
ba4be087d5
Create PR to main with cherry-pick from release / cherry-pick (push) Failing after 0s
CICD NeMo / pre-flight (push) Failing after 0s
CICD NeMo / configure (push) Has been skipped
Build, validate, and release Neural Modules / pre-flight (push) Failing after 1s
CICD NeMo / code-linting (push) Has been skipped
Build, validate, and release Neural Modules / release (push) Has been skipped
Build, validate, and release Neural Modules / release-summary (push) Has been cancelled
CICD NeMo / cicd-test-container-build (push) Has been cancelled
CICD NeMo / cicd-import-tests (push) Has been cancelled
CICD NeMo / L0_Setup_Test_Data_And_Models (push) Has been cancelled
CICD NeMo / cicd-main-unit-tests (push) Has been cancelled
CICD NeMo / cicd-main-speech (push) Has been cancelled
CICD NeMo / Nemo_CICD_Test (push) Has been cancelled
CICD NeMo / Coverage (e2e) (push) Has been cancelled
CICD NeMo / Coverage (unit-test) (push) Has been cancelled
CodeQL / Analyze (python) (push) Has been cancelled
CICD NeMo / cicd-wait-in-queue (push) Has been cancelled
13 lines
848 B
ReStructuredText
13 lines
848 B
ReStructuredText
Models
|
|
======
|
|
|
|
End-to-End ASR models are typically of encoder-decoder style, where the encoder does acoustic
|
|
modeling i.e., converting speech wavform into features, and the decoder converts those features into
|
|
text. Encoder contains the bulk of trainable parameters and is usually the focus of SSL in ASR.
|
|
Thus, any architecture that can be used as encoder in ASR models can be pre-trained using SSL. For an
|
|
overview of model architectures that are currently supported in NeMo's ASR's collection, refer
|
|
to :doc:`ASR Featured Models <../featured_models>`. Note that SSL also uses encoder-decoder style of models. During
|
|
down-stream fine-tuning, the encoder is retained where as the decoder (used during SSL) is replaced
|
|
with down-stream task specific module. Refer to :doc:`checkpoints <./results>` to see how this is
|
|
accomplished in NeMo.
|