chore: import upstream snapshot with attribution
Create PR to main with cherry-pick from release / cherry-pick (push) Failing after 0s
CICD NeMo / pre-flight (push) Failing after 0s
CICD NeMo / configure (push) Has been skipped
Build, validate, and release Neural Modules / pre-flight (push) Failing after 1s
CICD NeMo / code-linting (push) Has been skipped
Build, validate, and release Neural Modules / release (push) Has been skipped
Build, validate, and release Neural Modules / release-summary (push) Has been cancelled
CICD NeMo / cicd-test-container-build (push) Has been cancelled
CICD NeMo / cicd-import-tests (push) Has been cancelled
CICD NeMo / L0_Setup_Test_Data_And_Models (push) Has been cancelled
CICD NeMo / cicd-main-unit-tests (push) Has been cancelled
CICD NeMo / cicd-main-speech (push) Has been cancelled
CICD NeMo / Nemo_CICD_Test (push) Has been cancelled
CICD NeMo / Coverage (e2e) (push) Has been cancelled
CICD NeMo / Coverage (unit-test) (push) Has been cancelled
CodeQL / Analyze (python) (push) Has been cancelled
CICD NeMo / cicd-wait-in-queue (push) Has been cancelled
Create PR to main with cherry-pick from release / cherry-pick (push) Failing after 0s
CICD NeMo / pre-flight (push) Failing after 0s
CICD NeMo / configure (push) Has been skipped
Build, validate, and release Neural Modules / pre-flight (push) Failing after 1s
CICD NeMo / code-linting (push) Has been skipped
Build, validate, and release Neural Modules / release (push) Has been skipped
Build, validate, and release Neural Modules / release-summary (push) Has been cancelled
CICD NeMo / cicd-test-container-build (push) Has been cancelled
CICD NeMo / cicd-import-tests (push) Has been cancelled
CICD NeMo / L0_Setup_Test_Data_And_Models (push) Has been cancelled
CICD NeMo / cicd-main-unit-tests (push) Has been cancelled
CICD NeMo / cicd-main-speech (push) Has been cancelled
CICD NeMo / Nemo_CICD_Test (push) Has been cancelled
CICD NeMo / Coverage (e2e) (push) Has been cancelled
CICD NeMo / Coverage (unit-test) (push) Has been cancelled
CodeQL / Analyze (python) (push) Has been cancelled
CICD NeMo / cicd-wait-in-queue (push) Has been cancelled
This commit is contained in:
@@ -0,0 +1,27 @@
|
||||
# 🧠 TopIPL: Iterative Pseudo-Labeling for ASR
|
||||
|
||||
TopIPL is an **iterative pseudo-labeling algorithm** for training speech recognition models using both labeled and unlabeled data. It integrates seamlessly into the NeMo ASR pipeline and enables **self-training** across epochs with minimal manual intervention.
|
||||
|
||||
## 🚀 Key Features
|
||||
|
||||
- ⚙️ Supports **semi-supervised ASR training** with dynamic iterative pseudo-label refinement.
|
||||
- 🧪 Designed for large-scale training using both labeled and unlabeled speech data.
|
||||
- 🔁 Automatically writes pseudo-labels and updates training configs between iterations.
|
||||
|
||||
## 📦 Required Components
|
||||
|
||||
TopIPL relies on the following components:
|
||||
|
||||
- **[`SDPNeMoRunIPLProcessor`]**
|
||||
Commands for running IPL are generated and submitted using SDP processors and NeMo-Run.
|
||||
See instructions for usage [here](https://github.com/NVIDIA/NeMo-speech-data-processor/blob/main/sdp/processors/ipl/README.md).
|
||||
|
||||
- **Training Callback: `IPLEpochStopperCallback`**
|
||||
Add this to your training config under `exp_manager` to **stop training at the end of each epoch**, enabling pseudo-label update:
|
||||
|
||||
```yaml
|
||||
exp_manager:
|
||||
create_ipl_epoch_stopper_callback: True
|
||||
ipl_epoch_stopper_callback_params:
|
||||
stop_every_n_epochs: n # Stop training after every n epochs (default: 1)
|
||||
|
||||
Reference in New Issue
Block a user