wehub-resource-sync
ba4be087d5
CICD NeMo / cicd-main-unit-tests (push) Blocked by required conditions
CICD NeMo / cicd-main-speech (push) Blocked by required conditions
CICD NeMo / cicd-test-container-build (push) Blocked by required conditions
CICD NeMo / cicd-import-tests (push) Blocked by required conditions
CICD NeMo / L0_Setup_Test_Data_And_Models (push) Blocked by required conditions
CICD NeMo / Nemo_CICD_Test (push) Blocked by required conditions
CICD NeMo / Coverage (e2e) (push) Blocked by required conditions
CICD NeMo / Coverage (unit-test) (push) Blocked by required conditions
CodeQL / Analyze (python) (push) Waiting to run
Create PR to main with cherry-pick from release / cherry-pick (push) Failing after 0s
CICD NeMo / pre-flight (push) Failing after 0s
CICD NeMo / configure (push) Has been skipped
Build, validate, and release Neural Modules / pre-flight (push) Failing after 1s
CICD NeMo / code-linting (push) Has been skipped
CICD NeMo / cicd-wait-in-queue (push) Waiting to run
Build, validate, and release Neural Modules / release (push) Has been skipped
Build, validate, and release Neural Modules / release-summary (push) Has been cancelled
NeMo Lightning
The NeMo Lightning directory provides custom PyTorch Lightning-compatible objects for seamlessly training NeMo 2.0 models using PTL. NeMo 2.0 models are implemented using Megatron Core. NeMo Lightning provides the bridge between higher-level, object-oriented PTL APIs and lower-level Megatron APIs. For detailed tutorials and documentation on NeMo 2.0, refer to the docs.
Some of the helpful classes provided here include:
Trainer: A lightweight wrapper around PTL'sTrainerobject which provides some additional support for capturing the arguments used to initialized the trainer. More information on NeMo 2's serialization mechanisms is available here.MegatronStrategy: A PTL strategy that enables training of Megatron models on NVIDIA GPUs.MegatronParallel: Class which sets up and manages Megatron's distributed model parallelism.MegatronMixedPrecision: A specialized precision plugin for training Megatron-based models in PTL.
More information on MegatronStrategy, MegatronParallel, and MegatronMixedPrecision can be found in this document.