ba4be087d5
Create PR to main with cherry-pick from release / cherry-pick (push) Failing after 0s
CICD NeMo / pre-flight (push) Failing after 0s
CICD NeMo / configure (push) Has been skipped
Build, validate, and release Neural Modules / pre-flight (push) Failing after 1s
CICD NeMo / code-linting (push) Has been skipped
Build, validate, and release Neural Modules / release (push) Has been skipped
Build, validate, and release Neural Modules / release-summary (push) Has been cancelled
CICD NeMo / cicd-test-container-build (push) Has been cancelled
CICD NeMo / cicd-import-tests (push) Has been cancelled
CICD NeMo / L0_Setup_Test_Data_And_Models (push) Has been cancelled
CICD NeMo / cicd-main-unit-tests (push) Has been cancelled
CICD NeMo / cicd-main-speech (push) Has been cancelled
CICD NeMo / Nemo_CICD_Test (push) Has been cancelled
CICD NeMo / Coverage (e2e) (push) Has been cancelled
CICD NeMo / Coverage (unit-test) (push) Has been cancelled
CodeQL / Analyze (python) (push) Has been cancelled
CICD NeMo / cicd-wait-in-queue (push) Has been cancelled
27 lines
1.4 KiB
Markdown
27 lines
1.4 KiB
Markdown
NeMo (**Ne**ural **Mo**dules) is a toolkit for creating AI applications built around **neural modules**, conceptual blocks of neural networks that take *typed* inputs and produce *typed* outputs.
|
|
|
|
## **collections/**
|
|
* **ASR** - Collection of modules and models for building speech recognition networks.
|
|
* **TTS** - Collection of modules and models for building speech synthesis networks.
|
|
* **Audio** - Collection of modules and models for building audio processing networks.
|
|
* **SpeechLM2** - Collection of modules and models for building multimodal LLM.
|
|
|
|
## **core/**
|
|
Provides fundamental APIs and utilities for NeMo modules, including:
|
|
- **Classes** - Base classes for datasets, models, and losses.
|
|
- **Config** - Configuration management utilities.
|
|
- **Neural Types** - Typed inputs/outputs for module interaction.
|
|
- **Optim** - Optimizers and learning rate schedulers.
|
|
|
|
## **lightning/**
|
|
Integration with PyTorch Lightning for training and distributed execution:
|
|
- **Strategies & Plugins** - Custom Lightning strategies.
|
|
- **Fabric** - Lightweight wrapper for model training.
|
|
- **Checkpointing & Logging** - Utilities for managing model states.
|
|
|
|
## **utils/**
|
|
General utilities for debugging, distributed training, logging, and model management:
|
|
- **callbacks/** - Hooks for training processes.
|
|
- **loggers/** - Logging utilities for different backends.
|
|
- **debugging & profiling** - Performance monitoring tools.
|