wehub-resource-sync
e06fe8e8c6
Secret Leaks / trufflehog (push) Failing after 1s
Build documentation / build (push) Failing after 1s
Build documentation / build_other_lang (push) Failing after 0s
CodeQL Security Analysis / CodeQL Analysis (push) Failing after 0s
PR CI / pr-ci (push) Failing after 1s
Slow tests on important models (on Push - A10) / Get all modified files (push) Failing after 1s
Slow tests on important models (on Push - A10) / Model CI (push) Has been skipped
Self-hosted runner (benchmark) / Benchmark (aws-g5-4xlarge-cache) (push) Has been cancelled
New model PR merged notification / Notify new model (push) Has been cancelled
Update Transformers metadata / build_and_package (push) Has been cancelled
1.8 KiB
1.8 KiB
Custom Layers and Utilities
This page lists all the custom layers used by the library, as well as the utility functions and classes it provides for modeling.
Most of those are only useful if you are studying the code of the models in the library.
WeightRenaming
autodoc GroupWeightRename
WeightConverter
autodoc WeightConverter
Conversion operations
autodoc ConversionOps
autodoc Chunk
autodoc Concatenate
autodoc MergeModulelist
autodoc SplitModulelist
autodoc PermuteForRope
autodoc VisionFuseAndPermuteForRope
autodoc VisionUnfuseAndPermuteForRope
Layers
autodoc GradientCheckpointingLayer
Attention Functions
autodoc AttentionInterface - register
Attention Mask Functions
autodoc AttentionMaskInterface - register
Rotary Position Embedding Functions
autodoc dynamic_rope_update
Pytorch custom modules
autodoc pytorch_utils.Conv1D
PyTorch Helper Functions
autodoc pytorch_utils.apply_chunking_to_forward
autodoc pytorch_utils.prune_linear_layer