caf324b09d
tests / check_code_quality (push) Waiting to run
tests / tests (ubuntu-latest, 3.10) (push) Blocked by required conditions
tests / tests (ubuntu-latest, 3.11) (push) Blocked by required conditions
Deploy "method_comparison" Gradio to Spaces / deploy (push) Waiting to run
Deploy "PEFT shop" Gradio app to Spaces / deploy (push) Waiting to run
tests on transformers main / tests (push) Waiting to run
tests / tests (ubuntu-latest, 3.12) (push) Blocked by required conditions
tests / tests (ubuntu-latest, 3.13) (push) Blocked by required conditions
tests / tests (windows-latest, 3.10) (push) Blocked by required conditions
tests / tests (windows-latest, 3.11) (push) Blocked by required conditions
tests / tests (windows-latest, 3.12) (push) Blocked by required conditions
tests / tests (windows-latest, 3.13) (push) Blocked by required conditions
Secret Leaks / trufflehog (push) Waiting to run
CI security linting / zizmor latest via Cargo (push) Waiting to run
Build documentation / build (push) Failing after 0s
78 lines
1.6 KiB
Markdown
78 lines
1.6 KiB
Markdown
<!--⚠️ Note that this file is in Markdown but contain specific syntax for our doc-builder (similar to MDX) that may not be
|
|
rendered properly in your Markdown viewer.
|
|
-->
|
|
|
|
# Models
|
|
|
|
[`PeftModel`] is the base model class for specifying the base Transformer model and configuration to apply a PEFT method to. The base `PeftModel` contains methods for loading and saving models from the Hub.
|
|
|
|
## PeftModel
|
|
|
|
[[autodoc]] PeftModel
|
|
- all
|
|
|
|
## PeftModelForSequenceClassification
|
|
|
|
A `PeftModel` for sequence classification tasks.
|
|
|
|
[[autodoc]] PeftModelForSequenceClassification
|
|
- all
|
|
|
|
## PeftModelForTokenClassification
|
|
|
|
A `PeftModel` for token classification tasks.
|
|
|
|
[[autodoc]] PeftModelForTokenClassification
|
|
- all
|
|
|
|
## PeftModelForCausalLM
|
|
|
|
A `PeftModel` for causal language modeling.
|
|
|
|
[[autodoc]] PeftModelForCausalLM
|
|
- all
|
|
|
|
## PeftModelForSeq2SeqLM
|
|
|
|
A `PeftModel` for sequence-to-sequence language modeling.
|
|
|
|
[[autodoc]] PeftModelForSeq2SeqLM
|
|
- all
|
|
|
|
## PeftModelForQuestionAnswering
|
|
|
|
A `PeftModel` for question answering.
|
|
|
|
[[autodoc]] PeftModelForQuestionAnswering
|
|
- all
|
|
|
|
## PeftModelForFeatureExtraction
|
|
|
|
A `PeftModel` for getting extracting features/embeddings from transformer models.
|
|
|
|
[[autodoc]] PeftModelForFeatureExtraction
|
|
- all
|
|
|
|
## PeftMixedModel
|
|
|
|
A `PeftModel` for mixing different adapter types (e.g. LoRA and LoHa).
|
|
|
|
[[autodoc]] PeftMixedModel
|
|
- all
|
|
|
|
## Utilities
|
|
|
|
[[autodoc]] utils.cast_mixed_precision_params
|
|
|
|
[[autodoc]] get_peft_model
|
|
|
|
[[autodoc]] inject_adapter_in_model
|
|
|
|
[[autodoc]] utils.get_peft_model_state_dict
|
|
|
|
[[autodoc]] utils.prepare_model_for_kbit_training
|
|
|
|
[[autodoc]] get_layer_status
|
|
|
|
[[autodoc]] get_model_status
|