liguodongiot--llm-action/llm-compression/sparsity

Wanda

https://arxiv.org/abs/2306.11695

SparseGPT https://arxiv.org/pdf/2301.00774

Outlier Weighed Layerwise Sparsity (OWL)

https://arxiv.org/pdf/2310.05175

结构化剪枝

LLM-Shearing

• https://github.com/princeton-nlp/LLM-Shearing
• https://arxiv.org/pdf/2310.06694.pdf
• https://xiamengzhou.github.io/sheared-llama/