wehub/deepspeedai--deepspeed
1
0
Fork 0
Code Issues Pull Requests Actions 1 Deployments Models Agent Notes Packages Projects Releases Wiki Activity
Files
main
deepspeedai--deepspeed/docs/_posts/2023-09-12-ZeRO-Inference.md
T
wehub-resource-sync 4ececc111a chore: import upstream snapshot with attribution
2026-07-13 13:18:33 +08:00

296 B
Raw Permalink Blame History

title: "ZeRO-Inference: 20X faster inference through weight quantization and KV cache offloading" excerpt: "" link: https://github.com/deepspeedai/DeepSpeedExamples/blob/master/inference/huggingface/zero_inference/README.md date: 2023-09-12 00:09:00 tags: inference ZeRO quantization English

Reference in New Issue View Git Blame Copy Permalink