254 B
254 B
title, excerpt, link, date, tags
| title | excerpt | link | date | tags |
|---|---|---|---|---|
| DeepSpeed-FastGen: High-throughput Text Generation for LLMs via MII and DeepSpeed-Inference | https://github.com/deepspeedai/DeepSpeed/tree/master/blogs/deepspeed-fastgen | 2023-11-06 00:00:00 | inference English |