wehub-resource-sync
8 lines
324 B
Markdown
8 lines
324 B
Markdown
---
|
|
title: "DeepSpeed ZeRO++: A leap in speed for LLM and chat model training with 4X less communication"
|
|
excerpt: ""
|
|
link: https://www.microsoft.com/en-us/research/blog/deepspeed-zero-a-leap-in-speed-for-llm-and-chat-model-training-with-4x-less-communication/
|
|
date: 2023-06-22 00:00:00
|
|
tags: training ZeRO RLHF English
|
|
---
|