liguodongiot--llm-action/llm-train/README.md

训练

• https://github.com/yangjianxin1/Firefly/

• https://github.com/hiyouga/LLaMA-Factory

• Characterization of Large Language Model Development in the Datacenter：https://arxiv.org/pdf/2403.07648

• MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUs：https://www.usenix.org/system/files/nsdi24-jiang-ziheng.pdf