Merge pull request #197 from jsl9208/main

add an online tutorial on deploying quantized MOSS
This commit is contained in:
Qinyuan Cheng
2023-04-27 19:10:24 +08:00
committed by GitHub
2 changed files with 2 additions and 0 deletions
+1
View File
@@ -461,6 +461,7 @@ bash run.sh
- [VideoChat with MOSS](https://github.com/OpenGVLab/Ask-Anything/tree/main/video_chat_with_MOSS) - 将MOSS接入视频问答
- [ModelWhale](https://www.heywhale.com/mw/project/6442706013013653552b7545) - 支持在线部署MOSS的算力平台
- [MOSS-DockerFile](https://github.com/linonetwo/MOSS-DockerFile) - 社区提供的Docker镜像,运行int4量化版和GradIOUI
- [V100单卡在线部署Int8量化版MOSS教程](https://www.heywhale.com/mw/project/6449f8fc3c3ad0d9754d8ae7) - 提供了量化版MOSS的部署样例,以及部署过程中一些问题的解决方法
如果您有其他开源项目使用或改进MOSS,欢迎提交Pull Request添加到README或在Issues中联系我们。
+1
View File
@@ -450,6 +450,7 @@ Note: In the tokenizer of `moss-moon-003-base`, the eos token is `<|endoftext|>`
- [VideoChat with MOSS](https://github.com/OpenGVLab/Ask-Anything/tree/main/video_chat_with_MOSS) - Watch videos with MOSS!
- [ModelWhale](https://www.heywhale.com/mw/project/6442706013013653552b7545) - A compute platform for deploying MOSS!
- [MOSS-DockerFile](https://github.com/linonetwo/MOSS-DockerFile) - Community-provided Docker images running int4 quantization and GradIOUI
- [An online tutorial on deploying quantized MOSS on single V100](https://www.heywhale.com/mw/project/6449f8fc3c3ad0d9754d8ae7) - A step-by-step tutorial on deploying moss-moon-003-sft-int8 is provided, and some specific solutions to common problems are also given
If you have other open-sourced projects that used or improved MOSS, please feel free to submit Pull Requests to README or reach out to us in Issues.