docs: make Chinese README the default
This commit is contained in:
@@ -1,4 +1,10 @@
|
||||
# DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanism
|
||||
<!-- WEHUB_ZH_README -->
|
||||
> [!NOTE]
|
||||
> 本文档由 WeHub 基于上游 README 翻译整理,属于社区翻译,非官方中文文档。
|
||||
> [English](./README.en.md) · [原始项目](https://github.com/MoonInTheRiver/DiffSinger) · [上游 README](https://github.com/MoonInTheRiver/DiffSinger/blob/HEAD/README.md)
|
||||
> 原作者、版权与许可证归属以原始项目及本仓库 LICENSE 文件为准。
|
||||
|
||||
# DiffSinger:基于浅层扩散机制的歌唱语音合成(Singing Voice Synthesis via Shallow Diffusion Mechanism)
|
||||
[](https://arxiv.org/abs/2105.02446)
|
||||
[](https://github.com/MoonInTheRiver/DiffSinger)
|
||||
[](https://github.com/MoonInTheRiver/DiffSinger/releases)
|
||||
@@ -6,27 +12,27 @@
|
||||
[](https://huggingface.co/spaces/Silentlin/DiffSinger)
|
||||
|
||||
|
||||
This repository is the official PyTorch implementation of our AAAI-2022 [paper](https://arxiv.org/abs/2105.02446), in which we propose DiffSinger (for Singing-Voice-Synthesis) and DiffSpeech (for Text-to-Speech).
|
||||
本仓库是我们 AAAI-2022 [论文](https://arxiv.org/abs/2105.02446), 的官方 PyTorch 实现,其中我们提出了 DiffSinger(用于歌唱语音合成 Singing-Voice-Synthesis)和 DiffSpeech(用于文本转语音 Text-to-Speech)。
|
||||
|
||||
|
||||
:tada: :tada: :tada: **Updates**:
|
||||
- Sep.11, 2022: :electric_plug: [DiffSinger-PN](docs/README-SVS-opencpop-pndm.md). Add plug-in [PNDM](https://arxiv.org/abs/2202.09778), ICLR 2022 in our laboratory, to accelerate DiffSinger freely.
|
||||
- Jul.27, 2022: Update documents for [SVS](docs/README-SVS.md). Add easy inference [A](docs/README-SVS-opencpop-cascade.md#4-inference-from-raw-inputs) & [B](docs/README-SVS-opencpop-e2e.md#4-inference-from-raw-inputs); Add Interactive SVS running on [HuggingFace🤗 SVS](https://huggingface.co/spaces/Silentlin/DiffSinger).
|
||||
- Mar.2, 2022: MIDI-B-version.
|
||||
- Mar.1, 2022: [NeuralSVB](https://github.com/MoonInTheRiver/NeuralSVB), for singing voice beautifying, has been released.
|
||||
- Feb.13, 2022: [NATSpeech](https://github.com/NATSpeech/NATSpeech), the improved code framework, which contains the implementations of DiffSpeech and our NeurIPS-2021 work [PortaSpeech](https://openreview.net/forum?id=xmJsuh8xlq) has been released.
|
||||
- Jan.29, 2022: support MIDI-A-version SVS.
|
||||
- Jan.13, 2022: support SVS, release PopCS dataset.
|
||||
- Dec.19, 2021: support TTS. [HuggingFace🤗 TTS](https://huggingface.co/spaces/NATSpeech/DiffSpeech)
|
||||
:tada: :tada: :tada: **更新**:
|
||||
- Sep.11, 2022::electric_plug: [DiffSinger-PN](docs/README-SVS-opencpop-pndm.md)。接入我们实验室 ICLR 2022 的插件 [PNDM](https://arxiv.org/abs/2202.09778),,可免费加速 DiffSinger。
|
||||
- Jul.27, 2022:更新 [SVS](docs/README-SVS.md) 相关文档。新增简易推理 [A](docs/README-SVS-opencpop-cascade.md#4-inference-from-raw-inputs) 与 [B](docs/README-SVS-opencpop-e2e.md#4-inference-from-raw-inputs);新增运行于 [HuggingFace🤗 SVS](https://huggingface.co/spaces/Silentlin/DiffSinger). 的交互式 SVS。
|
||||
- Mar.2, 2022:MIDI-B-version。
|
||||
- Mar.1, 2022:用于歌声美化的 [NeuralSVB](https://github.com/MoonInTheRiver/NeuralSVB), 已发布。
|
||||
- Feb.13, 2022:改进版代码框架 [NATSpeech](https://github.com/NATSpeech/NATSpeech), 已发布,其中包含 DiffSpeech 以及我们 NeurIPS-2021 工作 [PortaSpeech](https://openreview.net/forum?id=xmJsuh8xlq) 的实现。
|
||||
- Jan.29, 2022:支持 MIDI-A-version SVS。
|
||||
- Jan.13, 2022:支持 SVS,发布 PopCS 数据集。
|
||||
- Dec.19, 2021:支持 TTS。[HuggingFace🤗 TTS](https://huggingface.co/spaces/NATSpeech/DiffSpeech)
|
||||
|
||||
:rocket: **News**:
|
||||
- Feb.24, 2022: Our new work, NeuralSVB was accepted by ACL-2022 [](https://arxiv.org/abs/2202.13277). [Demo Page](https://neuralsvb.github.io).
|
||||
- Dec.01, 2021: DiffSinger was accepted by AAAI-2022.
|
||||
- Sep.29, 2021: Our recent work `PortaSpeech: Portable and High-Quality Generative Text-to-Speech` was accepted by NeurIPS-2021 [](https://arxiv.org/abs/2109.15166) .
|
||||
- May.06, 2021: We submitted DiffSinger to Arxiv [](https://arxiv.org/abs/2105.02446).
|
||||
:rocket: **新闻**:
|
||||
- Feb.24, 2022:我们的新工作 NeuralSVB 被 ACL-2022 接收 [](https://arxiv.org/abs/2202.13277). [演示页面](https://neuralsvb.github.io).
|
||||
- Dec.01, 2021:DiffSinger 被 AAAI-2022 接收。
|
||||
- Sep.29, 2021:我们近期工作 `PortaSpeech: Portable and High-Quality Generative Text-to-Speech` 被 NeurIPS-2021 接收 [](https://arxiv.org/abs/2109.15166) 。
|
||||
- May.06, 2021:我们将 DiffSinger 提交至 Arxiv [](https://arxiv.org/abs/2105.02446).
|
||||
|
||||
## Environments
|
||||
1. If you want to use env of anaconda:
|
||||
## 环境
|
||||
1. 若你想使用 anaconda 环境:
|
||||
```sh
|
||||
conda create -n your_env_name python=3.8
|
||||
source activate your_env_name
|
||||
@@ -34,24 +40,24 @@ This repository is the official PyTorch implementation of our AAAI-2022 [paper](
|
||||
or pip install -r requirements_3090.txt (GPU 3090, CUDA 11.4)
|
||||
```
|
||||
|
||||
2. Or, if you want to use virtual env of python:
|
||||
2. 或者,若你想使用 python 的 virtual env:
|
||||
```sh
|
||||
## Install Python 3.8 first.
|
||||
## 请先安装 Python 3.8。
|
||||
python -m venv venv
|
||||
source venv/bin/activate
|
||||
# install requirements.
|
||||
# 安装依赖。
|
||||
pip install -U pip
|
||||
pip install Cython numpy==1.19.1
|
||||
pip install torch==1.9.0
|
||||
pip install -r requirements.txt
|
||||
```
|
||||
|
||||
## Documents
|
||||
- [Run DiffSpeech (TTS version)](docs/README-TTS.md).
|
||||
- [Run DiffSinger (SVS version)](docs/README-SVS.md).
|
||||
## 文档
|
||||
- [运行 DiffSpeech(TTS 版本)](docs/README-TTS.md)。
|
||||
- [运行 DiffSinger(SVS 版本)](docs/README-SVS.md)。
|
||||
|
||||
## Overview
|
||||
| Mel Pipeline | Dataset | Pitch Input | F0 Prediction | Acceleration Method | Vocoder |
|
||||
## 概览
|
||||
| Mel 流水线 | 数据集 | 音高输入 | F0 预测 | 加速方法 | 声码器 |
|
||||
| ------------------------------------------------------------------------------------------- | ---------------------------------------------------------| ----------------- | ------------- | --------------------------- | ----------------------------- |
|
||||
| [DiffSpeech (Text->F0, Text+F0->Mel, Mel->Wav)](docs/README-TTS.md) | [Ljspeech](https://keithito.com/LJ-Speech-Dataset/) | None | Explicit | Shallow Diffusion | HiFiGAN |
|
||||
| [DiffSinger (Lyric+F0->Mel, Mel->Wav)](docs/README-SVS-popcs.md) | [PopCS](https://github.com/MoonInTheRiver/DiffSinger) | Ground-Truth F0 | None | Shallow Diffusion | NSF-HiFiGAN |
|
||||
@@ -72,7 +78,7 @@ tensorboard --logdir_spec exp_name
|
||||
</tr>
|
||||
</table>
|
||||
|
||||
## Citation
|
||||
## 引用
|
||||
@article{liu2021diffsinger,
|
||||
title={Diffsinger: Singing voice synthesis via shallow diffusion mechanism},
|
||||
author={Liu, Jinglin and Li, Chengxi and Ren, Yi and Chen, Feiyang and Liu, Peng and Zhao, Zhou},
|
||||
@@ -81,17 +87,16 @@ tensorboard --logdir_spec exp_name
|
||||
year={2021}}
|
||||
|
||||
|
||||
## Acknowledgements
|
||||
* lucidrains' [denoising-diffusion-pytorch](https://github.com/lucidrains/denoising-diffusion-pytorch)
|
||||
* Official [PyTorch Lightning](https://github.com/PyTorchLightning/pytorch-lightning)
|
||||
* kan-bayashi's [ParallelWaveGAN](https://github.com/kan-bayashi/ParallelWaveGAN)
|
||||
* jik876's [HifiGAN](https://github.com/jik876/hifi-gan)
|
||||
* Official [espnet](https://github.com/espnet/espnet)
|
||||
* lmnt-com's [DiffWave](https://github.com/lmnt-com/diffwave)
|
||||
* keonlee9420's [Implementation](https://github.com/keonlee9420/DiffSinger).
|
||||
## 致谢
|
||||
* lucidrains 的 [denoising-diffusion-pytorch](https://github.com/lucidrains/denoising-diffusion-pytorch)
|
||||
* 官方 [PyTorch Lightning](https://github.com/PyTorchLightning/pytorch-lightning)
|
||||
* kan-bayashi 的 [ParallelWaveGAN](https://github.com/kan-bayashi/ParallelWaveGAN)
|
||||
* jik876 的 [HifiGAN](https://github.com/jik876/hifi-gan)
|
||||
* 官方 [espnet](https://github.com/espnet/espnet)
|
||||
* lmnt-com 的 [DiffWave](https://github.com/lmnt-com/diffwave)
|
||||
* keonlee9420 的 [Implementation](https://github.com/keonlee9420/DiffSinger).
|
||||
|
||||
Especially thanks to:
|
||||
特别感谢:
|
||||
|
||||
* Team Openvpi's maintenance: [DiffSinger](https://github.com/openvpi/DiffSinger).
|
||||
* Your re-creation and sharing.
|
||||
|
||||
* Openvpi 团队的维护:[DiffSinger](https://github.com/openvpi/DiffSinger).
|
||||
* 您的再创作与分享。
|
||||
|
||||
Reference in New Issue
Block a user