94057c3d3e
PR Test (NPU) / check-changes (push) Has been cancelled
PR Test (NPU) / pr-gate (push) Has been cancelled
PR Test (NPU) / set-image-config (push) Has been cancelled
PR Test (NPU) / stage-b-test-1-npu-a2 (0) (push) Has been cancelled
PR Test (NPU) / stage-b-test-1-npu-a2 (1) (push) Has been cancelled
PR Test (NPU) / stage-b-test-2-npu-a2 (0) (push) Has been cancelled
PR Test (NPU) / stage-b-test-2-npu-a2 (1) (push) Has been cancelled
PR Test (NPU) / stage-b-test-4-npu-a3 (push) Has been cancelled
PR Test (NPU) / stage-b-test-16-npu-a3 (push) Has been cancelled
PR Test (NPU) / multimodal-gen-test-1-npu-a3 (push) Has been cancelled
PR Test (NPU) / multimodal-gen-test-2-npu-a3 (push) Has been cancelled
PR Test (Arm64) / pr-gate (push) Has been cancelled
PR Test (Arm64) / check-changes (push) Has been cancelled
PR Test (Arm64) / build-test (push) Has been cancelled
PR Test (sgl-router) / gate (push) Has been cancelled
PR Test (sgl-router) / tier-1 — lint (push) Has been cancelled
PR Test (sgl-router) / tier-2 — build + test (push) Has been cancelled
PR Test (sgl-router) / tier-3 — docker (placeholder) (push) Has been cancelled
PR Test (sgl-router) / tier-3 — k8s integration (push) Has been cancelled
PR Test (sgl-router) / tier-3 — e2e (push) Has been cancelled
PR Test (sgl-router) / finish (push) Has been cancelled
PR Test (NPU) / single-node-poc (map[name:qwen3_6_27b_w8a8_1p_in64k_out1k_50ms runner:linux-aarch64-a3-2 test_case:test/registered/ascend/performance/qwen3_6_27b/test_npu_qwen3_6_27b_w8a8_1p_in64k_out1k_50ms.py test_type:perf]) (push) Has been cancelled
PR Test (NPU) / pr-test-npu-finish (push) Has been cancelled
PR Test (Xeon) / pr-gate (push) Has been cancelled
PR Test (Xeon) / check-changes (push) Has been cancelled
PR Test (Xeon) / build-test (, xeon-gnr, base-b-test-cpu) (push) Has been cancelled
PR Test (XPU) / check-changes (push) Has been cancelled
PR Test (XPU) / pr-gate (push) Has been cancelled
PR Test (XPU) / stage-a-test-1-gpu-xpu (push) Has been cancelled
PR Test (XPU) / wait-for-stage-a (push) Has been cancelled
PR Test (XPU) / stage-b-test-1-gpu-xpu (push) Has been cancelled
PR Test (XPU) / finish (push) Has been cancelled
CI Model Inventory / build-inventory (push) Has been cancelled
Lint / lint (push) Has been cancelled
PR Benchmark (SMG Components) / Benchmark Compilation Check (push) Has been cancelled
PR Benchmark (SMG Components) / Benchmark - Manual Policy (push) Has been cancelled
PR Benchmark (SMG Components) / Benchmark - Request Processing (push) Has been cancelled
PR Benchmark (SMG Components) / Benchmark Summary (push) Has been cancelled
PR Test (SMG) / build-wheel (push) Has been cancelled
Release SGLang Model Gateway to PyPI / build on windows (x86_64 - auto) (push) Has been cancelled
Release SGLang Model Gateway to PyPI / build on macos (x86_64 - auto) (push) Has been cancelled
PR Test (SMG) / python-unit-tests (push) Has been cancelled
PR Test (SMG) / unit-tests (push) Has been cancelled
PR Test (SMG) / benchmarks (push) Has been cancelled
PR Test (SMG) / chat-completions (push) Has been cancelled
PR Test (SMG) / chat-completions-4gpu (push) Has been cancelled
PR Test (SMG) / e2e (push) Has been cancelled
PR Test (SMG) / docker-build-test (push) Has been cancelled
PR Test (SMG) / k8s-integration (push) Has been cancelled
PR Test (SMG) / finish (push) Has been cancelled
PR Test (SMG) / summarize-benchmarks (push) Has been cancelled
Release SGLang Model Gateway Docker Image / publish (push) Has been cancelled
Release SGLang Model Gateway to PyPI / build on macos (aarch64 - auto) (push) Has been cancelled
Release SGLang Model Gateway to PyPI / build on linux (aarch64 - auto) (push) Has been cancelled
Release SGLang Model Gateway to PyPI / build on linux (x86_64 - auto) (push) Has been cancelled
Release SGLang Model Gateway to PyPI / build on linux (aarch64 - musllinux_1_1) (push) Has been cancelled
Release SGLang Model Gateway to PyPI / build on linux (x86_64 - musllinux_1_1) (push) Has been cancelled
Release SGLang Model Gateway to PyPI / Build SDist (push) Has been cancelled
Release SGLang Model Gateway to PyPI / Upload to PyPI (push) Has been cancelled
Release SGLang Kernels / build-cu129-matrix (aarch64, 12.9, 3.10, arm-kernel-build-node) (push) Has been cancelled
Release SGLang Kernels / build-cu129-matrix (x86_64, 12.9, 3.10, x64-kernel-build-node) (push) Has been cancelled
Release SGLang Kernels / release-cu129 (push) Has been cancelled
Release SGLang Kernels / build-cu130-matrix (aarch64, 13.0, 3.10, arm-kernel-build-node) (push) Has been cancelled
Release SGLang Kernels / build-cu130-matrix (x86_64, 13.0, 3.10, x64-kernel-build-node) (push) Has been cancelled
Release SGLang Kernels / release-cu130 (push) Has been cancelled
Release SGLang Kernels / build-rocm-matrix (3.10, 700) (push) Has been cancelled
Release SGLang Kernels / build-rocm-matrix (3.10, 720) (push) Has been cancelled
Release SGLang Kernels / release-rocm700 (push) Has been cancelled
Release SGLang Kernels / release-rocm720 (push) Has been cancelled
Release SGLang Kernels / build-musa43 (43, 3.10) (push) Has been cancelled
Release SGLang Kernels / release-musa43 (push) Has been cancelled
94 lines
3.4 KiB
Plaintext
94 lines
3.4 KiB
Plaintext
---
|
|
title: "Diffusion Cookbook"
|
|
description: "Cookbook recipes for running diffusion models with SGLang"
|
|
metatags:
|
|
description: "Explore SGLang diffusion cookbook structure, categories, and contribution guidance for image and video generation recipes."
|
|
---
|
|
|
|
# SGLang Diffusion Cookbook
|
|
|
|
<div style={{display: 'flex', gap: '8px'}}>
|
|
<a href="https://opensource.org/licenses/Apache-2.0"><img src="https://img.shields.io/badge/License-Apache_2.0-blue.svg" alt="License" /></a>
|
|
<a href="https://github.com/sgl-project/sglang/pulls"><img src="https://img.shields.io/badge/PRs-welcome-brightgreen.svg" alt="PRs Welcome" /></a>
|
|
</div>
|
|
|
|
Create a comprehensive cookbook for diffusion models in SGLang, demonstrating SGLang's performance advantages for image and video generation workloads.
|
|
|
|
## 🎯 What You'll Find Here
|
|
|
|
This cookbook aggregates battle-tested SGLang recipes covering:
|
|
|
|
- **Models**: Mainstream Image and Video generation Models
|
|
- **Use Cases**: Inference serving, deployment strategies
|
|
- **Hardware**: GPU and CPU configurations, optimization for different accelerators
|
|
- **Best Practices**: Configuration templates, performance tuning, troubleshooting guides
|
|
|
|
Each recipe provides step-by-step instructions to help you quickly implement SGLang solutions for your specific requirements.
|
|
|
|
## 🚀 Quick Start
|
|
|
|
1. Browse the recipe index above to find your model
|
|
2. Follow the step-by-step instructions in each guide
|
|
3. Adapt configurations to your specific hardware and requirements
|
|
4. Join our community to share feedback and improvements
|
|
|
|
The sglang diffusion cookbook directory structure are shown below:
|
|
|
|
```text Example
|
|
docs_new/cookbook/diffusion/
|
|
├── README.mdx # Main cookbook (this file)
|
|
├── Qwen-Image/ # Qwen-Image series docs
|
|
│ ├── Qwen-Image.mdx
|
|
│ └── Qwen-Image-Edit.mdx
|
|
├── Wan/ # Wan series docs
|
|
│ ├── Wan2.1.mdx
|
|
│ └── Wan2.2.mdx
|
|
├── Z-Image/ # Z-Image series docs
|
|
│ └── Z-Image-Turbo.mdx
|
|
├── Ernie-Image/ # ERNIE-Image series docs
|
|
│ └── Ernie-Image.mdx
|
|
└── ...
|
|
```
|
|
|
|
## 🤝 Contributing
|
|
|
|
We believe the best documentation comes from practitioners. Whether you've optimized SGLang for a specific model, solved a tricky deployment challenge, or discovered performance improvements, we encourage you to contribute your recipes!
|
|
|
|
**💪How to Contribute**
|
|
|
|
- Comment below if interested (mention which role)
|
|
- Join discussion on implementation details
|
|
- Fork repo and work on assigned section
|
|
- Submit PR following SGLang cookbook standards
|
|
- Iterate based on review feedback
|
|
|
|
**To contribute:**
|
|
|
|
```shell Command
|
|
# Fork the repo and clone locally
|
|
git clone https://github.com/YOUR_USERNAME/sglang.git
|
|
cd sglang
|
|
|
|
# Create a new branch
|
|
git checkout -b add-my-recipe
|
|
|
|
# Add your recipe under docs_new/cookbook/diffusion/
|
|
# Submit a PR!
|
|
```
|
|
|
|
## 📖 Resources
|
|
|
|
- [SGLang GitHub](https://github.com/sgl-project/sglang)
|
|
- [SGLang Documentation](/)
|
|
- [SGLang Diffusion Documentation](/docs/sglang-diffusion/index)
|
|
- [SLACK Channel](https://sgl-fru7574.slack.com/archives/C07GLLLESNR)
|
|
- [Community Slack/Discord](https://discord.gg/MpEEuAeb)
|
|
|
|
## 📄 License
|
|
|
|
This project is licensed under the Apache License 2.0 - see the [LICENSE](https://github.com/sgl-project/sglang/blob/main/LICENSE) file for details.
|
|
|
|
---
|
|
|
|
**Let's build this resource together!** 🚀 Star the repo and contribute your recipes to help the SGLang community grow.
|