wehub-resource-sync
94057c3d3e
PR Test (NPU) / check-changes (push) Has been cancelled
PR Test (NPU) / pr-gate (push) Has been cancelled
PR Test (NPU) / set-image-config (push) Has been cancelled
PR Test (NPU) / stage-b-test-1-npu-a2 (0) (push) Has been cancelled
PR Test (NPU) / stage-b-test-1-npu-a2 (1) (push) Has been cancelled
PR Test (NPU) / stage-b-test-2-npu-a2 (0) (push) Has been cancelled
PR Test (NPU) / stage-b-test-2-npu-a2 (1) (push) Has been cancelled
PR Test (NPU) / stage-b-test-4-npu-a3 (push) Has been cancelled
PR Test (NPU) / stage-b-test-16-npu-a3 (push) Has been cancelled
PR Test (NPU) / multimodal-gen-test-1-npu-a3 (push) Has been cancelled
PR Test (NPU) / multimodal-gen-test-2-npu-a3 (push) Has been cancelled
PR Test (Arm64) / pr-gate (push) Has been cancelled
PR Test (Arm64) / check-changes (push) Has been cancelled
PR Test (Arm64) / build-test (push) Has been cancelled
PR Test (sgl-router) / gate (push) Has been cancelled
PR Test (sgl-router) / tier-1 — lint (push) Has been cancelled
PR Test (sgl-router) / tier-2 — build + test (push) Has been cancelled
PR Test (sgl-router) / tier-3 — docker (placeholder) (push) Has been cancelled
PR Test (sgl-router) / tier-3 — k8s integration (push) Has been cancelled
PR Test (sgl-router) / tier-3 — e2e (push) Has been cancelled
PR Test (sgl-router) / finish (push) Has been cancelled
PR Test (NPU) / single-node-poc (map[name:qwen3_6_27b_w8a8_1p_in64k_out1k_50ms runner:linux-aarch64-a3-2 test_case:test/registered/ascend/performance/qwen3_6_27b/test_npu_qwen3_6_27b_w8a8_1p_in64k_out1k_50ms.py test_type:perf]) (push) Has been cancelled
PR Test (NPU) / pr-test-npu-finish (push) Has been cancelled
PR Test (Xeon) / pr-gate (push) Has been cancelled
PR Test (Xeon) / check-changes (push) Has been cancelled
PR Test (Xeon) / build-test (, xeon-gnr, base-b-test-cpu) (push) Has been cancelled
PR Test (XPU) / check-changes (push) Has been cancelled
PR Test (XPU) / pr-gate (push) Has been cancelled
PR Test (XPU) / stage-a-test-1-gpu-xpu (push) Has been cancelled
PR Test (XPU) / wait-for-stage-a (push) Has been cancelled
PR Test (XPU) / stage-b-test-1-gpu-xpu (push) Has been cancelled
PR Test (XPU) / finish (push) Has been cancelled
CI Model Inventory / build-inventory (push) Has been cancelled
Lint / lint (push) Has been cancelled
PR Benchmark (SMG Components) / Benchmark Compilation Check (push) Has been cancelled
PR Benchmark (SMG Components) / Benchmark - Manual Policy (push) Has been cancelled
PR Benchmark (SMG Components) / Benchmark - Request Processing (push) Has been cancelled
PR Benchmark (SMG Components) / Benchmark Summary (push) Has been cancelled
PR Test (SMG) / build-wheel (push) Has been cancelled
Release SGLang Model Gateway to PyPI / build on windows (x86_64 - auto) (push) Has been cancelled
Release SGLang Model Gateway to PyPI / build on macos (x86_64 - auto) (push) Has been cancelled
PR Test (SMG) / python-unit-tests (push) Has been cancelled
PR Test (SMG) / unit-tests (push) Has been cancelled
PR Test (SMG) / benchmarks (push) Has been cancelled
PR Test (SMG) / chat-completions (push) Has been cancelled
PR Test (SMG) / chat-completions-4gpu (push) Has been cancelled
PR Test (SMG) / e2e (push) Has been cancelled
PR Test (SMG) / docker-build-test (push) Has been cancelled
PR Test (SMG) / k8s-integration (push) Has been cancelled
PR Test (SMG) / finish (push) Has been cancelled
PR Test (SMG) / summarize-benchmarks (push) Has been cancelled
Release SGLang Model Gateway Docker Image / publish (push) Has been cancelled
Release SGLang Model Gateway to PyPI / build on macos (aarch64 - auto) (push) Has been cancelled
Release SGLang Model Gateway to PyPI / build on linux (aarch64 - auto) (push) Has been cancelled
Release SGLang Model Gateway to PyPI / build on linux (x86_64 - auto) (push) Has been cancelled
Release SGLang Model Gateway to PyPI / build on linux (aarch64 - musllinux_1_1) (push) Has been cancelled
Release SGLang Model Gateway to PyPI / build on linux (x86_64 - musllinux_1_1) (push) Has been cancelled
Release SGLang Model Gateway to PyPI / Build SDist (push) Has been cancelled
Release SGLang Model Gateway to PyPI / Upload to PyPI (push) Has been cancelled
Release SGLang Kernels / build-cu129-matrix (aarch64, 12.9, 3.10, arm-kernel-build-node) (push) Has been cancelled
Release SGLang Kernels / build-cu129-matrix (x86_64, 12.9, 3.10, x64-kernel-build-node) (push) Has been cancelled
Release SGLang Kernels / release-cu129 (push) Has been cancelled
Release SGLang Kernels / build-cu130-matrix (aarch64, 13.0, 3.10, arm-kernel-build-node) (push) Has been cancelled
Release SGLang Kernels / build-cu130-matrix (x86_64, 13.0, 3.10, x64-kernel-build-node) (push) Has been cancelled
Release SGLang Kernels / release-cu130 (push) Has been cancelled
Release SGLang Kernels / build-rocm-matrix (3.10, 700) (push) Has been cancelled
Release SGLang Kernels / build-rocm-matrix (3.10, 720) (push) Has been cancelled
Release SGLang Kernels / release-rocm700 (push) Has been cancelled
Release SGLang Kernels / release-rocm720 (push) Has been cancelled
Release SGLang Kernels / build-musa43 (43, 3.10) (push) Has been cancelled
Release SGLang Kernels / release-musa43 (push) Has been cancelled
88 lines
2.3 KiB
Plaintext
88 lines
2.3 KiB
Plaintext
---
|
|
title: Supported models
|
|
description: See which families of SGLang-compatible models are actively maintained.
|
|
mode: wide
|
|
---
|
|
|
|
SGLang supports model families across text generation, retrieval, and reward workflows. Browse the sections below for the primary product paths and jump to the detail pages when you are ready to explore a specific class.
|
|
|
|
### Text generation
|
|
|
|
<CardGroup cols={3}>
|
|
<Card
|
|
title="Large language models"
|
|
mode="card"
|
|
className="max-w-sm mx-auto"
|
|
href="./supported-models/generative_models"
|
|
img="/cards/LLM-card.png"
|
|
>
|
|
Production-tuned Llama and Qwen families validated for high-throughput
|
|
serving.
|
|
</Card>
|
|
<Card
|
|
title="Vision language models"
|
|
mode="card"
|
|
className="max-w-sm mx-auto"
|
|
href="./supported-models/multimodal_language_models"
|
|
img="/cards/VLM-card.png"
|
|
>
|
|
Vision-text hybrids that stay responsive on multi-GPU setups.
|
|
</Card>
|
|
<Card
|
|
title="Diffusion language models"
|
|
mode="card"
|
|
className="max-w-sm mx-auto"
|
|
href="./sglang-diffusion/index"
|
|
img="/cards/dLLM-card.png"
|
|
>
|
|
Score-based and diffusion backbones for structured text generation
|
|
workflows.
|
|
</Card>
|
|
</CardGroup>
|
|
|
|
### Retrieval and ranking
|
|
|
|
<CardGroup cols={3}>
|
|
<Card
|
|
title="Embedding models"
|
|
mode="card"
|
|
className="max-w-sm mx-auto"
|
|
href="./supported-models/embedding_models"
|
|
img="/cards/Embedding-card.png"
|
|
>
|
|
Dense and sparse embeddings optimized with FlashInfer kernels.
|
|
</Card>
|
|
<Card
|
|
title="Rerank models"
|
|
mode="card"
|
|
className="max-w-sm mx-auto"
|
|
href="./supported-models/rerank_models"
|
|
img="/cards/Rerank-card.png"
|
|
>
|
|
Low-latency rerankers for multi-stage retrieval pipelines.
|
|
</Card>
|
|
<Card
|
|
title="Classification models"
|
|
mode="card"
|
|
className="max-w-sm mx-auto"
|
|
href="./supported-models/classify_models"
|
|
img="/cards/Classification-card.png"
|
|
>
|
|
Lightweight classifiers covering safety, intent, and context filters.
|
|
</Card>
|
|
</CardGroup>
|
|
|
|
### Specialized models
|
|
|
|
<CardGroup cols={3}>
|
|
<Card
|
|
title="Reward models"
|
|
mode="card"
|
|
className="max-w-sm mx-auto"
|
|
href="./supported-models/reward_models"
|
|
img="/cards/Reward-card.png"
|
|
>
|
|
RLHF and reward scoring pipelines optimized for production latency.
|
|
</Card>
|
|
</CardGroup>
|