chore: import upstream snapshot with attribution
Lint / lint (push) Has been cancelled
Build Docs / Deploy Docs (push) Has been cancelled
Windows CI / Windows (push) Has been cancelled

This commit is contained in:
wehub-resource-sync
2026-07-13 13:23:58 +08:00
commit 770d92cb1f
694 changed files with 114634 additions and 0 deletions
+43
View File
@@ -0,0 +1,43 @@
---
name: "🐛 Bug Report"
about: Submit a bug report to help us improve MLC-LLM
title: '[Bug] '
labels: ['bug']
assignees: ''
---
## 🐛 Bug
<!-- A clear and concise description of what the bug is. -->
## To Reproduce
Steps to reproduce the behavior:
1.
1.
1.
<!-- If you have a code sample, error messages, stack traces, please provide it here as well -->
## Expected behavior
<!-- A clear and concise description of what you expected to happen. -->
## Environment
- Platform (e.g. WebGPU/Vulkan/IOS/Android/CUDA):
- Operating system (e.g. Ubuntu/Windows/MacOS/...):
- Device (e.g. iPhone 12 Pro, PC+RTX 3090, ...)
- How you installed MLC-LLM (`conda`, source):
- How you installed TVM (`pip`, source):
- Python version (e.g. 3.10):
- GPU driver version (if applicable):
- CUDA/cuDNN version (if applicable):
- TVM Hash Tag (`python -c "import tvm; print('\n'.join(f'{k}: {v}' for k, v in tvm.support.libinfo().items()))"`, applicable if you compile models):
- Any other relevant information:
## Additional context
<!-- Add any other context about the problem here. -->
+9
View File
@@ -0,0 +1,9 @@
blank_issues_enabled: false
contact_links:
- name: Check the MLC-LLM Documentation
url: https://llm.mlc.ai/docs/
about: Our documentation might provide answers to your questions.
- name: Chat on Discord
url: https://discord.gg/9Xpy2HGBuD
about: Join the Discord Server to live chat with the community.
+17
View File
@@ -0,0 +1,17 @@
---
name: "\U0001F4DA Documentation"
about: Report an issue related to https://llm.mlc.ai/docs/
title: '[Doc] '
labels: ['documentation']
assignees: ''
---
## 📚 Documentation
### Suggestion
<!-- Please leave your general suggestion to our documentation here. -->
### Bug
- Link to the buggy documentation/tutorial:
- Description of the bug:
+23
View File
@@ -0,0 +1,23 @@
---
name: "\U0001F680 Feature Request"
about: Submit a proposal/request for a new MLC-LLM feature, or an enhancement on existing features.
title: '[Feature Request] '
labels: ['feature request']
assignees: ''
---
## 🚀 Feature
<!-- A brief description of the feature proposal -->
## Motivation
<!-- Please outline the motivation for the proposal, and how could this feature benefit the MLC-LLM project/community. -->
## Alternatives
<!-- A clear and concise description of any alternative solutions or features you've considered, if any. -->
## Additional context
<!-- Add any other context or screenshots about the feature request here. -->
+12
View File
@@ -0,0 +1,12 @@
---
name: "❓ General Questions"
about: General questions you have about MLC-LLM.
title: '[Question] '
labels: ['question']
assignees: ''
---
## ❓ General Questions
<!-- Describe your questions -->
+17
View File
@@ -0,0 +1,17 @@
---
name: "️⚙️ Model Request"
about: Request a new model in MLC-LLM
title: '[Model Request] '
labels: ['new-models']
assignees: ''
---
## ⚙️ Request New Models
- Link to an existing implementation (e.g. Hugging Face/Github): <!-- Link to the model -->
- Is this model architecture supported by MLC-LLM? (the list of [supported models](https://llm.mlc.ai/docs/prebuilt_models.html)) <!-- Yes/No -->
## Additional context
<!-- Add any other context that you think would be helpful for the community to add this model -->
+24
View File
@@ -0,0 +1,24 @@
---
name: " 🏎️ Speed Report"
about: Submit a speed report of an model running in MLC-LLM
title: '[Speed] '
labels: ['performance']
assignees: ''
---
# 🏎️ Speed Report
<!-- Please search if there are existing issues discuss the speed of the model you are using, if there are, we encourage you reply in the existed issue instead of creating a new one. -->
- The model code: <!-- e.g. vicuna-7b-1.1 -->
- The model configuration (e.g. quantization mode, running data type, etc.):
- Device (e.g. MacBook Pro M2, PC+RTX 3080):
- OS (if applicable):
- Encode speed (Token/s):
- Decode speed (Token/s):
- Memory usage (if applicable):
<!-- Note that the measured speed might reflect peak performance if the prompt/chat history is short. -->
+40
View File
@@ -0,0 +1,40 @@
---
name: "Tracking"
about: A tracking issue that tracks ongoing item in the project
title: '[Tracking] '
labels: ['status: tracking']
assignees: ''
---
<!--
A tracking issue contains a list of action items
that can be executed to complete a feature or fix.
We use tracking issues when we have a clear list of action items
related to feature items as they provide fine-grained
view of action items and provide clarity on what it takes to implement a feature.
When to open a tracking issue: Open a new tracking issue when you have
clear, actionable items (as a rule of thumb, make sure action items
items can be carried through if you are assigned to work on it and
you can provide enough guides to others who plan to work on these actions).
-->
## Overview
<!-- A brief overview of the task -->
## Action Items
<!-- Please list set of action items to complete -->
- [ ]
## Links to Related Issues and PRs
<!-- Cross link feature requests bug report issues related to the tracking item -->
<!-- When there are new PRs, open up new PRs -->
+39
View File
@@ -0,0 +1,39 @@
name: Build Docs
on:
push:
branches:
- main
jobs:
test_linux:
name: Deploy Docs
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4
with:
submodules: recursive
- name: Configuring build Environment
run: |
sudo apt-get update
python -m pip install -U pip wheel
- name: Setup Ruby
uses: ruby/setup-ruby@v1
with:
ruby-version: '3.0'
- name: Installing dependencies
run: |
python -m pip install -r docs/requirements.txt
gem install jekyll jekyll-remote-theme
- name: Deploying on GitHub Pages
if: github.ref == 'refs/heads/main'
run: |
git remote set-url origin https://x-access-token:${{ secrets.MLC_GITHUB_TOKEN }}@github.com/$GITHUB_REPOSITORY
git config --global user.email "mlc-gh-actions-bot@nomail"
git config --global user.name "mlc-gh-actions-bot"
./scripts/gh_deploy_site.sh
+25
View File
@@ -0,0 +1,25 @@
name: Lint
on:
push:
branches: [main]
pull_request:
branches: [main]
concurrency:
group: Lint-${{ github.event.pull_request.number || github.sha }}
cancel-in-progress: true
jobs:
lint:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@de0fac2e4500dabe0009e67214ff5f5447ce83dd # v6.0.2
with:
fetch-depth: 0
fetch-tags: true
- name: Set up uv
uses: astral-sh/setup-uv@b75a909f75acd358c2196fb9a5f1299a9a8868a4 # v6.7.0
- name: Set up Python environment
run: uv sync --group lint --no-install-project
- uses: pre-commit/action@2c7b3805fd2a0fd8c1884dcaebf91fc102a13ecd # v3.0.1
+32
View File
@@ -0,0 +1,32 @@
name: 'Relax Submodule Sync'
on:
workflow_dispatch:
jobs:
sync:
name: 'Relax Submodule Sync'
runs-on: ubuntu-latest
defaults:
run:
shell: bash
steps:
- name: Checkout
uses: actions/checkout@v4
with:
submodules: true
- name: Git Sumbodule Update
run: |
git submodule update --remote 3rdparty/tvm
- name: Commit update
env:
GITHUB_TOKEN: ${{ secrets.MLC_GITHUB_TOKEN }}
run: |
git config --global user.name 'Git bot'
git config --global user.email 'bot@noreply.github.com'
git remote set-url origin https://$GITHUB_TOKEN@github.com/mlc-ai/mlc-llm
git commit -am "Auto updated submodule references" && git push || echo "No changes to commit"
+49
View File
@@ -0,0 +1,49 @@
# GH actions.
# We use it to cover windows builds
# Jenkins is still the primary CI
name: Windows CI
on:
push:
branches:
- main
pull_request:
branches:
- main
jobs:
Windows:
runs-on: windows-latest
defaults:
run:
shell: 'cmd /C call {0}'
steps:
- name: Git config
run: >-
git config --system core.longpaths true
- uses: actions/checkout@v3
with:
submodules: 'recursive'
- uses: conda-incubator/setup-miniconda@v3
with:
activate-environment: mlc-llm-build
channel-priority: strict
environment-file: ci/build-environment.yaml
auto-activate-base: false
- name: Conda info
run: |
conda info
conda list
python --version
# The wheel is built with scikit-build-core, which uses the Ninja
# generator on Windows. Ninja needs cl.exe on PATH, so activate the MSVC
# developer environment before building (otherwise CMake aborts with
# "CMAKE_C_COMPILER not set, after EnableLanguage").
- name: Set up MSVC developer environment
uses: ilammy/msvc-dev-cmd@v1
with:
arch: x64
- name: Build MLC-LLM
run: >-
ci/task/build_win.bat