wehub-resource-sync
ec436095dd
Book-CI / test (macos-latest) (push) Has been cancelled
Book-CI / test (ubuntu-latest) (push) Has been cancelled
Book-CI / test (windows-latest) (push) Has been cancelled
Release Fake Tag / publish (push) Has been cancelled
Deploy / deploy (macos-latest) (push) Has been cancelled
Deploy / deploy (ubuntu-latest) (push) Has been cancelled
Deploy / deploy (windows-latest) (push) Has been cancelled
Release to PyPI / Build & publish sglang-kt (push) Has been cancelled
Release to PyPI / Build kt-kernel (Python 3.11) (push) Has been cancelled
Release to PyPI / Build kt-kernel (Python 3.12) (push) Has been cancelled
Release to PyPI / Publish kt-kernel to PyPI (push) Has been cancelled
44 lines
1.4 KiB
Markdown
44 lines
1.4 KiB
Markdown
# KT-CLI
|
|
|
|
> ⚠️ **Note:** This feature is currently under active development. Many functionalities are not yet complete and are being improved. Please stay tuned for updates.
|
|
|
|
## Design Philosophy
|
|
|
|
KT-CLI is designed to **minimize the burden of reading documentation**. Instead of requiring users to read lengthy docs, the CLI provides:
|
|
|
|
- **Interactive Mode**: Run commands without arguments to get step-by-step guided prompts
|
|
- **Direct Mode**: Pass arguments directly for automation and scripting
|
|
> 💡 **Tip:** The arguments are fully compatible with the previous SGLang + KTransformers approach, so you can migrate seamlessly.
|
|
|
|
Simply run a command, and the CLI will interactively guide you through the process!
|
|
|
|
## Usage
|
|
|
|
You can check the usage by `kt --help`
|
|
|
|
```
|
|
kt [OPTIONS] COMMAND [ARGS]...
|
|
```
|
|
|
|
KTransformers CLI - A unified command-line interface for KTransformers.
|
|
|
|
## Options
|
|
|
|
| Option | Description |
|
|
|--------|-------------|
|
|
| `--help` | Show this message and exit. |
|
|
|
|
## Commands
|
|
|
|
| Command | Description |
|
|
|---------|-------------|
|
|
| `version` | Show version information |
|
|
| `chat` | Interactive chat with running model |
|
|
| `quant` | Quantize model weights |
|
|
| `bench` | Run full benchmark |
|
|
| `microbench` | Run micro-benchmark |
|
|
| `doctor` | Diagnose environment issues |
|
|
| `model` | Manage models and storage paths |
|
|
| `config` | Manage configuration |
|
|
| `sft` | Fine-tuning with LlamaFactory |
|