Files
wehub-resource-sync eec33d25b2
pre-commit / pre-commit (push) Failing after 1s
Build Wheel / build (3.11) (push) Failing after 1s
Build Wheel / build (3.12) (push) Failing after 0s
chore: import upstream snapshot with attribution
2026-07-13 12:29:08 +08:00
..

AudioX online serving

Launches the AudioXPipeline behind vLLM-Omni's OpenAI-compatible chat endpoint and provides a minimal Python client that covers all six tasks (t2a, t2m, v2a, v2m, tv2a, tv2m).

Start the server

cd examples/online_serving/audiox
bash run_server.sh                 # defaults: MODEL=zhangj1an/AudioX, PORT=8099

Environment overrides: MODEL, PORT, DIFFUSION_ATTENTION_BACKEND.

Call from Python

# text-to-audio
python openai_chat_client.py --task t2a \
    --prompt "Fireworks burst twice, followed by a period of silence before a clock begins ticking." \
    --output t2a.wav

# text-to-music
python openai_chat_client.py --task t2m \
    --prompt "Uplifting ukulele tune for a travel vlog" \
    --output t2m.wav

# video-to-audio (no text)
python openai_chat_client.py --task v2a --video path/to/clip.mp4 --output v2a.wav

# text+video-to-audio
python openai_chat_client.py --task tv2a \
    --prompt "drum beating sound and human talking" \
    --video path/to/clip.mp4 \
    --output tv2a.wav

The client sends:

  • num_inference_steps, guidance_scale, seed, audiox_task, seconds_start, seconds_total, sigma_min, sigma_max as flattened keys under extra_body. The server routes the declared knobs (see vllm_omni/model_extras/audiox.py) into the pipeline's sampling_params.extra_args.
  • For v2* / tv2* tasks, the video as a video_url content item (data URI for local files)

curl

curl -sS -X POST http://localhost:8099/v1/chat/completions \
  -H 'Content-Type: application/json' \
  -d '{
    "model": "zhangj1an/AudioX",
    "messages": [{"role": "user", "content": [{"type": "text", "text": "Uplifting ukulele"}]}],
    "extra_body": {
      "num_inference_steps": 250,
      "guidance_scale": 7.0,
      "seed": 42,
      "audiox_task": "t2m",
      "seconds_total": 10.0,
      "sigma_min": 0.3,
      "sigma_max": 500.0
    }
  }' > t2m.json