wehub-resource-sync
9e8f1bbeed
Dashboard / frontend (push) Failing after 0s
Dashboard / api (push) Failing after 0s
Lint PowerShell / powershell-lint (ubuntu-latest) (push) Failing after 1s
Python Lint / Lint Python with Ruff (push) Failing after 1s
ShellCheck / Lint shell scripts (push) Failing after 1s
Matrix Smoke / linux-smoke (push) Failing after 1s
Matrix Smoke / distro: cachyos (push) Failing after 15s
Matrix Smoke / distro: linux-mint-21.3 (push) Failing after 15s
Matrix Smoke / distro: debian-12 (push) Failing after 5m21s
Matrix Smoke / distro: fedora-41 (push) Failing after 4m56s
Matrix Smoke / distro: ubuntu-24.04 (push) Failing after 2m13s
Matrix Smoke / distro: rocky-9 (push) Failing after 10m39s
Matrix Smoke / distro: manjaro (push) Failing after 12m11s
Matrix Smoke / distro: opensuse-tw (push) Failing after 11m53s
Matrix Smoke / distro: archlinux (push) Failing after 20m3s
Matrix Smoke / distro: ubuntu-22.04 (push) Failing after 13m49s
Validate .env Schema / tier-1-env-validation (push) Successful in 52s
Validate .env Schema / tier-2-env-validation (push) Successful in 44s
Validate .env Schema / tier-3-env-validation (push) Successful in 52s
Validate .env Schema / tier-4-env-validation (push) Successful in 51s
Validate Extensions Catalog / Check catalog is up-to-date (push) Failing after 9m47s
Secret Scan / Scan for secrets (push) Failing after 21m4s
Validate Docker Compose / Validate Docker Compose files (push) Has been cancelled
Python Type Check / Type check with mypy (push) Has been cancelled
Validate .env Schema / tier-0-env-validation (push) Has been cancelled
Test Linux / integration-smoke (push) Has been cancelled
Lint PowerShell / powershell-lint (windows-latest) (push) Has been cancelled
Matrix Smoke / macos-smoke (push) Has been cancelled
36 lines
992 B
YAML
36 lines
992 B
YAML
# ODS — CPU-Only Overlay (Linux / no GPU)
|
|
# Uses llama.cpp server CPU build. No NVIDIA/AMD/Intel GPU required.
|
|
# For low-RAM systems, set LLAMA_SERVER_MEMORY_LIMIT=4G in .env
|
|
#
|
|
# Use with: docker compose -f docker-compose.base.yml -f docker-compose.cpu.yml up -d
|
|
|
|
services:
|
|
llama-server:
|
|
image: ${LLAMA_SERVER_IMAGE:-ghcr.io/ggml-org/llama.cpp:server-b8248}
|
|
command:
|
|
- --model
|
|
- /models/${GGUF_FILE:-Qwen3.5-9B-Q4_K_M.gguf}
|
|
- --host
|
|
- 0.0.0.0
|
|
- --port
|
|
- "8080"
|
|
- --n-gpu-layers
|
|
- "0"
|
|
- --ctx-size
|
|
- "${CTX_SIZE:-8192}"
|
|
- --batch-size
|
|
- "${LLAMA_BATCH_SIZE:-512}"
|
|
- --threads
|
|
- "${LLAMA_THREADS:-4}"
|
|
- --parallel
|
|
- "${LLAMA_PARALLEL:-1}"
|
|
- --metrics
|
|
deploy:
|
|
resources:
|
|
limits:
|
|
cpus: '${LLAMA_CPU_LIMIT:-8.0}'
|
|
memory: ${LLAMA_SERVER_MEMORY_LIMIT:-6G}
|
|
reservations:
|
|
cpus: '${LLAMA_CPU_RESERVATION:-1.0}'
|
|
memory: 2G
|