wehub-resource-sync
9e8f1bbeed
Dashboard / frontend (push) Failing after 0s
Dashboard / api (push) Failing after 0s
Lint PowerShell / powershell-lint (ubuntu-latest) (push) Failing after 1s
Python Lint / Lint Python with Ruff (push) Failing after 1s
ShellCheck / Lint shell scripts (push) Failing after 1s
Matrix Smoke / linux-smoke (push) Failing after 1s
Matrix Smoke / distro: cachyos (push) Failing after 15s
Matrix Smoke / distro: linux-mint-21.3 (push) Failing after 15s
Matrix Smoke / distro: debian-12 (push) Failing after 5m21s
Matrix Smoke / distro: fedora-41 (push) Failing after 4m56s
Matrix Smoke / distro: ubuntu-24.04 (push) Failing after 2m13s
Matrix Smoke / distro: rocky-9 (push) Failing after 10m39s
Matrix Smoke / distro: manjaro (push) Failing after 12m11s
Matrix Smoke / distro: opensuse-tw (push) Failing after 11m53s
Matrix Smoke / distro: archlinux (push) Failing after 20m3s
Matrix Smoke / distro: ubuntu-22.04 (push) Failing after 13m49s
Validate .env Schema / tier-1-env-validation (push) Successful in 52s
Validate .env Schema / tier-2-env-validation (push) Successful in 44s
Validate .env Schema / tier-3-env-validation (push) Successful in 52s
Validate .env Schema / tier-4-env-validation (push) Successful in 51s
Validate Extensions Catalog / Check catalog is up-to-date (push) Failing after 9m47s
Secret Scan / Scan for secrets (push) Failing after 21m4s
Validate Docker Compose / Validate Docker Compose files (push) Has been cancelled
Python Type Check / Type check with mypy (push) Has been cancelled
Validate .env Schema / tier-0-env-validation (push) Has been cancelled
Test Linux / integration-smoke (push) Has been cancelled
Lint PowerShell / powershell-lint (windows-latest) (push) Has been cancelled
Matrix Smoke / macos-smoke (push) Has been cancelled
52 lines
2.0 KiB
Plaintext
52 lines
2.0 KiB
Plaintext
# ODS: Local AI Infrastructure
|
|
|
|
ODS is a turnkey local AI stack designed to bring powerful AI capabilities to your own hardware. It provides a complete solution for running large language models, voice processing, and workflow automation entirely on your own infrastructure.
|
|
|
|
## Core Components
|
|
|
|
### llama-server - High Performance Inference
|
|
llama-server (from llama.cpp) serves as the backbone of ODS, providing OpenAI-compatible API endpoints for language model inference. It supports GGUF models including Qwen 3, Llama 3, and Mistral, automatically selecting the best model for your hardware tier.
|
|
|
|
### Open WebUI - Chat Interface
|
|
A beautiful, responsive chat interface that works with any OpenAI-compatible backend. Features include conversation history, model selection, and user management.
|
|
|
|
### Voice Processing
|
|
- **Whisper** for speech-to-text transcription with high accuracy
|
|
- **Piper** for natural-sounding text-to-speech synthesis
|
|
- Combined, these enable fully local voice assistants
|
|
|
|
### Workflow Automation
|
|
n8n integration provides visual workflow automation. Pre-built workflows include:
|
|
- Document Q&A (RAG pipeline)
|
|
- Voice transcription
|
|
- Code assistance
|
|
- Scheduled summarization
|
|
|
|
### Vector Database
|
|
Qdrant provides efficient vector storage and similarity search for RAG (Retrieval Augmented Generation) applications.
|
|
|
|
## Hardware Tiers
|
|
|
|
ODS automatically detects your GPU and configures appropriate models:
|
|
|
|
1. **Minimal** (<20GB VRAM): 7B quantized models
|
|
2. **Entry** (20-27GB VRAM): 14B AWQ models
|
|
3. **Prosumer** (28-47GB VRAM): 32B AWQ models
|
|
4. **Pro** (48GB+ VRAM): 70B+ models
|
|
|
|
## Installation
|
|
|
|
```bash
|
|
git clone https://github.com/Light-Heart-Labs/ODS.git
|
|
cd ODS/ods
|
|
./install.sh
|
|
```
|
|
|
|
The installer handles everything: Docker setup, GPU configuration, model selection, and service startup.
|
|
|
|
## Philosophy
|
|
|
|
ODS embodies the principle that AI should be accessible, private, and owned by users. Your data stays on your hardware. Your models run locally. Your AI, your rules.
|
|
|
|
Built by The Collective — making local AI practical for everyone.
|