wehub-resource-sync
0d3cb498a3
Deploy local.promptfoo.app / Deploy to Cloudflare Pages (push) Waiting to run
Test and Publish Multi-arch Docker Image / test (push) Waiting to run
Test and Publish Multi-arch Docker Image / build-docker-and-push-digests (map[digest-suffix:linux-amd64 platform:linux/amd64 runner:ubuntu-latest]) (push) Blocked by required conditions
Test and Publish Multi-arch Docker Image / build-docker-and-push-digests (map[digest-suffix:linux-arm64 platform:linux/arm64 runner:ubuntu-24.04-arm]) (push) Blocked by required conditions
Test and Publish Multi-arch Docker Image / merge-docker-digests (push) Blocked by required conditions
Test and Publish Multi-arch Docker Image / Attest Multi-arch Image (push) Blocked by required conditions
Validate Renovate Config / Validate Renovate Configuration (push) Waiting to run
CI / Shell Format Check (push) Has been cancelled
CI / Check Ruby (3.4) (push) Has been cancelled
CI / CI Config (push) Has been cancelled
CI / Test on Node ${{ matrix.node }} and ${{ matrix.os }}${{ matrix.shard && format(' (shard {0}/3)', matrix.shard) || '' }} (push) Has been cancelled
CI / Build on Node ${{ matrix.node }} (push) Has been cancelled
CI / Style Check (push) Has been cancelled
CI / Generate Assets (push) Has been cancelled
CI / Check Python (3.14) (push) Has been cancelled
CI / Check Python (3.9) (push) Has been cancelled
CI / Build Docs (push) Has been cancelled
CI / Code Scan Action (push) Has been cancelled
CI / Site tests (push) Has been cancelled
CI / webui tests (push) Has been cancelled
CI / Run Integration Tests (push) Has been cancelled
CI / Run Smoke Tests (push) Has been cancelled
CI / Go Tests (push) Has been cancelled
CI / Share Test (push) Has been cancelled
CI / Redteam (Production API) (push) Has been cancelled
CI / Redteam (Staging API) (push) Has been cancelled
CI / GitHub Actions Lint (push) Has been cancelled
CI / Check Ruby (3.0) (push) Has been cancelled
release-please / release-please (push) Has been cancelled
release-please / build (push) Has been cancelled
release-please / publish-npm (push) Has been cancelled
release-please / publish-npm-backfill (push) Has been cancelled
release-please / docker (push) Has been cancelled
release-please / publish-code-scan-action (push) Has been cancelled
release-please / attest-code-scan-action (push) Has been cancelled
47 lines
1.3 KiB
Markdown
47 lines
1.3 KiB
Markdown
# integration-docker/basic (Docker Comparison)
|
|
|
|
[Docker Model Runner](https://docs.docker.com/ai/model-runner/) makes it easy to manage, run, and deploy AI models using Docker. Designed for developers, Docker Model Runner streamlines the process of pulling, running, and serving large language models (LLMs) and other AI models directly from Docker Hub or any OCI-compliant registry.
|
|
|
|
## Getting Started
|
|
|
|
1. Create a promptfoo project with docker examples
|
|
|
|
```bash
|
|
npx promptfoo@latest init --example integration-docker/basic
|
|
cd integration-docker/basic
|
|
```
|
|
|
|
2. Enable Docker Model Runner in Docker Desktop or Docker Engine per https://docs.docker.com/ai/model-runner/#enable-docker-model-runner.
|
|
3. Use the Docker Model Runner CLI to pull the models
|
|
|
|
**For the simple example:**
|
|
|
|
```bash
|
|
docker model pull ai/llama3.2:3B-Q4_K_M
|
|
```
|
|
|
|
**For the advanced example:**
|
|
|
|
```bash
|
|
docker model pull ai/llama3.2:3B-Q4_K_M
|
|
docker model pull ai/gemma3:4B-Q4_K_M
|
|
docker model pull ai/phi4:14B-Q4_K_M
|
|
docker model pull ai/deepseek-r1-distill-llama:8B-Q4_K_M
|
|
docker model pull ai/smollm3:Q4_K_M
|
|
docker model pull ai/mxbai-embed-large:335M-F16
|
|
```
|
|
|
|
Note: These six models together require ~20 GiB of disk storage.
|
|
|
|
## Simple Example
|
|
|
|
```bash
|
|
promptfoo eval -c promptfooconfig.comparison.simple.yaml
|
|
```
|
|
|
|
## Advanced Example
|
|
|
|
```bash
|
|
promptfoo eval -c promptfooconfig.comparison.advanced.yaml
|
|
```
|