chore: import upstream snapshot with attribution

2026-07-13 13:24:08 +08:00
commit 0d3cb498a3
5438 changed files with 1316560 additions and 0 deletions
@@ -0,0 +1,46 @@
+# integration-docker/basic (Docker Comparison)
+
+[Docker Model Runner](https://docs.docker.com/ai/model-runner/) makes it easy to manage, run, and deploy AI models using Docker. Designed for developers, Docker Model Runner streamlines the process of pulling, running, and serving large language models (LLMs) and other AI models directly from Docker Hub or any OCI-compliant registry.
+
+## Getting Started
+
+1. Create a promptfoo project with docker examples
+
+```bash
+npx promptfoo@latest init --example integration-docker/basic
+cd integration-docker/basic
+```
+
+2. Enable Docker Model Runner in Docker Desktop or Docker Engine per https://docs.docker.com/ai/model-runner/#enable-docker-model-runner.
+3. Use the Docker Model Runner CLI to pull the models
+
+**For the simple example:**
+
+```bash
+docker model pull ai/llama3.2:3B-Q4_K_M
+```
+
+**For the advanced example:**
+
+```bash
+docker model pull ai/llama3.2:3B-Q4_K_M
+docker model pull ai/gemma3:4B-Q4_K_M
+docker model pull ai/phi4:14B-Q4_K_M
+docker model pull ai/deepseek-r1-distill-llama:8B-Q4_K_M
+docker model pull ai/smollm3:Q4_K_M
+docker model pull ai/mxbai-embed-large:335M-F16
+```
+
+Note: These six models together require ~20 GiB of disk storage.
+
+## Simple Example
+
+```bash
+promptfoo eval -c promptfooconfig.comparison.simple.yaml
+```
+
+## Advanced Example
+
+```bash
+promptfoo eval -c promptfooconfig.comparison.advanced.yaml
+```
@@ -0,0 +1,32 @@
+# yaml-language-server: $schema=https://promptfoo.dev/config-schema.json
+description: Compare facts about a topic with llm-rubric and similar assertions
+
+prompts:
+  - 'What are three concise facts about {{topic}}?'
+
+providers:
+  - id: docker:ai/llama3.2:3B-Q4_K_M
+  - id: docker:ai/gemma3:4B-Q4_K_M
+  - id: docker:ai/phi4:14B-Q4_K_M
+  - id: docker:ai/deepseek-r1-distill-llama:8B-Q4_K_M
+    config:
+      temperature: 0.1
+      max_tokens: 512
+
+tests:
+  - vars:
+      topic: 'whales'
+    assert:
+      - type: llm-rubric
+        value: 'Provide at least two of these three facts: Whales are (a) mammals, (b) live in the ocean, and (c) communicate with sound.'
+      - type: similar
+        value: 'whales are the largest animals in the world'
+        threshold: 0.6
+
+# Use local models for grading and embeddings for similarity instead of OpenAI
+defaultTest:
+  options:
+    provider:
+      id: docker:ai/smollm3:Q4_K_M
+      embedding:
+        id: docker:embeddings:ai/mxbai-embed-large:335M-F16
@@ -0,0 +1,15 @@
+# yaml-language-server: $schema=https://promptfoo.dev/config-schema.json
+description: Compare facts about a topic
+
+prompts:
+  - 'What are three concise facts about {{topic}}?'
+
+providers:
+  - id: docker:ai/llama3.2:3B-Q4_K_M
+
+tests:
+  - vars:
+      topic: 'whales'
+    assert:
+      - type: contains
+        value: 'mammals'