chore: import upstream snapshot with attribution

examples/openai-vision/README.md

@@ -0,0 +1,57 @@
+# openai-vision (OpenAI Vision Model Example)
+
+This example demonstrates how to use promptfoo to evaluate OpenAI's vision capabilities, allowing you to test models on their ability to analyze and describe images.
+
+## Features Demonstrated
+
+- Using OpenAI's GPT-4o with vision capabilities
+- Incorporating images in prompts using JSON format
+- Passing image URLs as variables
+- Testing vision model responses against expected content
+
+## Environment Variables
+
+This example requires the following environment variables:
+
+- `OPENAI_API_KEY` - Your OpenAI API key
+
+You can set this in a `.env` file or directly in your environment.
+
+## Running the Example
+
+You can run this example with:
+
+```bash
+npx promptfoo@latest init --example openai-vision
+# and then
+cd openai-vision
+
+# Run the evaluation
+npx promptfoo eval
+
+# View the results
+npx promptfoo view
+```
+
+## Example Configuration
+
+This example:
+
+1. Uses a JSON-formatted prompt that includes both text and image inputs
+2. Passes image URLs as variables that can be changed for each test case
+3. Tests the model's ability to accurately describe image content
+4. Demonstrates how to transform variables to generate markdown image tags
+
+## Key Technical Features
+
+- JSON prompt structure for multi-modal inputs
+- Image URL handling through variable substitution
+- Simple assertions to validate image content recognition
+- Variable transformation to generate additional context
+
+## Documentation
+
+For more information, see:
+
+- [OpenAI Vision API Documentation](https://platform.openai.com/docs/guides/vision)
+- [promptfoo OpenAI Provider Documentation](https://promptfoo.dev/docs/providers/openai#sending-images-in-prompts)

examples/openai-vision/prompt.json

@@ -0,0 +1,17 @@
+[
+  {
+    "role": "user",
+    "content": [
+      {
+        "type": "text",
+        "text": "{{question}}"
+      },
+      {
+        "type": "image_url",
+        "image_url": {
+          "url": "{{url}}"
+        }
+      }
+    ]
+  }
+]

examples/openai-vision/promptfooconfig.yaml

@@ -0,0 +1,18 @@
+# yaml-language-server: $schema=https://promptfoo.dev/config-schema.json
+description: OpenAI vision model image analysis and evaluation
+
+prompts:
+  - file://prompt.json
+providers:
+  - openai:chat:gpt-5.4
+
+tests:
+  - vars:
+      question: 'What do you see?'
+      url: 'https://upload.wikimedia.org/wikipedia/commons/thumb/d/dd/Gfp-wisconsin-madison-the-nature-boardwalk.jpg/2560px-Gfp-wisconsin-madison-the-nature-boardwalk.jpg'
+    options:
+      transformVars: |
+        return { ...vars, image_markdown: `![image](${vars.url})` }
+    assert:
+      - type: contains
+        value: 'boardwalk'