chore: import upstream snapshot with attribution

examples/config-separate-test-configs/README.md

@@ -0,0 +1,18 @@
+# config-separate-test-configs (Separate Test Configs)
+
+You can run this example with:
+
+```bash
+npx promptfoo@latest init --example config-separate-test-configs
+cd config-separate-test-configs
+```
+
+## Usage
+
+This example shows how you can use paths and wildcards to simplify for `promptfooconfig.yaml`.
+
+Run:
+
+```bash
+promptfoo eval
+```

examples/config-separate-test-configs/promptfooconfig.yaml

@@ -0,0 +1,38 @@
+# yaml-language-server: $schema=https://promptfoo.dev/config-schema.json
+description: Loading test cases from separate YAML configuration files
+
+prompts:
+  - file://prompt*.txt
+providers:
+  - openai:gpt-4.1-mini
+
+# The defaultTest configuration is applied to every test case in this config.
+defaultTest:
+  vars:
+    system_message: file://system_prompt.txt
+
+# Loads & runs all test cases matching these filepaths
+tests:
+  # You can supply an exact filepath
+  - file://tests/tests2.yaml
+
+  # Or a glob (wildcard)
+  - file://tests/*
+
+  # Mix and match with actual test cases
+  - vars:
+      topic: the internet
+      content_type: witty tweets
+
+  # Use the file:// prefix to load entire files as vars
+  - vars:
+      topic: file://vars/var_topic.yaml
+      content_type: file://vars/var_content_type.yaml
+
+  # You can also use the file:// prefix to load assertions
+  - vars:
+      topic: fruit loops
+      content_type: Youtube intro
+    assert:
+      - type: javascript
+        value: file://asserts/assert.js

examples/config-separate-test-configs/prompts.txt

@@ -0,0 +1,11 @@
+Generate a list of creative {{content_type}} about {{topic}}.
+---
+Imagine you are an expert in {{topic}}. What {{content_type}} would you recommend writing about?
+---
+[{
+  "role": "system",
+  "content": "{{system_message}}"
+}, {
+  "role": "user",
+  "content": "Suggest a {{content_type}} on the topic of {{topic}}"
+}]

examples/config-separate-test-configs/system_prompt.txt

@@ -0,0 +1,3 @@
+You're a 'modern chat assistant' who happens to "like" bananas.
+
+Be extremely concise. Be aggressive, confident, and do not apologize.

examples/config-separate-test-configs/tests/tests1.yaml

@@ -0,0 +1,24 @@
+# This file contains a list of test cases. They're added alongside test cases
+# from tests2.yaml in the example promptfooconfig.yaml.
+
+- vars:
+    topic: artificial intelligence
+    content_type: blog post ideas
+  assert:
+    - type: javascript
+      value: output.length > 100
+- vars:
+    topic: climate change
+    content_type: policy proposals
+- vars:
+    topic: vegetarian cooking
+    content_type: recipe ideas
+- vars:
+    topic: cybersecurity
+    content_type: educational topics
+- vars:
+    topic: remote work
+    content_type: challenges
+- vars:
+    topic: quantum computing
+    content_type: use cases

examples/config-separate-test-configs/tests/tests2.yaml

@@ -0,0 +1,25 @@
+# This file contains a list of test cases. They're added alongside test cases
+# from tests1.yaml in the example promptfooconfig.yaml.
+
+- vars:
+    topic: alien invasions
+    content_type: survival tips
+  assert:
+    - type: javascript
+      value: output.length > 100
+- vars:
+    topic: time travel
+    content_type: tourist attractions
+- vars:
+    topic: zombie apocalypse
+    content_type: home renovation ideas
+- vars:
+    topic: unicorn breeding
+    content_type: best practices
+- vars:
+    topic: telepathy for beginners
+    content_type: etiquette rules
+- vars:
+    topic: fairy dust
+    content_type: cleaning hacks
+- vars: ../vars/vars_*.yaml

examples/config-separate-test-configs/vars/var_content_type.yaml

@@ -0,0 +1 @@
+UN resolution title

examples/config-separate-test-configs/vars/var_topic.yaml

@@ -0,0 +1 @@
+world peace

examples/config-separate-test-configs/vars/vars_extra.yaml

@@ -0,0 +1,2 @@
+topic: bananas
+content_type: musings of an evil genius