chore: import upstream snapshot with attribution

2026-07-13 13:24:08 +08:00
commit 0d3cb498a3
5438 changed files with 1316560 additions and 0 deletions
@@ -0,0 +1,64 @@
+# provider-fal (fal.ai Image Generation Example)
+
+You can run this example with:
+
+```bash
+npx promptfoo@latest init --example provider-fal
+cd provider-fal
+```
+
+Demonstrates how to evaluate and compare image generation models using promptfoo.
+
+## Setup
+
+1. **Get your API key** from [fal.ai dashboard](https://fal.ai/dashboard/keys)
+2. **Set environment variable**:
+   ```bash
+   export FAL_KEY=your-fal-key-here
+   ```
+3. **Install client**:
+   ```bash
+   npm install @fal-ai/client
+   ```
+4. **Run the evaluation**:
+   ```bash
+   promptfoo eval
+   ```
+
+## What This Example Shows
+
+- **Model comparison**: Two different fal.ai models side-by-side
+- **Creative prompts**: 7 test cases with artistic styles
+- **Reproducible results**: Fixed seeds for consistent outputs
+- **Configuration options**: Different settings per model
+
+## Example Output
+
+The evaluation generates a comparison table showing:
+
+- Model performance across different prompts
+- Generated images in markdown format
+- Execution time and caching behavior
+
+## View Results
+
+```bash
+promptfoo view
+```
+
+Opens the web interface to browse generated images and compare model outputs.
+
+## Customize the Example
+
+Edit `promptfooconfig.yaml` to:
+
+- Try different models from [fal.ai/models](https://fal.ai/models)
+- Add your own prompts
+- Adjust model parameters
+- Add assertions to test output quality
+- Route SDK requests through a proxy with `config.client.proxyUrl` when your environment requires it
+
+## Documentation
+
+- [promptfoo fal provider](https://promptfoo.dev/docs/providers/fal)
+- [fal.ai models](https://fal.ai/models)
@@ -0,0 +1,62 @@
+# yaml-language-server: $schema=https://promptfoo.dev/config-schema.json
+description: fal.ai image generation comparison
+
+prompts:
+  - 'Create a {{quality}} image of {{subject}} with {{style}} aesthetic'
+
+providers:
+  - id: fal:image:fal-ai/flux/schnell
+    config:
+      seed: 42
+      num_inference_steps: 4
+      guidance_scale: 3.5
+
+  - id: fal:image:fal-ai/flux/dev
+    config:
+      seed: 42
+      num_inference_steps: 28
+      guidance_scale: 7.5
+      image_size: landscape_4_3
+
+tests:
+  - vars:
+      style: Van Gogh painting
+      subject: starry night over a cyberpunk city
+      mood: dreamy
+      quality: highly detailed
+
+  - vars:
+      style: Picasso cubist artwork
+      subject: robot playing chess
+      mood: abstract
+      quality: artistic
+
+  - vars:
+      style: Monet impressionist painting
+      subject: dragon flying over water lilies
+      mood: serene
+      quality: ethereal
+
+  - vars:
+      style: Studio Ghibli animation
+      subject: floating castle in the clouds
+      mood: whimsical
+      quality: cinematic
+
+  - vars:
+      style: cyberpunk digital art
+      subject: neon-lit street with flying cars
+      mood: futuristic
+      quality: ultra-realistic
+
+  - vars:
+      style: Renaissance masterpiece
+      subject: astronaut discovering alien ruins
+      mood: majestic
+      quality: museum-worthy
+
+  - vars:
+      style: Japanese woodblock print
+      subject: giant octopus attacking a spaceship
+      mood: dramatic
+      quality: traditional