chore: import upstream snapshot with attribution

2026-07-13 13:24:08 +08:00
commit 0d3cb498a3
5438 changed files with 1316560 additions and 0 deletions
@@ -0,0 +1,93 @@
+# google-vertex (Google Vertex AI Examples)
+
+Example configurations for testing Google Vertex AI models with promptfoo.
+
+You can run this example with:
+
+```bash
+npx promptfoo@latest init --example google-vertex
+cd google-vertex
+```
+
+## Purpose
+
+- Test Vertex AI's Gemini, Claude, and Llama models
+- Configure model-specific features and search grounding
+- Compare performance across different tasks
+
+## Prerequisites
+
+- Google Cloud account with Vertex AI API enabled
+- API credentials
+- Node.js ^20.20.0 or >=22.22.0 (Node.js 20 support ends July 30, 2026; Node.js 24 LTS recommended)
+
+## Environment Variables
+
+- `VERTEX_PROJECT_ID` - Your Google Cloud project ID
+- `GOOGLE_APPLICATION_CREDENTIALS` - Path to service account credentials (optional)
+
+## Setup
+
+1. Install dependencies:
+
+   ```sh
+   npm install google-auth-library
+   ```
+
+2. Configure authentication:
+
+   ```sh
+   # User account (development)
+   gcloud auth application-default login
+
+   # Or service account
+   export GOOGLE_APPLICATION_CREDENTIALS=/path/to/credentials.json
+   ```
+
+3. Set your project ID:
+   ```sh
+   export VERTEX_PROJECT_ID=your-project-id
+   ```
+
+## Configurations
+
+This example includes:
+
+- `promptfooconfig.gemini.yaml`: Gemini models with function calling, system instructions, and safety settings
+- `promptfooconfig.claude.yaml`: Claude models for technical writing and code analysis
+- `promptfooconfig.llama.yaml`: Llama models with safety features and region configuration
+- `promptfooconfig.search.yaml`: Search grounding for real-time information
+- `promptfooconfig.response-schema.yaml`: Response schemas with structured output
+
+## Running Examples
+
+```sh
+# Basic example
+promptfoo eval -c promptfooconfig.yaml
+
+# Model-specific examples
+promptfoo eval -c promptfooconfig.gemini.yaml
+promptfoo eval -c promptfooconfig.claude.yaml
+promptfoo eval -c promptfooconfig.llama.yaml
+
+# Search grounding tool and image understanding
+promptfoo eval -c promptfooconfig.search.yaml
+promptfoo eval -c promptfooconfig.image.yaml
+
+# Structured output with response schemas
+promptfoo eval -c promptfooconfig.response-schema.yaml
+
+# View results
+promptfoo view
+```
+
+## Expected Results
+
+Each configuration demonstrates different model capabilities, from function calling and tool use to safety features and real-time information retrieval.
+
+## Learn More
+
+- [Vertex AI Provider Documentation](https://www.promptfoo.dev/docs/providers/vertex/)
+- [Google Cloud Vertex AI Documentation](https://cloud.google.com/vertex-ai/docs)
+- [Google documentation on Grounding with Google Search](https://ai.google.dev/docs/gemini_api/grounding)
+- [Google documentation on Image Understanding](https://ai.google.dev/gemini-api/docs/image-understanding#inline-image)