chore: import upstream snapshot with attribution

examples/google-vertex-tools/README.md

@@ -0,0 +1,100 @@
+# google-vertex-tools (Google Vertex Tools)
+
+Example configurations for testing Google Vertex AI models with function calling and tool callbacks.
+
+You can run this example with:
+
+```bash
+npx promptfoo@latest init --example google-vertex-tools
+cd google-vertex-tools
+```
+
+## Purpose
+
+This example demonstrates how to use [Vertex AI models](https://www.promptfoo.dev/docs/providers/vertex/) with:
+
+- Function calling and tool declarations
+- Function callback execution with local implementations
+- Different configuration approaches (YAML vs JavaScript)
+
+## Prerequisites
+
+1. Install the Google Auth Library:
+
+   ```sh
+   npm install google-auth-library
+   ```
+
+2. Enable the Vertex AI API in your Google Cloud project
+
+3. Configure your Google Cloud project:
+
+   ```sh
+   gcloud config set project PROJECT_ID
+   ```
+
+4. Set up authentication using one of these methods:
+   - Authenticate with your Google account:
+
+     ```sh
+     gcloud auth application-default login
+     ```
+
+   - Use a machine with an authorized service account
+   - Use service account credentials file:
+     1. Download your service account JSON
+     2. Set the credentials path:
+
+        ```sh
+        export GOOGLE_APPLICATION_CREDENTIALS=/path/to/credentials.json
+        ```
+
+## Configurations
+
+This example includes two different approaches:
+
+### Basic Tool Declaration (`promptfooconfig.yaml`)
+
+Uses external tool definitions and validates function calls without execution:
+
+- `promptfooconfig.yaml` - YAML configuration with external tools
+- `tools.json` - Function definitions for weather lookup
+
+### Function Callbacks (`promptfooconfig-callback.js`)
+
+Demonstrates actual function execution with local callbacks:
+
+- `promptfooconfig-callback.js` - JavaScript configuration with inline tools and callbacks
+- Includes local function implementation for adding numbers
+
+## Running the Examples
+
+1. **Basic tool declaration example:**
+
+   ```sh
+   promptfoo eval -c promptfooconfig.yaml
+   ```
+
+2. **Function callback example:**
+
+   ```sh
+   promptfoo eval -c promptfooconfig-callback.js
+   ```
+
+3. **View results:**
+
+   ```sh
+   promptfoo view
+   ```
+
+## Expected Results
+
+- **Basic example**: Validates that the model correctly calls the weather function with proper parameters
+- **Callback example**: Actually executes the addition function and validates the computed results
+
+## Learn More
+
+- [Vertex AI Provider Documentation](https://www.promptfoo.dev/docs/providers/vertex/)
+- [Google Cloud Vertex AI Documentation](https://cloud.google.com/vertex-ai/docs)
+- [Function Calling Documentation](https://www.promptfoo.dev/docs/providers/vertex/#function-calling)
+- [promptfoo Documentation](https://www.promptfoo.dev/docs/)

examples/google-vertex-tools/promptfooconfig-callback.js

@@ -0,0 +1,58 @@
+module.exports = /** @type {import('promptfoo').TestSuiteConfig} */ ({
+  description: 'Function calling and callback execution demonstration',
+  prompts: [
+    'Please add the following numbers together: {{a}} and {{b}}',
+    'What is the sum of {{a}} and {{b}}?',
+  ],
+  providers: [
+    {
+      id: 'vertex:gemini-2.5-flash-002',
+      config: {
+        tools: [
+          {
+            functionDeclarations: [
+              {
+                name: 'addNumbers',
+                description: 'Add two numbers together',
+                parameters: {
+                  type: 'object',
+                  properties: {
+                    a: { type: 'number' },
+                    b: { type: 'number' },
+                  },
+                  required: ['a', 'b'],
+                },
+              },
+            ],
+          },
+        ],
+        functionToolCallbacks: {
+          addNumbers: (parametersJsonString) => {
+            const { a, b } = JSON.parse(parametersJsonString);
+            return JSON.stringify(a + b);
+          },
+        },
+      },
+    },
+  ],
+  tests: [
+    {
+      vars: { a: 5, b: 6 },
+      assert: [
+        {
+          type: 'equals',
+          value: '11',
+        },
+      ],
+    },
+    {
+      vars: { a: 10, b: 20 },
+      assert: [
+        {
+          type: 'javascript',
+          value: "output.includes('30')",
+        },
+      ],
+    },
+  ],
+});

examples/google-vertex-tools/promptfooconfig.yaml

@@ -0,0 +1,41 @@
+# yaml-language-server: $schema=https://promptfoo.dev/config-schema.json
+
+# Learn more about building a configuration: https://promptfoo.dev/docs/configuration/guide
+
+description: 'Function calling demonstration'
+
+prompts:
+  - What is the weather in {{location}}?
+
+providers:
+  # See https://www.promptfoo.dev/docs/providers/vertex/
+  - id: 'vertex:gemini-2.5-flash-002'
+    config:
+      tools: file://tools.json
+
+defaultTest:
+  assert:
+    - type: is-valid-function-call
+    - type: equals
+      value: get_current_weather
+      # Transform is a cleaner way to pick out specific properties.
+      # This transform returns only the 'name' property
+      transform: output[0].functionCall.name
+    - type: similar
+      value: '{{location}}'
+      threshold: 0.9
+      # This transform returns only the parsed location argument.
+      transform: output[0].functionCall.args.location
+
+  options:
+    # This overrides the default grading providers with Vertex AI models.
+    providers:
+      embedding: 'vertex:embedding:text-embedding-005'
+      text: 'vertex:gemini-2.5-flash-002'
+
+tests:
+  - vars:
+      location: San Francisco
+
+  - vars:
+      location: New York

examples/google-vertex-tools/tools.json

@@ -0,0 +1,20 @@
+[
+  {
+    "functionDeclarations": [
+      {
+        "name": "get_current_weather",
+        "description": "Get the current weather in a given location",
+        "parameters": {
+          "type": "object",
+          "properties": {
+            "location": {
+              "type": "string",
+              "description": "The city and state, e.g. San Francisco, CA or a zip code e.g. 95616"
+            }
+          },
+          "required": ["location"]
+        }
+      }
+    ]
+  }
+]