chore: import upstream snapshot with attribution
CI / Shell Format Check (push) Has been cancelled
CI / Check Ruby (3.4) (push) Has been cancelled
CI / CI Config (push) Has been cancelled
CI / Test on Node ${{ matrix.node }} and ${{ matrix.os }}${{ matrix.shard && format(' (shard {0}/3)', matrix.shard) || '' }} (push) Has been cancelled
CI / Build on Node ${{ matrix.node }} (push) Has been cancelled
CI / Style Check (push) Has been cancelled
CI / Generate Assets (push) Has been cancelled
CI / Check Python (3.14) (push) Has been cancelled
CI / Check Python (3.9) (push) Has been cancelled
CI / Build Docs (push) Has been cancelled
CI / Code Scan Action (push) Has been cancelled
CI / Site tests (push) Has been cancelled
CI / webui tests (push) Has been cancelled
CI / Run Integration Tests (push) Has been cancelled
CI / Run Smoke Tests (push) Has been cancelled
CI / Go Tests (push) Has been cancelled
CI / Share Test (push) Has been cancelled
CI / Redteam (Production API) (push) Has been cancelled
CI / Redteam (Staging API) (push) Has been cancelled
CI / GitHub Actions Lint (push) Has been cancelled
CI / Check Ruby (3.0) (push) Has been cancelled
release-please / release-please (push) Has been cancelled
release-please / build (push) Has been cancelled
release-please / publish-npm (push) Has been cancelled
release-please / publish-npm-backfill (push) Has been cancelled
release-please / docker (push) Has been cancelled
release-please / publish-code-scan-action (push) Has been cancelled
release-please / attest-code-scan-action (push) Has been cancelled
Deploy local.promptfoo.app / Deploy to Cloudflare Pages (push) Has been cancelled
Test and Publish Multi-arch Docker Image / test (push) Has been cancelled
Test and Publish Multi-arch Docker Image / build-docker-and-push-digests (map[digest-suffix:linux-amd64 platform:linux/amd64 runner:ubuntu-latest]) (push) Has been cancelled
Test and Publish Multi-arch Docker Image / build-docker-and-push-digests (map[digest-suffix:linux-arm64 platform:linux/arm64 runner:ubuntu-24.04-arm]) (push) Has been cancelled
Test and Publish Multi-arch Docker Image / merge-docker-digests (push) Has been cancelled
Test and Publish Multi-arch Docker Image / Attest Multi-arch Image (push) Has been cancelled
Validate Renovate Config / Validate Renovate Configuration (push) Has been cancelled
CI / Shell Format Check (push) Has been cancelled
CI / Check Ruby (3.4) (push) Has been cancelled
CI / CI Config (push) Has been cancelled
CI / Test on Node ${{ matrix.node }} and ${{ matrix.os }}${{ matrix.shard && format(' (shard {0}/3)', matrix.shard) || '' }} (push) Has been cancelled
CI / Build on Node ${{ matrix.node }} (push) Has been cancelled
CI / Style Check (push) Has been cancelled
CI / Generate Assets (push) Has been cancelled
CI / Check Python (3.14) (push) Has been cancelled
CI / Check Python (3.9) (push) Has been cancelled
CI / Build Docs (push) Has been cancelled
CI / Code Scan Action (push) Has been cancelled
CI / Site tests (push) Has been cancelled
CI / webui tests (push) Has been cancelled
CI / Run Integration Tests (push) Has been cancelled
CI / Run Smoke Tests (push) Has been cancelled
CI / Go Tests (push) Has been cancelled
CI / Share Test (push) Has been cancelled
CI / Redteam (Production API) (push) Has been cancelled
CI / Redteam (Staging API) (push) Has been cancelled
CI / GitHub Actions Lint (push) Has been cancelled
CI / Check Ruby (3.0) (push) Has been cancelled
release-please / release-please (push) Has been cancelled
release-please / build (push) Has been cancelled
release-please / publish-npm (push) Has been cancelled
release-please / publish-npm-backfill (push) Has been cancelled
release-please / docker (push) Has been cancelled
release-please / publish-code-scan-action (push) Has been cancelled
release-please / attest-code-scan-action (push) Has been cancelled
Deploy local.promptfoo.app / Deploy to Cloudflare Pages (push) Has been cancelled
Test and Publish Multi-arch Docker Image / test (push) Has been cancelled
Test and Publish Multi-arch Docker Image / build-docker-and-push-digests (map[digest-suffix:linux-amd64 platform:linux/amd64 runner:ubuntu-latest]) (push) Has been cancelled
Test and Publish Multi-arch Docker Image / build-docker-and-push-digests (map[digest-suffix:linux-arm64 platform:linux/arm64 runner:ubuntu-24.04-arm]) (push) Has been cancelled
Test and Publish Multi-arch Docker Image / merge-docker-digests (push) Has been cancelled
Test and Publish Multi-arch Docker Image / Attest Multi-arch Image (push) Has been cancelled
Validate Renovate Config / Validate Renovate Configuration (push) Has been cancelled
This commit is contained in:
@@ -0,0 +1,55 @@
|
||||
# provider-cloudflare/gateway (Cloudflare AI Gateway)
|
||||
|
||||
You can run this example with:
|
||||
|
||||
```bash
|
||||
npx promptfoo@latest init --example provider-cloudflare/gateway
|
||||
cd provider-cloudflare/gateway
|
||||
```
|
||||
|
||||
This example demonstrates how to route AI requests through [Cloudflare AI Gateway](https://developers.cloudflare.com/ai-gateway/) for caching, rate limiting, and analytics.
|
||||
|
||||
## Prerequisites
|
||||
|
||||
1. A Cloudflare account with AI Gateway enabled
|
||||
2. An AI Gateway created in your Cloudflare dashboard
|
||||
3. API keys for the providers you want to use (OpenAI, Anthropic, Groq, etc.)
|
||||
|
||||
## Setup
|
||||
|
||||
Set the required environment variables:
|
||||
|
||||
```bash
|
||||
export CLOUDFLARE_ACCOUNT_ID=your_account_id
|
||||
export CLOUDFLARE_GATEWAY_ID=your_gateway_id
|
||||
export OPENAI_API_KEY=your_openai_key
|
||||
export ANTHROPIC_API_KEY=your_anthropic_key
|
||||
export GROQ_API_KEY=your_groq_key
|
||||
```
|
||||
|
||||
## Running the Example
|
||||
|
||||
```bash
|
||||
npx promptfoo eval -c examples/provider-cloudflare/gateway/promptfooconfig.yaml
|
||||
```
|
||||
|
||||
## What This Example Does
|
||||
|
||||
The configuration compares responses from three different providers, all routed through Cloudflare AI Gateway:
|
||||
|
||||
- **OpenAI** (gpt-4o-mini)
|
||||
- **Anthropic** (claude-haiku-4-5-20251001)
|
||||
- **Groq** (llama-3.1-8b-instant)
|
||||
|
||||
Each provider answers questions about technical topics, and the assertions verify that responses contain relevant keywords.
|
||||
|
||||
## Benefits of Using AI Gateway
|
||||
|
||||
- **Caching**: Identical requests are cached, reducing costs during development
|
||||
- **Analytics**: View usage across all providers in your Cloudflare dashboard
|
||||
- **Rate Limiting**: Protect against quota issues with request queuing
|
||||
- **Logging**: All requests and responses are logged for debugging
|
||||
|
||||
## Documentation
|
||||
|
||||
See the [Cloudflare AI Gateway provider documentation](https://www.promptfoo.dev/docs/providers/cloudflare-gateway) for more details.
|
||||
@@ -0,0 +1,89 @@
|
||||
# yaml-language-server: $schema=https://promptfoo.dev/config-schema.json
|
||||
# Cloudflare AI Gateway Example
|
||||
#
|
||||
# This example demonstrates routing AI requests through Cloudflare AI Gateway
|
||||
# for caching, rate limiting, and analytics.
|
||||
#
|
||||
# Required environment variables:
|
||||
# CLOUDFLARE_ACCOUNT_ID - Your Cloudflare account ID
|
||||
# CLOUDFLARE_GATEWAY_ID - Your AI Gateway ID
|
||||
#
|
||||
# Optional environment variables:
|
||||
# CF_AIG_TOKEN - Required if your gateway has "Authenticated Gateway" enabled
|
||||
#
|
||||
# Provider API keys (choose based on which providers you use):
|
||||
# OPENAI_API_KEY - OpenAI API key
|
||||
# ANTHROPIC_API_KEY - Anthropic API key
|
||||
# GROQ_API_KEY - Groq API key
|
||||
#
|
||||
# Note: If you've configured BYOK (Bring Your Own Keys) in Cloudflare dashboard,
|
||||
# you can omit the provider API keys - Cloudflare will use the stored keys.
|
||||
#
|
||||
# Run with:
|
||||
# npx promptfoo eval -c examples/provider-cloudflare/gateway/promptfooconfig.yaml
|
||||
|
||||
description: Cloudflare AI Gateway comparison
|
||||
|
||||
prompts:
|
||||
- 'Explain {{topic}} in simple terms, in about 2-3 sentences.'
|
||||
|
||||
providers:
|
||||
# Route OpenAI requests through Cloudflare AI Gateway
|
||||
- id: cloudflare-gateway:openai:gpt-4o-mini
|
||||
config:
|
||||
accountId: '{{env.CLOUDFLARE_ACCOUNT_ID}}'
|
||||
gatewayId: '{{env.CLOUDFLARE_GATEWAY_ID}}'
|
||||
# Uncomment if using authenticated gateway:
|
||||
# cfAigToken: '{{env.CF_AIG_TOKEN}}'
|
||||
temperature: 0.7
|
||||
max_tokens: 200
|
||||
|
||||
# Route Anthropic requests through Cloudflare AI Gateway
|
||||
- id: cloudflare-gateway:anthropic:claude-haiku-4-5-20251001
|
||||
config:
|
||||
accountId: '{{env.CLOUDFLARE_ACCOUNT_ID}}'
|
||||
gatewayId: '{{env.CLOUDFLARE_GATEWAY_ID}}'
|
||||
# Uncomment if using authenticated gateway:
|
||||
# cfAigToken: '{{env.CF_AIG_TOKEN}}'
|
||||
max_tokens: 200
|
||||
|
||||
# Route Groq requests through Cloudflare AI Gateway
|
||||
- id: cloudflare-gateway:groq:llama-3.1-8b-instant
|
||||
config:
|
||||
accountId: '{{env.CLOUDFLARE_ACCOUNT_ID}}'
|
||||
gatewayId: '{{env.CLOUDFLARE_GATEWAY_ID}}'
|
||||
# Uncomment if using authenticated gateway:
|
||||
# cfAigToken: '{{env.CF_AIG_TOKEN}}'
|
||||
temperature: 0.7
|
||||
max_tokens: 200
|
||||
|
||||
tests:
|
||||
- vars:
|
||||
topic: machine learning
|
||||
assert:
|
||||
- type: contains-any
|
||||
value:
|
||||
- algorithm
|
||||
- data
|
||||
- learn
|
||||
- pattern
|
||||
|
||||
- vars:
|
||||
topic: quantum computing
|
||||
assert:
|
||||
- type: contains-any
|
||||
value:
|
||||
- qubit
|
||||
- quantum
|
||||
- superposition
|
||||
- computer
|
||||
|
||||
- vars:
|
||||
topic: blockchain
|
||||
assert:
|
||||
- type: contains-any
|
||||
value:
|
||||
- block
|
||||
- chain
|
||||
- ledger
|
||||
- decentralized
|
||||
Reference in New Issue
Block a user