wehub-resource-sync
0d3cb498a3
Deploy local.promptfoo.app / Deploy to Cloudflare Pages (push) Waiting to run
Test and Publish Multi-arch Docker Image / test (push) Waiting to run
Test and Publish Multi-arch Docker Image / build-docker-and-push-digests (map[digest-suffix:linux-amd64 platform:linux/amd64 runner:ubuntu-latest]) (push) Blocked by required conditions
Test and Publish Multi-arch Docker Image / build-docker-and-push-digests (map[digest-suffix:linux-arm64 platform:linux/arm64 runner:ubuntu-24.04-arm]) (push) Blocked by required conditions
Test and Publish Multi-arch Docker Image / merge-docker-digests (push) Blocked by required conditions
Test and Publish Multi-arch Docker Image / Attest Multi-arch Image (push) Blocked by required conditions
Validate Renovate Config / Validate Renovate Configuration (push) Waiting to run
CI / Shell Format Check (push) Has been cancelled
CI / Check Ruby (3.4) (push) Has been cancelled
CI / CI Config (push) Has been cancelled
CI / Test on Node ${{ matrix.node }} and ${{ matrix.os }}${{ matrix.shard && format(' (shard {0}/3)', matrix.shard) || '' }} (push) Has been cancelled
CI / Build on Node ${{ matrix.node }} (push) Has been cancelled
CI / Style Check (push) Has been cancelled
CI / Generate Assets (push) Has been cancelled
CI / Check Python (3.14) (push) Has been cancelled
CI / Check Python (3.9) (push) Has been cancelled
CI / Build Docs (push) Has been cancelled
CI / Code Scan Action (push) Has been cancelled
CI / Site tests (push) Has been cancelled
CI / webui tests (push) Has been cancelled
CI / Run Integration Tests (push) Has been cancelled
CI / Run Smoke Tests (push) Has been cancelled
CI / Go Tests (push) Has been cancelled
CI / Share Test (push) Has been cancelled
CI / Redteam (Production API) (push) Has been cancelled
CI / Redteam (Staging API) (push) Has been cancelled
CI / GitHub Actions Lint (push) Has been cancelled
CI / Check Ruby (3.0) (push) Has been cancelled
release-please / release-please (push) Has been cancelled
release-please / build (push) Has been cancelled
release-please / publish-npm (push) Has been cancelled
release-please / publish-npm-backfill (push) Has been cancelled
release-please / docker (push) Has been cancelled
release-please / publish-code-scan-action (push) Has been cancelled
release-please / attest-code-scan-action (push) Has been cancelled
3.5 KiB
3.5 KiB
provider-cloudflare/ai (Cloudflare Workers AI)
Cloudflare Workers AI evaluation with OpenAI-compatible endpoints.
Quick Start
You can run this example with:
npx promptfoo@latest init --example provider-cloudflare/ai
cd provider-cloudflare/ai
Environment Variables
This example requires the following environment variables:
CLOUDFLARE_ACCOUNT_ID- Your Cloudflare account ID (found in your Cloudflare dashboard)CLOUDFLARE_API_KEY- Your Cloudflare API key with Workers AI permissions
Set these in your environment:
export CLOUDFLARE_ACCOUNT_ID=your_account_id_here
export CLOUDFLARE_API_KEY=your_api_key_here
Example Configurations
Basic Usage (chat_config.yaml)
Compares the latest flagship chat models:
cloudflare-ai:chat:@cf/openai/gpt-oss-120b- OpenAI's production, general purpose, high reasoning modelcloudflare-ai:chat:@cf/meta/llama-4-scout-17b-16e-instruct- Meta's Llama 4 Scout with native multimodal capabilities
Advanced Configuration (chat_advanced_configuration.yaml)
Demonstrates OpenAI-compatible parameters with Cloudflare AI:
- Uses
@cf/mistralai/mistral-small-3.1-24b-instruct(enhanced vision understanding and 128K context) - Custom
max_tokens,temperature,seedparameters - Environment variable configuration patterns
Embedding Configuration (embedding_configuration.yaml)
Shows embedding generation and similarity testing:
- Chat:
@cf/meta/llama-3.3-70b-instruct-fp8-fast(optimized 70B model with fp8 quantization) - Embedding:
@cf/google/embeddinggemma-300m(state-of-the-art embedding model trained on 100+ languages) - Similarity assertion testing with configurable thresholds
Provider Types
Cloudflare AI supports three provider types:
- Chat:
cloudflare-ai:chat:model-name- Conversational AI and instruction following - Completion:
cloudflare-ai:completion:model-name- Text completion and generation - Embedding:
cloudflare-ai:embedding:model-name- Text embeddings for similarity and search
Featured Models (2025)
This example showcases the latest flagship models:
- OpenAI GPT-OSS-120B (
@cf/openai/gpt-oss-120b) - Production-ready, high reasoning capabilities - Meta Llama 4 Scout (
@cf/meta/llama-4-scout-17b-16e-instruct) - Multimodal with mixture-of-experts - Meta Llama 3.3 70B Fast (
@cf/meta/llama-3.3-70b-instruct-fp8-fast) - Speed-optimized 70B model - Mistral Small 3.1 (
@cf/mistralai/mistral-small-3.1-24b-instruct) - Enhanced vision and 128K context - EmbeddingGemma-300M (
@cf/google/embeddinggemma-300m) - Multilingual embeddings (100+ languages)
OpenAI Compatibility
All examples use Cloudflare's OpenAI-compatible endpoints, supporting standard parameters:
temperature- Response randomness controlmax_tokens- Output length limitstop_p- Nucleus samplingfrequency_penalty- Repetition reductionpresence_penalty- Topic diversity
Local Development
For local testing with your development version:
npm run local -- eval -c examples/provider-cloudflare/ai/chat_config.yaml
References
- Cloudflare Workers AI Models - Complete model catalog
- Cloudflare Workers AI Documentation - Platform overview
- OpenAI Compatibility - API details
- promptfoo Cloudflare AI Provider - Provider documentation