wehub-resource-sync
0d3cb498a3
Deploy local.promptfoo.app / Deploy to Cloudflare Pages (push) Waiting to run
Test and Publish Multi-arch Docker Image / test (push) Waiting to run
Test and Publish Multi-arch Docker Image / build-docker-and-push-digests (map[digest-suffix:linux-amd64 platform:linux/amd64 runner:ubuntu-latest]) (push) Blocked by required conditions
Test and Publish Multi-arch Docker Image / build-docker-and-push-digests (map[digest-suffix:linux-arm64 platform:linux/arm64 runner:ubuntu-24.04-arm]) (push) Blocked by required conditions
Test and Publish Multi-arch Docker Image / merge-docker-digests (push) Blocked by required conditions
Test and Publish Multi-arch Docker Image / Attest Multi-arch Image (push) Blocked by required conditions
Validate Renovate Config / Validate Renovate Configuration (push) Waiting to run
CI / Shell Format Check (push) Has been cancelled
CI / Check Ruby (3.4) (push) Has been cancelled
CI / CI Config (push) Has been cancelled
CI / Test on Node ${{ matrix.node }} and ${{ matrix.os }}${{ matrix.shard && format(' (shard {0}/3)', matrix.shard) || '' }} (push) Has been cancelled
CI / Build on Node ${{ matrix.node }} (push) Has been cancelled
CI / Style Check (push) Has been cancelled
CI / Generate Assets (push) Has been cancelled
CI / Check Python (3.14) (push) Has been cancelled
CI / Check Python (3.9) (push) Has been cancelled
CI / Build Docs (push) Has been cancelled
CI / Code Scan Action (push) Has been cancelled
CI / Site tests (push) Has been cancelled
CI / webui tests (push) Has been cancelled
CI / Run Integration Tests (push) Has been cancelled
CI / Run Smoke Tests (push) Has been cancelled
CI / Go Tests (push) Has been cancelled
CI / Share Test (push) Has been cancelled
CI / Redteam (Production API) (push) Has been cancelled
CI / Redteam (Staging API) (push) Has been cancelled
CI / GitHub Actions Lint (push) Has been cancelled
CI / Check Ruby (3.0) (push) Has been cancelled
release-please / release-please (push) Has been cancelled
release-please / build (push) Has been cancelled
release-please / publish-npm (push) Has been cancelled
release-please / publish-npm-backfill (push) Has been cancelled
release-please / docker (push) Has been cancelled
release-please / publish-code-scan-action (push) Has been cancelled
release-please / attest-code-scan-action (push) Has been cancelled
config-csv-metadata (CSV Metadata Example)
You can run this example with:
npx promptfoo@latest init --example config-csv-metadata
cd config-csv-metadata
Usage
This example demonstrates how to use metadata columns in CSV and Excel test files to organize and filter your test cases. You can see more details on how to build test cases from CSV in the Promptfoo docs
Files
promptfooconfig.yaml: Configuration file with a simple prompt and provider setuptests.csv: Test cases with metadata columns for categorization and filteringtests.xlsx: Same test cases in Excel format (optional - requiresnpm install read-excel-file)
Metadata Columns
The CSV/Excel file includes two types of metadata columns:
__metadata:category- Single value metadata for broad categorization__metadata:tags[]- Array metadata for multiple tags, with comma separation and escape support
Running the Example
Basic evaluation:
promptfoo eval
To use Excel file instead of CSV:
# First install the read-excel-file package
npm install read-excel-file
# Then run with Excel file
promptfoo eval -c promptfooconfig.yaml -t file://tests.xlsx
Filter by category:
promptfoo eval --filter-metadata category=technology
Filter by tags:
promptfoo eval --filter-metadata tags=ai
Note that array metadata values (tags) support escaped commas. For example, "global,warming" is treated as a single tag.
Expected Output
The example includes basic assertions using the __expected column to verify outputs contain relevant keywords.