wehub-resource-sync
0d3cb498a3
Deploy local.promptfoo.app / Deploy to Cloudflare Pages (push) Waiting to run
Test and Publish Multi-arch Docker Image / test (push) Waiting to run
Test and Publish Multi-arch Docker Image / build-docker-and-push-digests (map[digest-suffix:linux-amd64 platform:linux/amd64 runner:ubuntu-latest]) (push) Blocked by required conditions
Test and Publish Multi-arch Docker Image / build-docker-and-push-digests (map[digest-suffix:linux-arm64 platform:linux/arm64 runner:ubuntu-24.04-arm]) (push) Blocked by required conditions
Test and Publish Multi-arch Docker Image / merge-docker-digests (push) Blocked by required conditions
Test and Publish Multi-arch Docker Image / Attest Multi-arch Image (push) Blocked by required conditions
CI / Shell Format Check (push) Waiting to run
CI / Check Ruby (3.4) (push) Waiting to run
CI / CI Config (push) Waiting to run
CI / Test on Node ${{ matrix.node }} and ${{ matrix.os }}${{ matrix.shard && format(' (shard {0}/3)', matrix.shard) || '' }} (push) Blocked by required conditions
CI / Build on Node ${{ matrix.node }} (push) Blocked by required conditions
CI / Style Check (push) Waiting to run
CI / Generate Assets (push) Waiting to run
CI / Check Python (3.14) (push) Waiting to run
CI / Check Python (3.9) (push) Waiting to run
CI / Build Docs (push) Waiting to run
CI / Code Scan Action (push) Waiting to run
CI / Site tests (push) Waiting to run
CI / webui tests (push) Waiting to run
CI / Run Integration Tests (push) Waiting to run
CI / Run Smoke Tests (push) Waiting to run
CI / Go Tests (push) Waiting to run
CI / Share Test (push) Waiting to run
CI / Redteam (Production API) (push) Waiting to run
CI / Redteam (Staging API) (push) Waiting to run
CI / GitHub Actions Lint (push) Waiting to run
CI / Check Ruby (3.0) (push) Waiting to run
release-please / release-please (push) Waiting to run
release-please / build (push) Blocked by required conditions
release-please / publish-npm (push) Blocked by required conditions
release-please / publish-npm-backfill (push) Waiting to run
release-please / docker (push) Blocked by required conditions
release-please / publish-code-scan-action (push) Blocked by required conditions
release-please / attest-code-scan-action (push) Blocked by required conditions
Validate Renovate Config / Validate Renovate Configuration (push) Waiting to run
redteam-guardrails (Guardrails Evaluation)
This preset provides a comprehensive testing suite for evaluating guardrails effectiveness against the most critical security threats and harmful content that guardrails are designed to prevent. Similar to how IBM evaluates their Granite Guardian models across 40+ datasets including AegisSafetyTest, ToxicChat, HarmBench, BeaverTails, and RAG hallucination benchmarks, this preset ensures your guardrails are rigorously tested against real-world threats. The comprehensive coverage is essential because guardrails must defend against an evolving landscape of attacks - from sophisticated jailbreaks and prompt injections to harmful content generation and hallucination risks in production AI systems.
You can run this example with:
npx promptfoo@latest init --example redteam-guardrails
cd redteam-guardrails
What it Tests
The Guardrails Evaluation preset includes 42 plugins specifically chosen to test guardrails against:
🎯 Prompt Injection & Jailbreaking (10 plugins)
- ascii-smuggling - Unicode obfuscation attacks
- indirect-prompt-injection - Context-based injection attacks
- cca - Context compliance attacks
- hijacking - Goal hijacking attempts
- system-prompt-override - System prompt manipulation
- beavertails - 330K jailbreak prompts dataset
- harmbench - Academic jailbreak dataset
- pliny - Curated jailbreak collection
- donotanswer - Refusal testing dataset
- prompt-extraction - System prompt disclosure
⚠️ Harmful Content - WMD & Weapons (3 plugins)
- harmful:chemical-biological-weapons - WMD content
- harmful:indiscriminate-weapons - Mass destruction weapons
- harmful:weapons:ied - IED instructions
🔥 Harmful Content - Violence & Crime (5 plugins)
- harmful:violent-crime - Violent criminal activities
- harmful:sex-crime - Sexual crime content
- harmful:non-violent-crime - Non-violent crimes
- harmful:graphic-content - Graphic/violent content
- harmful:unsafe-practices - Dangerous instructions
👥 Harmful Content - Exploitation & Abuse (7 plugins)
- harmful:child-exploitation - Child safety
- harmful:harassment-bullying - Harassment content
- harmful:hate - Hate speech
- harmful:self-harm - Self-harm content
- harmful:sexual-content - Sexual content
- harmful:insults - Personal attacks
- harmful:profanity - Profane language
🏴☠️ Harmful Content - Radicalization & Extremism (1 plugin)
- harmful:radicalization - Extremist content
💻 Harmful Content - Cybercrime & Security (2 plugins)
- harmful:cybercrime - General cybercrime
- harmful:cybercrime:malicious-code - Malicious code generation
💊 Harmful Content - Substances (3 plugins)
- harmful:illegal-activities - General illegal activities
- harmful:illegal-drugs - Drug-related content
- harmful:illegal-drugs:meth - Specific methamphetamine content
📰 Harmful Content - Information Integrity (2 plugins)
- harmful:misinformation-disinformation - False information
- harmful:specialized-advice - Unqualified advice
⚖️ Harmful Content - Legal & IP (2 plugins)
- harmful:copyright-violations - Copyright infringement
- harmful:intellectual-property - IP theft
🛡️ System Security & Integrity (6 plugins)
- cyberseceval - Meta's cybersecurity dataset
- excessive-agency - Unauthorized actions
- hallucination - False information generation
- overreliance - Over-dependence issues
- divergent-repetition - Resource exhaustion attacks
- reasoning-dos - Reasoning DoS attacks
🔐 PII & Privacy Protection (1 plugin)
- harmful:privacy - Privacy violations
Usage
Basic Usage
redteam:
plugins:
- guardrails-eval
With Strategies (Enhanced Testing)
redteam:
plugins:
- guardrails-eval
strategies:
- jailbreak
- jailbreak-templates
- multilingual
Related Files
promptfooconfig.yaml- Example configuration- See promptfoo documentation for more details