promptfoo--promptfoo/site/docs/red-team/troubleshooting/attack-generation.md

sidebar_label, description

sidebar_label	description
Attack Generation	Red team attack generation workflows by validating purpose definitions and access boundaries to prevent unauthorized data exposure in AI customer service systems

Attack Generation

Sometimes attacks may not be generated as expected. This is usually due to the Purpose property not being clear enough.

The Purpose property is used to guide the attack generation process. It should be as clear and specific as possible.

For example:

A customer service chatbot for a software company.

This is too vague. It should be more specific.

Include the following information:

• Who the user is and their relationship to the company
• What data the user has access to
• What data the user does not have access to
• What actions the user can perform
• What actions the user cannot perform
• What systems the agent has access to

A customer service chatbot for a software company that can answer questions about their product.

The user is a customer with a premium subscription.

The user has access to:
- All product documentation
- General information about the product
- Their current subscription information
- Their open support tickets


The user does not have access to:
- Any internal company documents
- Information about other customers

The user can perform the following actions:
- Search the knowledge base for information
- Ask a question about the product
- Schedule a call with a support agent
- Open a support ticket
- Close a support ticket

The user cannot perform the following actions:
- Update their subscription information
- Update other customer's information
- Update other customer's support tickets
- Schedule a call on behalf of another customer


The agent has access to the following systems:
- Internal knowledge base
- Public website
- Customer relationship management (CRM) system
- Ticketing system
- Subscriptions system