The Prompt Extraction red teaming plugin tests an AI system's vulnerability to attacks aimed at extracting the system prompt from the model. The system prompt consists of instructions given to the model to guide its behavior.| www.promptfoo.dev
The BOLA (Broken Object Level Authorization) red teaming plugin is designed to test an AI system's vulnerability to attacks that attempt to access or modify resources belonging to other users or outside the authorized scope (OWASP API 1).| www.promptfoo.dev
The Harmful Content plugin is designed to test an AI system's ability to handle and respond appropriately to various types of harmful or sensitive content. This plugin covers a wide range of potentially problematic areas, from violent crimes to misinformation.| www.promptfoo.dev
The Divergent Repetition red teaming plugin is designed to test whether an AI system can be manipulated into revealing its training data through repetitive pattern exploitation that causes model divergence.| www.promptfoo.dev
Promptfoo is an open-source tool for red teaming gen AI applications.| www.promptfoo.dev
The BFLA (Broken Function Level Authorization) red teaming plugin is designed to test an AI system's ability to maintain proper authorization controls for specific functions or actions (OWASP API 5).| www.promptfoo.dev