Promptfoo

Tool manual · Kali & common usage

AI Security · Intermediate · AI Security lane

IntermediateAI Security

Authorized usage only. Capture and inspect traffic only on systems and networks you own or have written permission to analyze.

What is Promptfoo?

Promptfoo evaluates LLM prompts/policies with YAML-driven test cases.

Regression-test guardrails in CI for AI apps you build.

Official website: Promptfoo · Documentation

When do you use it?

You need Test and evaluate LLM prompts/policies.
You are following a CYNARKS lab or authorized engagement that calls for Promptfoo.
You already tried simpler checks and need this tool’s deeper capability.

Who uses it?

Security practitioners
Students in authorized labs
Engineers validating their own systems

How do you use it? (typical flow)

Install Promptfoo using the steps below (prefer Kali package or official installer).
Confirm you have authorization for the target (lab VM, own system, or written scope).
Run --help / man (or the Help section) to see current flags for your version.
Start with a safe example from Basic commands against localhost or an authorized lab target.
Record what you ran, what you observed, and any follow-up (filter, report, remediation).

Help & manual (like man / --help)

Every serious tool has a built-in way to look up flags. Learn these first so you are not stuck memorizing every option.

1. Docs
```
https://www.promptfoo.dev/docs/
```
2. Help
```
promptfoo --help
```

Kali Linux

npm install -g promptfoo

1. Installation

OS	Installation
`Kali Linux`	npm install -g promptfoo
`npm`	npm install -g promptfoo

2. Basic commands

1. Evaluate guardrails on lab prompts
```
promptfoo eval
```
Evaluate guardrails on lab prompts
2. Show help
```
promptfoo --help
```
List flags for your installed version (same habit as man/--help).
3. Short help
```
promptfoo -h
```
Alternate help flag when supported.

5. Useful features

YAML configs
CI

6. Practical examples

Example 1: Evaluate guardrails on lab prompts
```
promptfoo eval
```
Evaluate guardrails on lab prompts
Example 2: Show help
```
promptfoo --help
```
List flags for your installed version (same habit as man/--help).
Example 3: Short help
```
promptfoo -h
```
Alternate help flag when supported.

7. Important notes

Continuous LLM safety eval.
Authorized targets only — labs, systems you own, or written permission.
Prefer reading --help / man / official docs for your installed version; flags change over time.

Related course: ai security · web application security · Commands: /commands