Promptfoo

CLI tool for prompt testing, model comparison, and LLM red-teaming/security scanning

Open-source CLI tool (8.3K+ ⭐) for developers to test and secure LLM apps. Configure via YAML, compare outputs side-by-side across multiple models (GPT, Claude, Gemini, Llama...). Built-in red-team...