garak

LLM vulnerability scanner – probes security flaws in AI models

garak is the "nmap for LLMs" – a vulnerability scanner built specifically for large language models, developed by NVIDIA. Tests for hallucination, data leakage, prompt injection, jailbreak, toxicit...