psiinon/open-source-llm-scannersCurated list of open-source LLM security scanners and web app scanners, ordered by stars, for finding vulnerabilities in AI applications.
A list of open source LLM security scanners on GitHub, ordered by Stars. It does not provide in-depth analysis. A minimum of 10 stars are needed as a low bar 😁
Related: open-source-web-scanners
Tools which can find a range of vulnerabilities in LLM applications.
| Main Site | Last Commit | Committers | Stars |
|---|
| Promptfoo |  |  |  |
| garak |  |  |  |
| Giskard |  |  |  |
| Purple Llama |  |  |  |
| PyRIT |  |  |  |
| Agentic Security |  |  |  |
| Promptmap2 |  |  |  |
| FuzzyAI |  |  |  |
| Agentic Radar |  |  |  |
| EasyJailbreak |  |  |  |
| Vigil |  |  |  |
| LLMFuzzer |  |  |  |
| LLaMator |  |  |  |
| Whistleblower |  |  |  |
| mcp-checkpoint |  |  |  |
| hackagent |  |  |  |
Tools which use LLMs to find a range of vulnerabilities in web applications.
PR's welcomed.
Template line for GitHub projects (replace USER_REPO):
| []() | [](https://github.com/USER_REPO/commits) | [](https://github.com/USER_REPO/graphs/contributors) | [](https://github.com/USER_REPO/stargazers) |
Template line for GitLab projects (replace USER_REPO):
| []() | [](https://gitlab.com/USER_REPO/-/commits/master) | [](https://gitlab.com/USER_REPO/-/graphs/master) | [](https://gitlab.com/USER_REPO/-/starrers) |
| FAAST |  |  |  |