AI Security Tools & Resources

Curated collection of tools, frameworks, and resources for AI/ML security

Vulnerability Scanners

Nuclei

17.2k

Fast vulnerability scanner with AI/LLM security templates

TemplatesAutomationCI/CD

Semgrep

9.8k

Static analysis tool with rules for AI/ML security

SASTCode AnalysisCustom Rules

Trivy

21.3k

Container and IaC scanner for AI model deployments

ContainerKubernetesSupply Chain

LLM Security Tools

Garak

1.2k

LLM vulnerability scanner and red teaming framework

LLM TestingRed TeamAutomation

LLM Guard

890

Security toolkit for LLM applications

Input ValidationOutput FilteringPII Detection

NeMo Guardrails

3.4k

NVIDIA toolkit for building safe LLM applications

Safety RailsNVIDIAEnterprise

Langfuse

4.1k

LLM observability and security monitoring

MonitoringTracingAnalytics

Adversarial Testing

TextAttack

2.8k

Framework for adversarial attacks on NLP models

NLPAdversarialResearch

Adversarial Robustness Toolbox

4.5k

IBM library for ML security

IBMDefenseAttack

CleverHans

6.1k

Library for adversarial example generation

TensorFlowPyTorchJAX

Foolbox

2.6k

Python toolbox for adversarial attacks

Multi-frameworkResearchBenchmarking

Privacy & Data Protection

Presidio

3.2k

Microsoft data protection and PII detection

PIIMicrosoftAnonymization

Private AI

N/A

PII detection and redaction API

APIEnterpriseCompliance

Opacus

1.6k

Differential privacy library for PyTorch

Differential PrivacyPyTorchMeta

TensorFlow Privacy

1.9k

Privacy-preserving machine learning

TensorFlowGoogleDP-SGD

Model Security

ModelScan

450

Security scanner for ML model files

Model ScanningMalware DetectionCI/CD

AI Verify

320

Singapore AI governance testing framework

GovernanceTestingCompliance

MLflow

17.8k

ML lifecycle platform with security features

MLOpsTrackingDeployment

Weights & Biases

8.4k

ML experiment tracking and model registry

MonitoringVersioningCollaboration

Supply Chain Security

Sigstore

2.1k

Signing and verification for software supply chain

SigningSLSAOpenSSF

SLSA

1.5k

Supply chain security framework

FrameworkGoogleStandards

In-toto

850

Supply chain security for software

AttestationCNCFProvenance

Syft

5.7k

SBOM generation for containers and filesystems

SBOMContainerDependencies

Additional Resources

Documentation

OWASP Top 10 for LLM Applications

Comprehensive guide to the most critical security risks in LLM applications

Visit Resource
Framework

MITRE ATLAS

Adversarial threat landscape for AI systems

Visit Resource
Standard

NIST AI Risk Management Framework

Comprehensive framework for managing AI risks

Visit Resource
Database

AI Incident Database

Repository of AI failures and incidents

Visit Resource
Platform

Hugging Face Model Security

Security scanning for Hugging Face models

Visit Resource
Framework

Google Secure AI Framework

Google approach to securing AI systems

Visit Resource