mirror of
https://github.com/mukul975/Anthropic-Cybersecurity-Skills.git
synced 2026-07-17 05:05:16 +03:00
mukul975
8cae0648ec
Demand-driven expansion targeting the fastest-growing 2025-2026 threat and
skills categories (ISC2/WEF/CrowdStrike/Mandiant signals):
- AI Security (NEW domain, 12 skills): LLM red-teaming with garak/PyRIT,
prompt injection (direct/indirect/RAG), MCP tool-poisoning, agentic tool
invocation, guardrails, model/data poisoning, system-prompt leakage,
embedding/vector weaknesses, model extraction, continuous red-teaming
- Supply Chain Security (NEW domain, 5 skills): SBOMs, dependency confusion,
malicious-npm triage, typosquatting, SLSA/Sigstore provenance
- Hardware & Firmware Security (NEW domain, 4 skills): CHIPSEC/UEFI audit,
Secure Boot bypass, TPM measured-boot attestation, ESP bootkit hunting
- Identity (10): Entra ID/ROADtools, GraphRunner, AADInternals, ADCS/Certipy,
shadow credentials, coercion, BloodHound CE, device-code phishing, SSO abuse
- Cloud-native (8): Stratus, Pacu, CloudFox, container escape, K8s RBAC,
Falco, Trivy, kube-bench
- Offensive C2 (6): Sliver, Havoc, NetExec, DPAPI, NTLM relay ESC8, redirectors
- DFIR (6): Hayabusa, Chainsaw, KAPE, Velociraptor, EZ Tools, Plaso
- Backfill (4): OpenCTI, MISP, honeytokens, post-quantum crypto migration
Each skill follows the repo taxonomy (SKILL.md + references/{standards,api-reference}.md
+ scripts/agent.py + LICENSE), with researched real tool commands (no placeholders),
complete frontmatter, and ATT&CK/ATLAS + NIST CSF mappings. Updates README domain
table, skill count, and index.json.
55 lines
2.1 KiB
Markdown
55 lines
2.1 KiB
Markdown
# Promptfoo / DeepTeam — Command & Config Reference
|
|
|
|
## Install
|
|
|
|
| Tool | Command |
|
|
|------|---------|
|
|
| Promptfoo (global) | `npm install -g promptfoo` |
|
|
| Promptfoo (no install) | `npx promptfoo@latest redteam run` |
|
|
| DeepTeam | `pip install -U deepteam` |
|
|
|
|
## Promptfoo Red-Team CLI
|
|
|
|
| Command | Purpose |
|
|
|---------|---------|
|
|
| `promptfoo redteam init` | Scaffold an interactive red-team config |
|
|
| `promptfoo redteam generate` | Generate adversarial test cases only |
|
|
| `promptfoo redteam run` | Generate + evaluate (combined) |
|
|
| `promptfoo redteam eval` | Evaluate existing generated tests |
|
|
| `promptfoo redteam report` | Open/export the results report |
|
|
| `promptfoo redteam plugins` | List available plugins |
|
|
| `promptfoo redteam strategies` | List available strategies |
|
|
|
|
Useful flags: `--no-progress-bar` (CI), `--output results.json`, `--filter-failing <file>`, `-c <config>`.
|
|
|
|
## Promptfoo Config Keys (`redteam:` block)
|
|
|
|
| Key | Purpose |
|
|
|-----|---------|
|
|
| `purpose` | Application description; grounds attack generation |
|
|
| `numTests` | Tests generated per plugin |
|
|
| `plugins` | Adversarial generators (e.g. `owasp:llm`, `owasp:agentic`, `pii:direct`, `prompt-extraction`, `harmful`) |
|
|
| `strategies` | Delivery techniques (`jailbreak`, `jailbreak:composite`, `crescendo`, `prompt-injection`) |
|
|
| `targets` | Endpoints/models under test |
|
|
|
|
## DeepTeam Python API
|
|
|
|
| Import | Purpose |
|
|
|--------|---------|
|
|
| `from deepteam import red_team` | Run a red-team assessment |
|
|
| `from deepteam.vulnerabilities import Bias, PIILeakage` | Vulnerability definitions (50+) |
|
|
| `from deepteam.attacks.single_turn import PromptInjection` | Single-turn attack methods |
|
|
| `red_team(model_callback=..., vulnerabilities=[...], attacks=[...])` | Execute the suite |
|
|
|
|
## DeepTeam CLI
|
|
|
|
| Command | Purpose |
|
|
|---------|---------|
|
|
| `deepteam run config.yaml` | Run red teaming from a YAML config |
|
|
|
|
## External References
|
|
|
|
- Promptfoo command line: https://www.promptfoo.dev/docs/usage/command-line/
|
|
- DeepTeam attacks: https://www.trydeepteam.com/docs/red-teaming-adversarial-attacks
|
|
- DeepTeam vulnerabilities: https://www.trydeepteam.com/docs/red-teaming-vulnerabilities
|