Files
Anthropic-Cybersecurity-Skills/skills/continuous-llm-red-teaming-with-promptfoo/references/api-reference.md
T
mukul975 8cae0648ec Add 55 new skills across 3 new domains + 6 undercovered areas (762 -> 817)
Demand-driven expansion targeting the fastest-growing 2025-2026 threat and
skills categories (ISC2/WEF/CrowdStrike/Mandiant signals):

- AI Security (NEW domain, 12 skills): LLM red-teaming with garak/PyRIT,
  prompt injection (direct/indirect/RAG), MCP tool-poisoning, agentic tool
  invocation, guardrails, model/data poisoning, system-prompt leakage,
  embedding/vector weaknesses, model extraction, continuous red-teaming
- Supply Chain Security (NEW domain, 5 skills): SBOMs, dependency confusion,
  malicious-npm triage, typosquatting, SLSA/Sigstore provenance
- Hardware & Firmware Security (NEW domain, 4 skills): CHIPSEC/UEFI audit,
  Secure Boot bypass, TPM measured-boot attestation, ESP bootkit hunting
- Identity (10): Entra ID/ROADtools, GraphRunner, AADInternals, ADCS/Certipy,
  shadow credentials, coercion, BloodHound CE, device-code phishing, SSO abuse
- Cloud-native (8): Stratus, Pacu, CloudFox, container escape, K8s RBAC,
  Falco, Trivy, kube-bench
- Offensive C2 (6): Sliver, Havoc, NetExec, DPAPI, NTLM relay ESC8, redirectors
- DFIR (6): Hayabusa, Chainsaw, KAPE, Velociraptor, EZ Tools, Plaso
- Backfill (4): OpenCTI, MISP, honeytokens, post-quantum crypto migration

Each skill follows the repo taxonomy (SKILL.md + references/{standards,api-reference}.md
+ scripts/agent.py + LICENSE), with researched real tool commands (no placeholders),
complete frontmatter, and ATT&CK/ATLAS + NIST CSF mappings. Updates README domain
table, skill count, and index.json.
2026-06-22 19:08:16 +02:00

2.1 KiB

Promptfoo / DeepTeam — Command & Config Reference

Install

Tool Command
Promptfoo (global) npm install -g promptfoo
Promptfoo (no install) npx promptfoo@latest redteam run
DeepTeam pip install -U deepteam

Promptfoo Red-Team CLI

Command Purpose
promptfoo redteam init Scaffold an interactive red-team config
promptfoo redteam generate Generate adversarial test cases only
promptfoo redteam run Generate + evaluate (combined)
promptfoo redteam eval Evaluate existing generated tests
promptfoo redteam report Open/export the results report
promptfoo redteam plugins List available plugins
promptfoo redteam strategies List available strategies

Useful flags: --no-progress-bar (CI), --output results.json, --filter-failing <file>, -c <config>.

Promptfoo Config Keys (redteam: block)

Key Purpose
purpose Application description; grounds attack generation
numTests Tests generated per plugin
plugins Adversarial generators (e.g. owasp:llm, owasp:agentic, pii:direct, prompt-extraction, harmful)
strategies Delivery techniques (jailbreak, jailbreak:composite, crescendo, prompt-injection)
targets Endpoints/models under test

DeepTeam Python API

Import Purpose
from deepteam import red_team Run a red-team assessment
from deepteam.vulnerabilities import Bias, PIILeakage Vulnerability definitions (50+)
from deepteam.attacks.single_turn import PromptInjection Single-turn attack methods
red_team(model_callback=..., vulnerabilities=[...], attacks=[...]) Execute the suite

DeepTeam CLI

Command Purpose
deepteam run config.yaml Run red teaming from a YAML config

External References