Files
Anthropic-Cybersecurity-Skills/tools
Mahipal a81b233649 ci: add description-quality and collision gates
The description is the only signal an agent sees at discovery time, so
overlapping descriptions cause misrouting. Nothing in CI checked for that.

- tools/lint-descriptions.py enforces name==folder, description <=1024
  chars, terminal punctuation (a truncation canary), a trigger clause, a
  negative trigger, and a 500-line body cap. Pre-existing failures are
  grandfathered in tools/lint-baseline.json so this blocks new debt only;
  the baseline may shrink and never grow.
- tools/detect-collisions.py scores every description pair by TF-IDF
  cosine and ratchets the count of unreviewed near-duplicates. It strips
  negative-trigger clauses before vectorizing: those name the sibling
  skill on purpose, so scoring them would make correct disambiguation
  raise a pair's similarity.
- wire both into validate-skills.yml, along with agentskills conformance,
  an index.json freshness check, and a guard that fails the build if a
  regex frontmatter parser is reintroduced.
- broaden the path filters from tools/validate-skill.py to tools/**, as
  noted when #105 merged.

All five gates verified to fail on deliberately broken input.
2026-08-23 17:15:12 +02:00
..

Skill Validation Tools

validate-skill.py

Validate SKILL.md metadata before submitting a PR.

Usage

# Validate a single skill
python tools/validate-skill.py skills/my-new-skill/

# Validate all skills
python tools/validate-skill.py --all

What it checks

  • SKILL.md exists in the skill directory
  • Valid YAML frontmatter (between --- markers)
  • Required fields present: name, description, domain, subdomain, tags
  • Name is kebab-case, 164 characters
  • Description is at least 50 characters (no upper limit; multi-line folded scalars are valid)
  • Domain is cybersecurity
  • Subdomain is from the allowed list
  • Tags is a list with at least 2 items

Requirements

Python 3.8+ (stdlib only, no external dependencies)