Build · Prototype
Detector Coverage Atlas
Secret-scanning tools name, categorize, detect, and verify the same credentials differently — so coverage questions stay tribal.
Career signal: Product Strategy, Technical Product Management, Product GTM
All projects1. Problem
Secret-scanning tools name, categorize, detect, and verify the same credentials differently — so coverage questions stay tribal.
Teams cannot answer which providers are covered, whether two detectors are equivalent, whether a finding can be verified, or what changed, without overstating the evidence.
Without this: Competitive slides invent gaps. Unreviewed cells get treated as “unsupported.” Onboarding depends on whoever last read the detector source.
2. Users
Primary: Security researcher / AppSec engineer who needs evidence-backed coverage and verification status
Secondary: PM, SA, AE, and CS who must explain coverage without overstating it
Job: Answer a detector-coverage question with provenance, confidence, and a path to the source.
3. Evidence
Independent research against public TruffleHog: a source parser observed 910 detector records (Sept 2026), with 14 fully enriched and ready to render. Nested folders (github/v1, aws/access_keys) were being dropped until that bug was fixed. Validity-check detection is heuristic — GitHub and GitLab verification delegated to helpers are known false negatives. This is a public research catalog, not an official Truffle Security product.
4. Goals and non-goals
Goals
- Preserve source names and pin every import to a commit SHA.
- Normalize to canonical secret types without deleting source terminology.
- Label cells documented, observed, unknown, not evaluated, or needs review — never treat gray as a confirmed gap.
- Keep detection (`detectors`) separate from credential-capability analysis (`analyzer`).
Non-goals
- A production scanner or continuous customer-monitoring product.
- CodeQL, dependency scanning, or general vuln scanning.
- Real secrets, live credential verification, or internal Truffle code/data.
- Filling Betterleaks or Kingfisher columns before their public rule files are reviewed.
- Treating how-to-rotate docs as detector-coverage evidence.
5. MVP
Catalog foundation: schema, TruffleHog ingestion, 14 reviewed starter detectors, searchable comparison with explicit uncertainty.
Question the MVP tests: Can fragmented public detector information become a reliable, evidence-backed product before we add more sources or automation?
6. Workflow
- Ingest public repos and docs at a pinned commit
- Normalize without overwriting source names
- Enrich with evidence level and review status
- Compare across tools
- Queue parser uncertainty for human review
7. System design
Plain language
- Public GitHub + provider docs
- Ingestion
- Normalization
- Evidence + confidence
- Searchable UI
- Scheduled change detection
- Human review queue
Technical
- Octokit (commit-pinned reads)
- Provider-specific parsers
- Postgres + Drizzle (next)
- Vercel Cron snapshots (next)
- shadcn data table
- Comparison matrix
8. Data model
- DetectorRecord
- DetectorEquivalenceGroup
- CoverageMatrixCell
- IngestionRun
- Verification profile
- ValueNarrative
- RotationGuide
- Review item
9. Metrics
Operational
- 910 TruffleHog records parsed; 14 enriched
- Normalization rate and evidence completeness
- Stale-record and parser false-negative rate
Behavioral
- Review-queue resolution
- Reuse in onboarding and competitive prep
Business
- Hypothesis: fewer unsupported product claims and faster coverage answers than manual repo research
10. Business impact hypothesis
If coverage is evidence-based and reviewable, product and field decisions get faster and claims get safer. No invented revenue. Missing public docs is not a confirmed gap.
11. Tradeoffs
- Parser complexity vs. a human review queue for ~30 “no verifier” flags.
- Breadth of providers vs. depth of evidence — TruffleHog first.
- Scheduled snapshots vs. real-time crawling.
- Computed comparison views vs. stored matrix rows.
12. Prototype
Phase 1 in progress: parser tested on the real public TruffleHog repo; 14 enriched detectors ready for the Next.js table. Independent/unofficial. Separate from Truffle Camp (secretsafari) and from any company-owned Atlas.
Intended value
- Faster technical research
- More accurate competitive analysis
- Fewer unsupported product claims
- Quicker onboarding
- Stronger product and field decisions
13. What I would build next
- Detector detail with verification profiles and conditional risk language.
- Betterleaks and Kingfisher only after rule-file review; GitGuardian and GitHub Secret Scanning stay manual-doc.
- Commit snapshots, diffs, and a review queue.
- Five to ten representative questions against the UI to pick the next phase — not every planned screen.