dTechMediaCreations/advanced-artifactual-intelligence-security-agent
2
0
Fork 0
Code Issues 6 Pull Requests Actions Packages Projects Releases 1 Wiki Activity

Add reproducible evaluation and provenance research

Browse Source
This commit is contained in:
duaneAI
2026-09-17 10:40:29 -05:00
parent d9fc3ca18b
commit 68f02d035f
53 changed files with 1432 additions and 14 deletions
Download Patch File Download Diff File Expand all files Collapse all files
RESEARCH_BRIEF.md
+1 -1
View File
@@ -93,7 +93,7 @@ Future active or probabilistic capabilities require a separate design review, ex
**Milestone 1 Foundation:** stable CLI, artifact model, built-in rules, JSON and SARIF reporting, tests, threat model, and contribution standards.
**Milestone 2 Evaluation harness:** versioned benchmark format, corpus digests, per-rule metrics, performance measurements, and regression thresholds.
**Milestone 2 Evaluation harness:** versioned benchmark format, corpus digests, per-rule metrics, performance measurements, and regression thresholds. The first deterministic conformance corpus and TP/FP/FN evaluator are implemented; representative benchmark collection and performance thresholds remain open research work.
**Milestone 3 Artifact expansion:** structured parsers for model cards, dataset manifests, agent tool definitions, SBOM formats, and selected deployment descriptors.