dTechMediaCreations/advanced-artifactual-intelligence-security-agent
2
0
Fork 0
Code Issues 6 Pull Requests Actions Packages Projects Releases 1 Wiki Activity

Establish deterministic evaluation and provenance baseline #1

New Issue
Closed
opened 2026-09-17 15:42:21 +00:00 by duaneAI · 1 comment
duaneAI commented 2026-09-17 15:42:21 +00:00
Member
Copy Link
Copy Source

Implement a versioned corpus evaluator, rule catalog, report schemas, stable finding fingerprints, structured agent/provenance/ML-BOM rules, research note, wiki, and contributor documentation. The baseline must be local-only, reproducible, and explicit about statistical limitations.

Implement a versioned corpus evaluator, rule catalog, report schemas, stable finding fingerprints, structured agent/provenance/ML-BOM rules, research note, wiki, and contributor documentation. The baseline must be local-only, reproducible, and explicit about statistical limitations.
duaneAI added this to the Research Milestone 2 - Evaluation and Provenance milestone 2026-09-17 15:42:21 +00:00
duaneAI added the researchevaluationprovenanceagent-securitydocumentation labels 2026-09-17 15:42:21 +00:00
duaneAI commented 2026-09-17 15:42:22 +00:00
Author
Member
Copy Link
Copy Source

Implementation commit 68f02d035f7dbc1eea8af30a126164f6f6a55e10 adds 1,432 lines across 53 files. Verification: 25 unit tests pass; the 12-case corpus has zero mismatches; installed CLI, JSON, SARIF, and schema parse checks pass; the repository scan contains only eight intentional benchmark findings and zero errors.

Implementation commit `68f02d035f7dbc1eea8af30a126164f6f6a55e10` adds 1,432 lines across 53 files. Verification: 25 unit tests pass; the 12-case corpus has zero mismatches; installed CLI, JSON, SARIF, and schema parse checks pass; the repository scan contains only eight intentional benchmark findings and zero errors.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
agent-security
Agent tools, authorization, and trust boundaries
 benchmark
Corpora, fixtures, and performance measurement
 documentation
Research and contributor documentation
 evaluation
Evaluation harnesses, metrics, and reproducibility
 provenance
Artifact identity, attestations, and supply-chain evidence
 research
Research design or experimental work
No labels agent-security documentation evaluation provenance research
Milestone
No items
No Milestone Research Milestone 2 - Evaluation and Provenance
Projects
Clear projects
No projects
Assignees
Clear assignees
SysAdmin (dTech Administrator) duaneAI (duaneAI - AutoCode Model)
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: dTechMediaCreations/advanced-artifactual-intelligence-security-agent#1