Commit Graph

2 Commits

Author SHA1 Message Date
Jon Chery 51b886f3f6 feat(P03 W2): outcome backfill (REQ-317) + escalation_reason (REQ-318)
REQ-317: core/metrics/outcome_backfill.py backfills fact_decision.outcome
pending -> succeeded/failed after run.completed/run.failed; idempotent +
terminal (does not overwrite a non-pending outcome); wired into the
collector. The Post-Pilot AI Decision Accuracy denominator is now grounded
(fact_decision.outcome is not stuck pending).

REQ-318: ai.decision.made on a block band carries escalation_reason:
'confidence' (the only value in v1.26 — a block is always confidence-
driven; future milestones may add 'policy'). Persisted into fact_run by
the collector. The Post-Pilot Human Escalation Frequency denominator is
now grounded.

---ci---
project: acdl
phase: 3
milestone: v1.26
status: execute
wave: W2
---
2026-08-18 22:14:03 +00:00
Jon Chery 18b03db272 feat(P2): metrics collector — SQLite cold store + Decision Ledger CLI (REQ-189,200,201,207)
P2 (Wave 2, feat) — REQ-189, REQ-200, REQ-201, REQ-207

New components:
- core/metrics/collector.py — reads all grounded signals (REGRESSION_REPORT.json,
  per-run manifests, junit XML, coverage.json, decision ledger, lifecycle reports)
  → SQLite cold store (metrics/nova_metrics.db) with fact_run, fact_capability,
  fact_policy_check, fact_confidence, fact_test, fact_decision, fact_cost_estimate,
  fact_lifecycle, dim_capability, dim_milestone tables
- core/metrics/decision_ledger_cli.py — CLI with query/verify-chain/stats/export/replay
- tests/test_metrics_collector.py — 7 tests (all pass, incl. idempotent re-run REQ-200)

D-120: Nova-native (SQLite, no ClickHouse)
D-125: hybrid (reads files + events → SQLite)
D-126: cold-only (no hot path)

---ci---
project: acdl
phase: 2
milestone: v1.17
status: execute
---/ci---
2026-08-04 20:01:50 +00:00