Jon Chery
9897df04b2
The prior VERIFY stage was diff-scoped: it checked the phase diff only
and never re-ran underlying platform capability. This structural defect
(D-091) let 8 NFR-patch phases (v1.9.1-v1.9.8, deck rework) pass VERIFY
while the platform they described decayed underneath.
Phase 52 remediation:
- core/regression_verify.py: regression-class VERIFY with 10 seeded
local-tier capability checks (CAP-001..CAP-010). Tags each
Verified/Decayed/Broken; fails closed on any non-Verified.
- scripts/run_regression.sh: shell wrapper; writes
.ciagent/REGRESSION_REPORT.{md,json}; exits non-zero on decay.
- tests/test_verify_regression_mode.py: 11 tests (8 fast + 3 slow).
Confirms the gate catches decay (fails closed) and that regression
mode is additive (diff-scoped VERIFY behavior preserved).
- pyproject.toml: slow marker registered; run_ci.sh excludes slow
tests to avoid recursion.
Verified: 502 fast tests pass (was 493 at v1.9; +9 new). 3 slow
integration tests pass. run_regression.sh reports all 10 seeded
local-tier capabilities Verified against current code. The
decay-surfacing test injects a broken cloud-backed check and confirms
the run tags it Broken and fails closed.
Cloud-backed capability re-verification (live ECS, DynamoDB writes,
Lambda invocation) lands in Phase 54 (D-093).
---ci---
project: acdl
phase: 52
milestone: v1.10
status: verify
requirements:
covered: [REQ-112]
partial: []
decisions: [D-091]
regression:
- { capability: CAP-001, status: Verified }
- { capability: CAP-002, status: Verified }
- { capability: CAP-003, status: Verified }
- { capability: CAP-004, status: Verified }
- { capability: CAP-005, status: Verified }
- { capability: CAP-006, status: Verified }
- { capability: CAP-007, status: Verified }
- { capability: CAP-008, status: Verified }
- { capability: CAP-009, status: Verified }
- { capability: CAP-010, status: Verified }
---/ci---
36 lines
1.1 KiB
Bash
Executable File
36 lines
1.1 KiB
Bash
Executable File
#!/usr/bin/env bash
|
|
# scripts/run_regression.sh - regression-class VERIFY (D-091).
|
|
#
|
|
# Re-runs capability checks against the current codebase and tags each
|
|
# capability Verified / Decayed / Broken. Fails closed: any non-Verified
|
|
# capability blocks milestone completion.
|
|
#
|
|
# Usage:
|
|
# bash scripts/run_regression.sh # run all checks
|
|
# ACDL_REGRESSION_MILESTONE=v1.10 ACDL_REGRESSION_PHASE=52 \
|
|
# bash scripts/run_regression.sh # override metadata
|
|
#
|
|
# Output:
|
|
# .ciagent/REGRESSION_REPORT.md human-readable report
|
|
# .ciagent/REGRESSION_REPORT.json machine-readable report
|
|
set -euo pipefail
|
|
ROOT="$(cd "$(dirname "${BASH_SOURCE[0]}")/.." && pwd)"
|
|
cd "$ROOT"
|
|
|
|
echo "=== ACDL Regression VERIFY (D-091) ==="
|
|
echo "milestone: ${ACDL_REGRESSION_MILESTONE:-v1.10} phase: ${ACDL_REGRESSION_PHASE:-52}"
|
|
echo ""
|
|
|
|
python3 core/regression_verify.py
|
|
status=$?
|
|
|
|
if [ "$status" = "0" ]; then
|
|
echo ""
|
|
echo "=== REGRESSION PASS ==="
|
|
echo "all capabilities Verified; milestone gate open"
|
|
else
|
|
echo ""
|
|
echo "=== REGRESSION FAIL ==="
|
|
echo "non-Verified capabilities surfaced; milestone gate blocks" >&2
|
|
fi
|
|
exit "$status" |