Skip to content

Expose failed rule evaluations and standalone engine health - #97

Merged
mzupan merged 1 commit into
mainfrom
codex/engine-evaluation-health
Nov 15, 2026
Merged

mzupan merged 1 commit into
mainfrom
codex/engine-evaluation-health

Conversation

@mzupan

@mzupan mzupan commented Nov 15, 2026 •

Copy link
Copy Markdown
Contributor

Stacked after #96. Merge in order #94, #95, #96, #97, #98, #99. This diff contains only this finding relative to its base.

Monitor and detection cycles could report success after individual evaluations failed or were rejected. Record per-evaluation success, no-data, errors, rejected admission and cancellation across monitors, detections, SLOs and anomalies. Add due/inflight gauges, duration and last-success timestamps; fail degraded monitor/detection/anomaly cycles while retaining their existing state and notification behavior. Anomaly evaluation-log persistence failures are also counted.

The standalone anomaly worker exports the shared registry and process metrics through GET /metrics on RUSH_WORKER_METRICS_ADDR (default 0.0.0.0:9090; explicitly empty disables). Only fixed engine/outcome labels are emitted, and cancelled work releases inflight gauges without advancing success.

Validation: engine-focused suite passed (67 passed, 2 isolated ClickHouse tests ignored), including new cancellation and bounded-label regressions; final engine-metrics tests passed. cargo fmt --check, git diff --check and cargo clippy --all-targets passed. Strict -D warnings remains blocked by existing warnings. The worker listener is shared with the replay-health change earlier in this stack.

@mzupan
mzupan force-pushed the codex/engine-evaluation-health branch from d0f02a4 to f116248 Compare November 15, 2026 22:45
@mzupan
mzupan merged commit 471c586 into main Nov 15, 2026
4 of 5 checks passed
@mzupan
mzupan deleted the codex/engine-evaluation-health branch November 15, 2026 22:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant