Skip to content

Expose volatile ingest buffers and delivery outcomes - #94

Merged
mzupan merged 2 commits into
mainfrom
codex/ingest-batch-health
Nov 15, 2026
Merged

mzupan merged 2 commits into
mainfrom
codex/ingest-batch-health

Conversation

@mzupan

@mzupan mzupan commented Nov 15, 2026

Copy link
Copy Markdown
Contributor

Accepted ingest rows can remain in the in-memory batcher while ClickHouse or the durable spool is unavailable. Add per-table pending rows/bytes/age and blocked-flush gauges, plus delivery outcomes, rows, latency and insert failures. A separate atomic sampler keeps backlog age visible while a flush holds its mutex; cancelled attempts do not count as successful delivery.

Validation: 15 writer tests passed, including failed flush/recovery and cancellation metrics; full library suite passed (787 passed, 14 integration tests ignored). cargo fmt --check and cargo clippy --all-targets passed. Strict clippy -D warnings remains blocked by existing repository warnings. Labels are fixed table/outcome values; no tenant identifiers are emitted.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant