Skip to content

feat(vindex/hammer): add conformance and load-testing hammer - #195

Open
mhutchinson wants to merge 1 commit into
transparency-dev:mainfrom
mhutchinson:vindex/hammer
Open

mhutchinson wants to merge 1 commit into
transparency-dev:mainfrom
mhutchinson:vindex/hammer

Conversation

@mhutchinson

Copy link
Copy Markdown
Contributor

Summary

Adds the implementation-agnostic c2sp.org/tlog-vindex conformance checker and performance benchmark harness (vindex/cmd/hammer and vindex/internal/hammer), along with updated design requirements in vindex/internal/hammer/README.md and vindex/docs/ARCHITECTURE.md.

Key Capabilities

  • Zero Target Coupling: Operates strictly across standard HTTP tlog-tiles and tlog-vindex wire surfaces (<index-url>/keys, <index-url>/values, and optional <output-log-url> tiles/checkpoints), allowing external third-party tlog-vindex implementations in any language or storage engine to benchmark throughput, tail latency, catch-up speed, and spec conformance.
  • Pure-Go Reference MapFn Oracle: Evaluates raw, sumdb, and ct mapping functions natively in pure Go using standard library parsers (with zero WebAssembly coupling inside the hammer), recording exact ground-truth (key -> entry_indices) mappings and sequenced (input-size, input-root) states before exposing checkpoints on /checkpoint.
  • Bidirectional Accuracy & Input-State Verification: Detects omitted keys (false negatives that serve valid MPT non-inclusion proofs over an incomplete trie), phantom keys, altered entry indices across full and bounded /values pages, prefix key-set mismatches, and forged or inconsistent input-root commitments.
  • Protocol & Tile Conformance Probes: Exercises RFC 3986 percent-encoding edge cases (+, =, &, !, *, ~), mandatory 400/404/503 HTTP status-code rules, and optional <output-log-url> tlog-tiles checkpoint consistency and entry-bundle authentication.

- Document implementation-agnostic C2SP tlog-vindex conformance and pure-Go mapping oracle requirements in vindex/internal/hammer/README.md and ARCHITECTURE.md.
- Implement pure-Go reference MapFn profiles (raw, sumdb, ct) and an exact ground-truth key/index and input-root Oracle without WebAssembly coupling.
- Add Tessera POSIX Input Log sequencer, drip-feed HTTP server, concurrent verifying reader pool, negative HTTP status conformance probes (400/404/503), and optional Output Log tlog-tiles verifier.
- Add differential pure-Go vs WASM equivalence tests, adversarial conformance tests, multi-profile E2E suites, and b.Loop() benchmarks.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants