Skip to content

results: AIOpsLab audit with its proposed fix, ITBench library audit, agent study, SREGym HEAD alert baseline, and k8s-ai-bench repeats and cross-task check - #33

Merged
TheDeadcoder merged 2 commits into
mainfrom
results/audits-and-agents
Oct 16, 2026
Merged

TheDeadcoder merged 2 commits into
mainfrom
results/audits-and-agents

Conversation

@TheDeadcoder

Copy link
Copy Markdown
Owner

Adds the results of the studies merged in #27 to #32, with dates and clock times scrubbed.

  • AIOpsLab audit: runs/ (first attempts and repeats), runs-patched/ with the proposed fix, pilot/, and their
    ledgers.
  • ITBench library audit: runs/, pilot/ and the ledger.
  • Agent study: the Claude Code runs under runs/, the smaller model's runs under runs-haiku/, pilot/, and both
    ledgers.
  • SREGym HEAD alert baseline: runs-head/ and ledger-head.json.
  • k8s-ai-bench: the 15 repeated episodes and the cross-task check under interference/. The ledger now scores first
    attempts on their own. All 15 repeats got the same label as their first attempt.

It also widens the scrubber so it removes clock times and dates that follow an escaped newline, as in the agents'
JSON transcripts. No committed file changes under the new patterns.

Four agent episodes hit the plan's usage limit and were run again. The set-aside copies are not included.

Every study's tests pass, and every ledger's --check matches its runs.

… agent study, SREGym HEAD alert baseline, and k8s-ai-bench repeats and cross-task check
@TheDeadcoder
TheDeadcoder merged commit 2472ac6 into main Oct 16, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant