Skip to content

ci: test files in parallel; one Chrome job per compiler - #61

Merged
gmpassos merged 4 commits into
masterfrom
ci/faster-tests
Oct 20, 2026
Merged

gmpassos merged 4 commits into
masterfrom
ci/faster-tests

Conversation

@gmpassos

Copy link
Copy Markdown
Contributor

Why

CI took ~10–11 min, almost all of it test_chrome: the Wasm run (~4.2 min) and then the JS run with coverage (~5.6 min), one after the other in one job, each running the test files one at a time (concurrency: 1 in dart_test.yaml, from 2020, no reason recorded). build (~30s) and test_vm (~1 min) were never the bottleneck.

Changes

  • dart_test.yaml: drop concurrency: 1. dart test defaults to half the processors; each browser suite runs in its own frame.
  • dart.yml:
    • test_chrome is a matrix (dart2wasm, dart2js), fail-fast: false, so both compilers run in parallel and one failure doesn't cancel the other. Coverage is still collected from the dart2js run and uploaded only there.
    • --concurrency=4 (GitHub's Linux runners have 4 vCPUs) for the Chrome and VM runs.
    • test_chrome timeout 30 → 20 min.
  • No required status checks on master, so the renamed jobs (test_chrome (dart2wasm), test_chrome (dart2js)) block nothing.

Measured locally (all 561 browser tests passing each run)

Run One file at a time Parallel
Chrome Wasm 2:10 0:35 (-j 4, 3 runs: 0:35–0:38)
Chrome JS + coverage — 1:01 (-j 4)
Chrome JS — 0:34 (-j 8)
Both compilers (default -j) ~4:30 1:19
VM 0:20 0:19

This PR's own CI run gives the real numbers on the runners.

No version bump: CI and test configuration only, nothing in the published package's behavior changes.

🤖 Generated with Claude Code

- `dart_test.yaml`: no `concurrency: 1` (test files ran one at a time);
  the browser suites run each in its own frame and pass in parallel.
- CI: `--concurrency=4` (the runner's vCPUs), and `test_chrome` as a
  matrix (dart2wasm, dart2js) running in parallel instead of one after
  the other; the coverage from the dart2js job, as before.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@codecov

codecov Bot commented Oct 19, 2026 •

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 93.05%. Comparing base (ab42e6b) to head (11f80fc).

Additional details and impacted files
@@            Coverage Diff             @@
##           master      #61      +/-   ##
==========================================
+ Coverage   93.02%   93.05%   +0.03%     
==========================================
  Files          34       34              
  Lines        9537     9537              
==========================================
+ Hits         8872     8875       +3     
+ Misses        665      662       -3     
Flag Coverage Δ
unittests 93.05% <ø> (+0.03%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

gmpassos and others added 2 commits October 19, 2026 18:28
- `test_chrome`: a matrix of compiler (dart2wasm, dart2js) x 3 shards of
  the test files (picked round-robin by name at run time: new test files
  are included), all in parallel; most of the time is compiling each test
  file.
- dart2wasm shards run 4 test files at a time. dart2js shards, collecting
  the coverage, run one at a time: run in parallel, the coverage missed
  32 lines run asynchronously after a test file's tests (async contents,
  loadings, calendar events...), the -0.09% codecov/project reported.
- Each dart2js shard uploads its coverage; `.codecov.yml` makes Codecov
  wait for the 3 uploads (`after_n_builds`) before reporting.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
In parallel on the runner's 4 vCPUs, timing tests failed in the
dart2wasm shards (timers late: UIComponentAsync auto refresh, a removed
UIMultiSelection's cancelled selection). The parallelism is the 6 jobs.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@gmpassos
gmpassos merged commit 68e5ba5 into master Oct 20, 2026
10 checks passed
@gmpassos
gmpassos deleted the ci/faster-tests branch October 20, 2026 04:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant