Skip to content

ci: run the nav.json portal tests - #467

Merged
WasifIsrar merged 1 commit into
devfrom
ci/portal-tests-nav
Nov 4, 2026
Merged

WasifIsrar merged 1 commit into
devfrom
ci/portal-tests-nav

Conversation

@razazarif

Copy link
Copy Markdown
Contributor

Closes apimatic/v4-test-automation#23

Adds the nav.json step from v4-test-automation to portal_tests.yml, after visual:

- name: visual — nav.json
  if: ${{ !cancelled() }}
  working-directory: tests
  env:
    PLAYWRIGHT_BROWSERS_PATH: ${{ github.workspace }}\.playwright-browsers
  run: pnpm test:nav:visual
  • For each nav.json layout in the QA RTM, it generates a copy of the suite's petstore build with this commit's CLI. It then checks the tab bar, the sidebar and the routes, and compares them against baselines (38 tests).
  • It runs 3 scenarios at once, and each serves on its own port (8090–8092). So it doesn't depend on the generate step or its server, and runs even if they failed.
  • In the test repo's CI this takes ~4.5–5.5 min. It adds that to this job (~11 min today), which keeps it well inside the 45-min timeout.

🤖 Generated with Claude Code

Adds the v4-test-automation nav.json step (pnpm test:nav:visual) after
the visual step. Each scenario generates its own petstore copy with this
build of the CLI, three at a time, and checks the tab bar and sidebar
against baselines. Adds ~5 min to the job.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@sonarqubecloud

sonarqubecloud Bot commented Nov 4, 2026

Copy link
Copy Markdown

@razazarif
razazarif requested a review from WasifIsrar November 4, 2026 06:05
@WasifIsrar
WasifIsrar merged commit 642e211 into dev Nov 4, 2026
17 of 18 checks passed
@asadali214 asadali214 mentioned this pull request Nov 4, 2026
@github-actions

github-actions Bot commented Nov 4, 2026

Copy link
Copy Markdown
Contributor

🎉 This PR is included in version 2.2.0-beta.1 🎉

The release is available on:

Your semantic-release bot 📦🚀

@github-actions

github-actions Bot commented Nov 5, 2026

Copy link
Copy Markdown
Contributor

🎉 This PR is included in version 2.2.0 🎉

The release is available on:

Your semantic-release bot 📦🚀

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add Nav Step in CLI Workflow

2 participants