Skip to content

feat(FR-2562): expand e2e-healer to run full test suite and enable healing#6667

Draft
nowgnuesLee wants to merge 2 commits into04-14-feat_fr-2559_add_teams_notification_jira_integration_and_result_parsing_to_e2e-watchdogfrom
04-14-feat_fr-2562_expand_e2e-healer_to_run_full_test_suite_and_enable_healing
Draft

feat(FR-2562): expand e2e-healer to run full test suite and enable healing#6667
nowgnuesLee wants to merge 2 commits into04-14-feat_fr-2559_add_teams_notification_jira_integration_and_result_parsing_to_e2e-watchdogfrom
04-14-feat_fr-2562_expand_e2e-healer_to_run_full_test_suite_and_enable_healing

Conversation

@nowgnuesLee
Copy link
Copy Markdown
Contributor

@nowgnuesLee nowgnuesLee commented Apr 14, 2026

Resolves #6659(FR-2559)

Summary

Expand the e2e-healer agentic workflow from running a single test file to the full E2E suite, and enable the automated healing phase.

Changes

  • Full test suite: Replace e2e/auth/login.spec.ts with e2e/ --grep-invert @visual (all non-visual tests)
  • Enable healing phase: Uncomment the previously disabled healing logic that:
    • Creates branch e2e-healer/<date>-<sha> from main
    • Uses Playwright planner to analyze and fix WebUI-caused failures
    • Opens draft PR with fix if tests pass, or adds diagnostic comment if not
  • Scope guard: Only attempts healing for WebUI-caused failures (skips Backend/Server issues)
  • Timeout increase: 120min → 180min to accommodate full suite + healing

Post-merge action required

.lock.yml must be recompiled after merge:

gh aw compile e2e-healer --strict

Test plan

  • Manual dispatch — verify full test suite runs (not just login.spec.ts)
  • On failure, verify healing phase activates and creates a draft PR
  • Verify timeout is sufficient for full suite + healing attempt
  • Verify Backend/Server failures are skipped by the healer (only WebUI fixes attempted)

🤖 Generated with Claude Code

Copy link
Copy Markdown
Contributor Author

nowgnuesLee commented Apr 14, 2026

Warning

This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more


How to use the Graphite Merge Queue

Add either label to this PR to merge it via the merge queue:

  • flow:merge-queue - adds this PR to the back of the merge queue
  • flow:hotfix - for urgent changes, fast-track this PR to the front of the merge queue

You must have a Graphite account in order to use the merge queue. Sign up using this link.

An organization admin has required the Graphite Merge Queue in this repository.

Please do not merge from GitHub as this will restart CI on PRs being processed by the merge queue.

This stack of pull requests is managed by Graphite. Learn more about stacking.

…aling

Changes to e2e-healer.md:
- Replace single-file test (login.spec.ts) with full E2E suite
  (--grep-invert @visual) as originally intended
- Enable the healing phase (previously commented out) that:
  - Creates branch e2e-healer/<date>-<sha> from main
  - Uses Playwright planner to analyze and fix failures
  - Opens draft PR with fix if tests pass
  - Adds diagnostic comment if fix fails
- Only attempts healing for WebUI-caused failures (not Backend/Server)
- Increase timeout from 120 to 180 minutes for full suite + healing

Note: .lock.yml recompilation required via `gh aw compile` after merge.

Resolves FR-2562
…ling phase

Manually patch e2e-healer.lock.yml (cannot recompile with gh-aw v0.68.1
due to secrets pattern incompatibility):
- Run full E2E suite (e2e/ --grep-invert @visual) instead of login.spec.ts
- Enable healing phase with full instructions in agent prompt
- Increase agent timeout from 120 to 180 minutes

Resolves FR-2562
@nowgnuesLee nowgnuesLee force-pushed the 04-14-feat_fr-2562_expand_e2e-healer_to_run_full_test_suite_and_enable_healing branch from d97977b to 0edc6ba Compare April 14, 2026 06:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size:M 30~100 LoC

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant