Skip to content

Conversation

iankhou
Copy link
Contributor

@iankhou iankhou commented Oct 2, 2025

Problem

E2E tests are flaky due to unreliable network. Some retries that are implemented are not effective.

Recent intermittent E2E test failures:

Changes

Removed ineffective retries. Added retry for E2E Notices tests that have recently failed on ephemeral reasons.

Implemented retries for deployment and sandbox tests at the action level.

Validation

Workflows running on this PR, with label run-e2e.

Checklist

  • If this PR includes a functional change to the runtime behavior of the code, I have added or updated automated test coverage for this change.
  • If this PR requires a change to the Project Architecture README, I have included that update in this PR.
  • If this PR requires a docs update, I have linked to that docs PR above.
  • If this PR modifies E2E tests, makes changes to resource provisioning, or makes SDK calls, I have run the PR checks with the run-e2e label set.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Copy link

changeset-bot bot commented Oct 2, 2025

⚠️ No Changeset found

Latest commit: 14274e1

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@iankhou iankhou added the run-e2e Label that will include e2e tests in PR checks workflow label Oct 2, 2025
@iankhou iankhou closed this Oct 2, 2025
@iankhou iankhou reopened this Oct 2, 2025
@iankhou iankhou marked this pull request as ready for review October 2, 2025 16:35
@iankhou iankhou requested a review from a team as a code owner October 2, 2025 16:35
shell: bash
command: |
# This step will be handled by the composite action below
echo "Preparing to run e2e package manager tests with retry..."
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we might want to keep the logs

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Will do, I've put them back

Comment on lines 500 to 507
# Setup node and restore cache
echo "Setting up Node.js and restoring cache..."
# Run the e2e deployment tests using the action
echo "Running e2e deployment tests..."
# This will be handled by the composite action call below
exit 0
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

keep

Comment on lines -569 to -571
# This step will be handled by the composite action below
echo "Preparing to run e2e sandbox tests with retry..."
exit 0
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

keep

@iankhou iankhou merged commit 5209a7c into main Oct 2, 2025
102 of 103 checks passed
@iankhou iankhou deleted the iankhou-e2e-retry branch October 2, 2025 19:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

run-e2e Label that will include e2e tests in PR checks workflow

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants