-
Notifications
You must be signed in to change notification settings - Fork 101
feat: retry e2e tests at the action level #3012
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
shell: bash | ||
command: | | ||
# This step will be handled by the composite action below | ||
echo "Preparing to run e2e package manager tests with retry..." |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think we might want to keep the logs
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Will do, I've put them back
# Setup node and restore cache | ||
echo "Setting up Node.js and restoring cache..." | ||
# Run the e2e deployment tests using the action | ||
echo "Running e2e deployment tests..." | ||
# This will be handled by the composite action call below | ||
exit 0 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
keep
# This step will be handled by the composite action below | ||
echo "Preparing to run e2e sandbox tests with retry..." | ||
exit 0 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
keep
Problem
E2E tests are flaky due to unreliable network. Some retries that are implemented are not effective.
Recent intermittent E2E test failures:
Changes
Removed ineffective retries. Added retry for E2E Notices tests that have recently failed on ephemeral reasons.
Implemented retries for deployment and sandbox tests at the action level.
Validation
Workflows running on this PR, with label
run-e2e
.Checklist
run-e2e
label set.By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.