Investigate, Identify, and Create Issues to Fix Flaky Tests in CI #3511
Description
Description of the task
Problem
There are many flaky tests in CI. When PRs are created, CI may fail due to these flaky tests, even if there is nothing wrong with the code added by the PR. An ongoing list of flaky tests is being tracked in our Notion page here.
Goal
Investigate and identify the cause of these flaky tests. Some questions you may want to think about are as follows:
- Is there a root cause tying these flaky tests together? (I have a hunch it has to do with eventually validations)
- Are each of the flaky tests caused by independent issues?
After investigation, please create issues to fix these flaky tests.
Acceptance criteria
- Cause/causes behind flaky tests are identified
- Issues to fix flaky test behaviour are created
- Eventually, flaky test behaviour in CI is resolved. You can resolve this issue before all sub-issues to fix flaky test behaviours are complete. However, this issue may be reopened if flaky test behaviour is not resolved by those fixes.