Draft
Conversation
Add flaky-tests/audit-log.md to track CI runs on this branch. Any test failure here is a flaky test since no test logic has been modified from master. Signed-off-by: Charlie Le <charlie.le@gmail.com> Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> Signed-off-by: Charlie Le <charlie_le@apple.com>
Detected flaky test in ci run 24314068155. The subtest maxT_well_after_lookback_boundary failed under -race on amd64 but passed on arm64 and without -race. Root cause is a timing sensitivity where time.Now() drifts between test setup and code under test. Signed-off-by: Charlie Le <charlie.le@gmail.com> Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> Signed-off-by: Charlie Le <charlie_le@apple.com>
CI run 24314518781 completed with all jobs passing. Signed-off-by: Charlie Le <charlie.le@gmail.com> Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> Signed-off-by: Charlie Le <charlie_le@apple.com>
Detected flaky test in ci run 24314927948. TestQueueConcurrency in pkg/scheduler/queue timed out after 30m on arm64 with -race. Root cause is a deadlock where dequeueRequest blocks forever on a channel when the queue is drained or deleted by concurrent goroutines. Signed-off-by: Charlie Le <charlie.le@gmail.com> Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> Signed-off-by: Charlie Le <charlie_le@apple.com>
… occurrence #2 CI run 24315645679: same timing-sensitive test failed again on amd64 with -race. This is occurrence #2 of 3 before auto-skip. Signed-off-by: Charlie Le <charlie.le@gmail.com> Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> Signed-off-by: Charlie Le <charlie_le@apple.com>
…ndary and TestQueueConcurrency Auto-skip flaky tests after first occurrence: - TestDistributorQuerier_QueryIngestersWithinBoundary: timing-sensitive test where time.Now() drifts between test setup and code under test (2 occurrences on amd64 with -race) - TestQueueConcurrency: deadlock where dequeueRequest blocks forever when queue is drained/deleted by concurrent goroutines (1 occurrence on arm64 with -race, 30m timeout) Signed-off-by: Charlie Le <charlie.le@gmail.com> Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> Signed-off-by: Charlie Le <charlie_le@apple.com>
…aryMode New flaky test from ci run 24316060467: integration test failed on arm64 due to Docker container (e2e-cortex-test-consul) disappearing mid-test. Transient CI infrastructure issue, not a code bug. Also updated audit log with run #5 and #6 results. Signed-off-by: Charlie Le <charlie.le@gmail.com> Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> Signed-off-by: Charlie Le <charlie_le@apple.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
flaky-tests/document each flaky test with build logs, job links, and occurrence countt.Skip()Tracking
flaky-tests/audit-log.md— timestamped log of every CI run resultflaky-tests/<TestName>.md— one file per flaky test with failure detailsThis PR will never be merged. It exists as a living audit trail.