← Back to issue list

fix(tests): make store spread tests less flaky

View original Github issue

Metadata

Project
charmcraft
Number
#1460
Type
pull request
State
merged
Author
lengau
Labels
Created
Updated
Closed

Current evaluation

Merged following approval by two reviewers and successful CI checks. The change resolves issue #1429 by adjusting two files to reduce flakiness in store spread tests, with a net diff of +7/-4 lines.

Suggested action:

No scores available.

Issue body

Fixes #1429

Evaluation history

Date Model Scores Action Summary
qwen/qwen3.6-35b-a3b Merged following approval by two reviewers and successful CI checks. The change resolves issue #1429 by adjusting two files to reduce flakiness in store spread tests, with a net diff of +7/-4 lines.
qwen3.6-35b-a3b-mtp-q6 Merged to resolve issue #1429 by stabilizing flaky store spread tests. The update adjusts test assertions and timing to prevent intermittent failures, ensuring consistent CI execution.
qwen3.6-35b-a3b-mtp-q6 Merged to resolve issue #1429 by stabilizing flaky store spread tests. Adjustments to test assertions and timing prevent intermittent failures, ensuring consistent CI results.

Update history

No update history recorded yet.

Related issues

Issue Project State Summary Similarity
#1290 test(spread): clean up store tests charmcraft merged Merged cleanup of spread store tests, removing 28 lines across four files. The underlying library test failure is fixed in PR #1292. Approved by two reviewers.
85%
#1366 tests(spread): make release test less flaky charmcraft merged Merged changes that reduce flakiness in the spread release test, resolving issue #1362. Approved by two reviewers, the update modifies one file (+17/-7) after addressing feedback.
83%
#5954 tests: fix store tests snapcraft merged Merged after approval. Updated store tests with new staging credentials and switched to wheels for automated spread tests. CI passed, with unrelated spread failures noted by the author.
80%
#534 test(spread): workaround for flaky test fetch-service merged Merged a workaround for a flaky spread test (issue #533). The change adjusts one file (+2/-1 lines) to skip a no-op name query check while retaining other validations. Approved by two reviewers and passed all CI checks.
80%
#3090 ci: move staging store tests to spread snapcraft merged Merged into master. The change migrated staging store tests to the spread testing framework, removing 1434 lines across 27 files. Approved by two reviewers, passed CI, and achieved 100% diff coverage prior to integration.
79%
#127 Fix spread tests imagecraft merged Merged after receiving approval from two reviewers and passing all CI checks. The changes fix spread tests across 11 files (+49/-38 lines).
79%
#1223 tests: fix resource spread test charmcraft merged Merged to fix the resource spread test, advancing progress toward issue #1193. The update modified two files (+44/-23 lines) and was approved by two reviewers. Related library and store test corrections are addressed in separate pull requests.
78%
#1600 test(spread): move flaky parallel-build test to weeklies charmcraft merged Merged to address issue #1332 by relocating a flaky parallel-build test to the weekly suite. Approved by two reviewers, the change modifies two files (+19/-2) to stabilize CI runs.
76%
#1287 tests: minor cleanups on the spread tests snapcraft merged Merged minor spread test cleanups into master. Modified four files with 16 additions and 6 deletions. Approved by one reviewer with zero unresolved comments, maintaining 95.27% coverage upon integration.
76%
#13 test(spread): add more spread tests snapcraft-rocks merged Successfully merged spread tests covering architectures, chisel slices, craftctl, package-repositories, and patchelf. Approved by two reviewers across 15 files (+206/-5 lines).
76%