← Back to issue list

tests(spread): make release test less flaky

View original Github issue

Metadata

Project
charmcraft
Number
#1366
Type
pull request
State
merged
Author
lengau
Labels
Created
Updated
Closed

Current evaluation

Merged changes that reduce flakiness in the spread release test, resolving issue #1362. Approved by two reviewers, the update modifies one file (+17/-7) after addressing feedback.

Suggested action:

No scores available.

Issue body

Fixes #1362

Evaluation history

Date Model Scores Action Summary
qwen/qwen3.6-35b-a3b Merged changes that reduce flakiness in the spread release test, resolving issue #1362. Approved by two reviewers, the update modifies one file (+17/-7) after addressing feedback.
qwen3.6-35b-a3b-mtp-q6 Merged to stabilize flaky release tests in the spread suite, resolving issue #1362. The maintainer applied reviewer feedback to eliminate intermittent test failures.
qwen3.6-35b-a3b-mtp-q6 Merged changes that resolve flakiness in the spread release test, addressing reviewer feedback and closing issue #1362.

Update history

No update history recorded yet.

Related issues

Issue Project State Summary Similarity
#1460 fix(tests): make store spread tests less flaky charmcraft merged Merged following approval by two reviewers and successful CI checks. The change resolves issue #1429 by adjusting two files to reduce flakiness in store spread tests, with a net diff of +7/-4 lines.
83%
#534 test(spread): workaround for flaky test fetch-service merged Merged a workaround for a flaky spread test (issue #533). The change adjusts one file (+2/-1 lines) to skip a no-op name query check while retaining other validations. Approved by two reviewers and passed all CI checks.
83%
#1287 tests: minor cleanups on the spread tests snapcraft merged Merged minor spread test cleanups into master. Modified four files with 16 additions and 6 deletions. Approved by one reviewer with zero unresolved comments, maintaining 95.27% coverage upon integration.
81%
#1600 test(spread): move flaky parallel-build test to weeklies charmcraft merged Merged to address issue #1332 by relocating a flaky parallel-build test to the weekly suite. Approved by two reviewers, the change modifies two files (+19/-2) to stabilize CI runs.
80%
#926 test: address a couple of non-flaky spread failures rockcraft merged Merged after two approvals and passing all CI checks. Resolves non-flaky spread test failures by updating test configurations across three files, eliminating consistent failures.
80%
#1290 test(spread): clean up store tests charmcraft merged Merged cleanup of spread store tests, removing 28 lines across four files. The underlying library test failure is fixed in PR #1292. Approved by two reviewers.
80%
#127 Fix spread tests imagecraft merged Merged after receiving approval from two reviewers and passing all CI checks. The changes fix spread tests across 11 files (+49/-38 lines).
79%
#13 test(spread): add more spread tests snapcraft-rocks merged Successfully merged spread tests covering architectures, chisel slices, craftctl, package-repositories, and patchelf. Approved by two reviewers across 15 files (+206/-5 lines).
78%
#1266 tests(spread): requirements dependencies charmcraft merged Merged following approval by two reviewers. Introduces regression tests for requirements file and dependency combinations, resolving issue #1179. The change modifies five files, adding 149 lines and removing one.
78%
#4433 tests(spread): add remote-build spread test snapcraft merged Merged changes adding spread tests for new and legacy remote-build, resolving issue #4398. Approved by two reviewers with passing CI checks.
78%