← Back to issue list

test: address a couple of non-flaky spread failures

View original Github issue

Metadata

Project
rockcraft
Number
#926
Type
pull request
State
merged
Author
tigarmo
Labels
Created
Updated
Closed

Current evaluation

Merged after two approvals and passing all CI checks. Resolves non-flaky spread test failures by updating test configurations across three files, eliminating consistent failures.

Suggested action:

No scores available.

Issue body

- [ ] Have you followed the guidelines for contributing? - [ ] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)? - [ ] Have you successfully run `make lint && make test`? ---

Evaluation history

Date Model Scores Action Summary
qwen/qwen3.6-35b-a3b Merged after two approvals and passing all CI checks. Resolves non-flaky spread test failures by updating test configurations across three files, eliminating consistent failures.
qwen3.6-35b-a3b-mtp-q6 Merged by maintainer tigarmo to fix non-flaky spread failures in the test suite. Changes were integrated into the main branch without additional discussion.
qwen3.6-35b-a3b-mtp-q6 Merged maintainer tigarmo's pull request to fix non-flaky spread test failures. The test adjustments were successfully integrated into the repository.

Update history

No update history recorded yet.

Related issues

Issue Project State Summary Similarity
#534 test(spread): workaround for flaky test fetch-service merged Merged a workaround for a flaky spread test (issue #533). The change adjusts one file (+2/-1 lines) to skip a no-op name query check while retaining other validations. Approved by two reviewers and passed all CI checks.
80%
#1366 tests(spread): make release test less flaky charmcraft merged Merged changes that reduce flakiness in the spread release test, resolving issue #1362. Approved by two reviewers, the update modifies one file (+17/-7) after addressing feedback.
80%
#3663 tests: update spread url snapcraft merged Merged following reviewer approval and passing CI. Updated spread tarball URLs in test configuration files, modifying two files with minimal changes.
79%
#3662 tests: update spread url snapcraft merged Merged update to spread tarball URLs in test files. Approved by a reviewer, passed CI checks, modified two files with minimal changes, and maintained existing code coverage.
78%
#62 spread: add a "big" spread test rockcraft merged Merged a reusable spread test framework to house multiple checks without repeated setup. The initial test validates bug #44 regarding directory permissions. Approved by one reviewer and passed CI checks.
77%
#127 Fix spread tests imagecraft merged Merged after receiving approval from two reviewers and passing all CI checks. The changes fix spread tests across 11 files (+49/-38 lines).
76%
#4808 tests: fix flutter spread test snapcraft merged Merged after passing CI and receiving three approvals. The change corrected the flutter spread test with a single-line update in one file.
76%
#1287 tests: minor cleanups on the spread tests snapcraft merged Merged minor spread test cleanups into master. Modified four files with 16 additions and 6 deletions. Approved by one reviewer with zero unresolved comments, maintaining 95.27% coverage upon integration.
76%
#2032 ci: fixes to several weekly spread tests charmcraft merged Merged CI fixes for several weekly spread tests. Approved by two reviewers and passed all checks with minimal changes across three files. Addresses initial test failures as a starting point for broader improvements.
76%
#1029 fix(testing): error early if spread.yaml is invalid. craft-application merged Merged after two approvals. Adds early validation to fail tests immediately if spread.yaml is invalid. CI passed except for an unrelated snap-test failure, which was overridden.
76%