chore(ci): move base devel spread tests to manual
Metadata
Current evaluation
Merged CI changes repurposing the large spread test run into a manual cron job. This isolates flaky base devel tests while preserving visibility via scheduled execution. Approved by two reviewers and applied across six files.
Suggested action: —
No scores available.
Issue body
These tests are by their very nature flaky because the base devel changes constantly and can occasionally break in a way that cannot be fixed by us. However, we still want to keep an eye on them so repurpose the 'large' spread run into a 'manual' one that, via cron, runs both the 'large' tests and the 'flaky' ones.
- [ ] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
-----
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| qwen/qwen3.6-35b-a3b | — | — | Merged CI changes repurposing the large spread test run into a manual cron job. This isolates flaky base devel tests while preserving visibility via scheduled execution. Approved by two reviewers and applied across six files. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged. CI updated to move inherently flaky base devel spread tests to a manual cron job. The large spread run was repurposed to trigger both large and flaky tests on demand, preserving monitoring without disrupting pipelines. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged changes to reclassify flaky base devel spread tests as manual. CI now executes these via cron alongside the standard large test suite, preventing automatic pipeline failures from unpredictable upstream development changes. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #11 chore: enable spread tests | snapcraft-rocks | merged | Merged to enable spread tests on CI using new self-hosted runners. Downgrades actions/checkout to v3 for compatibility. Approved by one reviewer. | |
| #6010 chore!: remove remote-build service override | snapcraft | merged | Merged cleanup removing the remote-build service override and manual spread tests. This follow-up addresses overlooked work from PR #5994. Approved by two reviewers, modifying seven files. | |
| #753 chore(services/testing): reduce spread verbosity level | craft-application | merged | Merged changes that disable verbose mode for the spread test command to reduce output noise. Approved by reviewers, passed all CI checks, and integrated into the codebase. | |
| #603 chore: update spread test to use utility functions | fetch-service | merged | Merged maintainer PR replacing direct curl calls in spread tests with utility functions from spread/utils.sh and extending create_session to accept optional secret definitions. Approved by two reviewers with all CI checks passing. | |
| #4634 chore: spread cleanup | snapcraft | merged | Merged by maintainer sergiusens after three reviewers approved. The PR cleaned up spread configuration across 85 files, removing 358 lines and adding 115. All CI checks passed with 100% coverage on modified code. | |
| #5393 chore(merge): feature/snapcraft-test into main | snapcraft | merged | Merged feature/snapcraft-test into main after two reviewer approvals. The change updated 54 files and passed most CI checks, with failing spread tests acknowledged for later resolution on main. | |
| #1372 chore: update base and docs ownership | craft-parts | merged | Merged after two approvals and passing all CI checks. Updates base and documentation ownership. Re-submitted after an accidental upstream branch creation. Changes affect one file (+3/-2). | |
| #4720 chore(core24): update package for linter spread test | snapcraft | merged | Merged a one-line package update for a linter spread test to address a time_t compatibility issue. Approved by two reviewers and passed CI checks. | |
| #271 chore(ci): generate release notes when publishing | starbase | merged | Merged a maintainer-submitted change that automates release note generation during publishing via CI. Approved by two reviewers, passed all checks, and added two lines to a single file. | |
| #241 chore: move tests to starflow | craft-store | merged | Merged after two approvals and passing CI. Tests were relocated to starflow across 43 files, featuring a major autoformat pass. Minor lock file discussion preceded integration. |