Set up weekly tests for tests that don't need to run on each PR
Metadata
Current evaluation
Weekly Linux LXD integration coverage now exists, but the issue remains open despite its implementation in PR #857.
Suggested action: close resolved
Reason: Commit a94fb28, associated with PR #857 and titled "ci: add weekly lxd tests", added a Monday-scheduled Linux LXD matrix in .github/workflows/tests-weekly.yaml. The job runs lxd_instance integration tests across Ubuntu versions, multiple LXD channels, and Python versions, directly implementing the requested weekly coverage outside PR checks.
Evaluated by: mr-cal-bot
Impact:
52
Quick Win:
29
Complexity:
38
Confidence:
97
Actionability:
90
Issue body
### What needs to get done
We should have a job in our weekly test job that runs integration tests on Linux that
don't need to run all the time.
For example, this would test the snap installer integration tests on all bases (not just core22), test relaunching instances with all bases, etc.
### Why it needs to get done
Currently we have a lot of combinations that aren't tested. They don't need to delay PRs, but they could begin to break, in which case we should be notified and fix them.
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha |
Impact:
52
Quick Win:
29
Complexity:
38
Confidence:
97
Actionability:
90
|
close resolved | Weekly Linux LXD integration coverage now exists, but the issue remains open despite its implementation in PR #857. | |
| stealth/space-bunny-alpha |
Impact:
35
Quick Win:
18
Complexity:
35
Confidence:
84
Actionability:
80
|
keep open | Enhancement request for weekly Linux integration tests covering base combinations excluded from PR runs, such as snap installer and relaunch tests; no resolution is reported. | |
| qwen3.6-35b-a3b-mtp-q6 |
Impact:
50
Quick Win:
30
Staleness:
65
Complexity:
40
Confidence:
70
Support Request:
10
|
keep open | Enhancement request to add weekly Linux integration tests. Weekly test workflow exists but only covers macOS; Linux tests and full base coverage remain incomplete. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
45
Complexity:
60
Confidence:
85
Support Request:
0
|
keep open | Request to add weekly integration tests for scenarios not required per PR to prevent regressions. Currently awaiting implementation. | |
| qwen3.6-35b-a3b-mtp-q6 |
Staleness:
70
Complexity:
20
Confidence:
80
Support Request:
0
|
keep open | Maintainer-requested enhancement to add a weekly CI job for integration tests that do not require PR gating. Currently unassigned and inactive for approximately 81 days. |
Update history
No update history recorded yet.
Related work
-
Likely Fixed By:
craft-providers#857
(confidence 99%)
PR #857 is identified in commit a94fb28 as adding the scheduled weekly LXD test job.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #876 ci: add weekly tests on a variety of distros | craft-providers | open | Adds a weekly LXD integration-test matrix for Debian, Fedora, Rocky Linux, CentOS Stream, AlmaLinux, openSUSE, and Mint; every new distro job is failing and the unreviewed PR has had no activity for 293 days. | |
| #857 ci: add weekly lxd tests | craft-providers | merged | Merged as a94fb285, adding a weekly CI matrix for LXD instance tests across Ubuntu, LXD, and Python versions to detect regressions such as #856 earlier. |