ci: add weekly lxd tests
Metadata
Current evaluation
Merged as a94fb285, adding a weekly CI matrix for LXD instance tests across Ubuntu, LXD, and Python versions to detect regressions such as #856 earlier.
Resolution: closed resolved
Reason: PR #857 was approved and merged as commit a94fb285. It introduced scheduled weekly LXD instance tests across Ubuntu, LXD, and Python combinations; subsequent maintainer comments identified reported spread failures as network-related.
Evaluated by: mr-cal-bot
No scores available.
Issue body
- [x] Have you followed the guidelines for contributing?
- [x] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
- [x] Have you successfully run `make lint && make test`?
---
This has us running our LXD instance tests on a matrix of Ubuntu/lxd/Python versions each week.
Example run: https://github.com/canonical/craft-providers/actions/runs/19977333039
This should catch errors such as https://github.com/canonical/craft-providers/issues/856 earlier.
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha | — | closed resolved | Merged as a94fb285, adding a weekly CI matrix for LXD instance tests across Ubuntu, LXD, and Python versions to detect regressions such as #856 earlier. | |
| qwen/qwen3.8-27b | — | closed resolved | Merged as commit a94fb285, adding a weekly CI workflow that runs LXD instance tests across a matrix of Ubuntu/LXD/Python versions to catch regressions like #856 earlier. | |
| stealth/space-bunny-alpha | — | closed resolved | Merged #857 added weekly LXD tests across Ubuntu, LXD channel, and Python version matrices in commit a94fb28. | |
| stealth/space-bunny-alpha |
Impact:
45
Quick Win:
26
Complexity:
34
Confidence:
94
Actionability:
88
|
needs review | Adds a weekly LXD integration-test matrix for Ubuntu, LXD, and Python versions. Approved twice with no unresolved comments; completed checks pass, while matrix and slow jobs remain pending. | |
| qwen3.6-35b-a3b-mtp-q6 |
Impact:
25
Quick Win:
21
Staleness:
45
Complexity:
15
Confidence:
80
|
needs review | Adds weekly LXD integration tests across Ubuntu/LXD/Python version matrices. Approved by 2 reviewers, CI passing, 0 unresolved comments. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
85
Complexity:
10
Confidence:
75
|
needs review | Adds weekly LXD integration tests across multiple Ubuntu/LXD/Python version matrices to catch regressions earlier. Currently approved by one reviewer but has unresolved comments and failing CI checks. Last active ~7 months ago. | |
| qwen3.6-35b-a3b-mtp-q6 |
Staleness:
85
Complexity:
20
Confidence:
70
|
close stale | Adds weekly CI tests for LXD instances across Ubuntu/LXD/Python versions to catch regressions. Currently inactive for 7+ months with unresolved flaky test failures and no maintainer feedback. |
Update history
| Date | Change |
|---|---|
| merged | |
| updated | |
| updated | |
| updated |
Related work
-
Related To:
canonical/craft-providers#856
(confidence 99%)
Explicitly cited as an earlier LXD regression that the new weekly tests were intended to detect.
-
Related To:
canonical/craft-providers#874
(confidence 95%)
Later fixed the specific LXD 6.6 behavior reported in #856; distinct from #857's CI coverage change.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #876 ci: add weekly tests on a variety of distros | craft-providers | open | Adds a weekly LXD integration-test matrix for Debian, Fedora, Rocky Linux, CentOS Stream, AlmaLinux, openSUSE, and Mint; every new distro job is failing and the unreviewed PR has had no activity for 293 days. | |
| #765 Set up weekly tests for tests that don't need to run on each PR | craft-providers | open | Weekly Linux LXD integration coverage now exists, but the issue remains open despite its implementation in PR #857. |