test: migrate to openstack
Metadata
Current evaluation
Migrated spread tests to OpenStack. Approved by two reviewers and merged after CI checks passed for target platforms. Unrelated test failures were noted as flaky and did not block the merge.
Suggested action: —
No scores available.
Issue body
Migrates the spread tests to openstack.
Similar to https://github.com/canonical/rockcraft/pull/1279.
(SNAPCRAFT-1349)
---
- [x] I've followed the [contribution guidelines](https://github.com/canonical/snapcraft/blob/main/CONTRIBUTING.md).
- [x] I've signed the [CLA](http://www.ubuntu.com/legal/contributors/).
- [x] I've successfully run `make lint && make test`.
- [ ] I've added or updated any relevant documentation.
- [ ] In documents I changed, I [added a meta description](https://canonical-starflow.readthedocs-hosted.com/how-to/add-a-page-meta-description/) if one was missing.
- [ ] I've updated the relevant release notes.
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| qwen/qwen3.6-35b-a3b | — | — | Migrated spread tests to OpenStack. Approved by two reviewers and merged after CI checks passed for target platforms. Unrelated test failures were noted as flaky and did not block the merge. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
10
Complexity:
45
Confidence:
85
|
needs review | Migrates spread integration tests from LXD to OpenStack. Two reviewers have approved the changes, with one unresolved comment and several CI checks still pending. Author notes minor test flakiness under investigation. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
15
Complexity:
45
Confidence:
85
|
needs review | Migrates spread tests to OpenStack. Approved by two reviewers with one unresolved comment. CI pending for OpenStack integration tests and publishing jobs. Author notes minor test flakiness and one known failure. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
10
Complexity:
55
Confidence:
85
|
needs review | Migrates spread tests to OpenStack. Currently approved by two reviewers with one unresolved comment and some flaky LXD/CI failures. Author indicates it is ready for final review and merge. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
10
Complexity:
50
Confidence:
90
|
needs review | Migrates spread integration tests to OpenStack. Approved by one reviewer with two unresolved comments. CI passes most checks but pending OpenStack spread tests; a few security/lint jobs fail. Author notes random LXD errors and one kernel-deb failure. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
15
Complexity:
45
Confidence:
85
|
needs review | Migrates spread tests to OpenStack. Awaiting review with two unresolved comments. Core CI passes, but OpenStack spread tests and lint checks are pending/failing. Author notes ~95% completion and intermittent LXD errors. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
10
Complexity:
45
Confidence:
85
|
needs review | Migrates spread integration tests to OpenStack. Currently under review with one approval, two unresolved comments, and mixed CI status. Author reports investigating random LXD failures and one OpenStack-specific test failure. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
10
Complexity:
45
Confidence:
85
|
needs review | Migrates spread tests to OpenStack. Currently under review with one approval and eight unresolved comments. CI shows several failing integration tests on OpenStack targets. Author notes it is 95% complete and ready for review. | |
| qwen3.6-35b-a3b-mtp-q6 |
Staleness:
5
Complexity:
45
Confidence:
85
|
needs review | Migrates spread tests to OpenStack. Currently approved with one unresolved comment and several failing CI checks, including OpenStack integration tests and LXD container startup errors. Author requests review. | |
| qwen3.6-35b-a3b-mtp-q6 |
Staleness:
5
Complexity:
45
Confidence:
85
|
needs review | Migrates spread tests to OpenStack. Currently awaiting maintainer review with 0 reviewers. CI passes most checks but shows failing OpenStack integration tests and LXC forkstart errors. | |
| qwen3.6-35b-a3b-mtp-q6 |
Staleness:
5
Complexity:
35
Confidence:
90
|
needs review | Migrates spread testing infrastructure to OpenStack. Currently awaiting maintainer review with passing CI checks and no comments or reviews yet. | |
| qwen3.6-35b-a3b-mtp-q6 |
Staleness:
5
Complexity:
30
Confidence:
85
|
needs review | Migrates spread tests to OpenStack infrastructure. Changes span 11 files with 177 additions and 52 deletions. Currently awaiting maintainer review and final CI checks, with all passing checks confirmed. |
Update history
| Date | Change |
|---|---|
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| created |
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #1279 test(spread): migrate from google to openstack | rockcraft | merged | Merged migration of spread tests from Google to OpenStack. Approved by two reviewers. CI checks for source-spread-tests and docs-spread-tests failed due to offline runners, with remaining proxy-related failures deferred for piecemeal fixes. | |
| #1091 ci: use openstack for spread | craft-application | merged | Switched the spread test backend to OpenStack and merged, resolving issue #1096. Approved by three reviewers and passed CI checks despite a failing OSV-scanner job. | |
| #368 ci: use openstack for spread | imagecraft | merged | Merged to switch the spread CI backend to OpenStack. Approved by two reviewers and merged despite failing OSV-scanner and lint checks. Updates 8 files (+99/-25 lines) to configure the new infrastructure provider for automated testing. | |
| #2783 ci: use openstack for spread | charmcraft | merged | Merged the switch of the spread CI backend from Google to OpenStack. Merge conflicts were resolved and approvals secured. Some tests may skip or fail due to Docker setup and rate limiting, but the change is integrated. | |
| #926 test: address a couple of non-flaky spread failures | rockcraft | merged | Merged after two approvals and passing all CI checks. Resolves non-flaky spread test failures by updating test configurations across three files, eliminating consistent failures. | |
| #534 test(spread): workaround for flaky test | fetch-service | merged | Merged a workaround for a flaky spread test (issue #533). The change adjusts one file (+2/-1 lines) to skip a no-op name query check while retaining other validations. Approved by two reviewers and passed all CI checks. | |
| #905 (qa) Migrated the smoke tests from Github CI to proper spread tests (CRAFT-1390) | charmcraft | merged | Migrated smoke tests from GitHub CI to spread tests and added local Multipass infrastructure for execution. Fixed pip and setuptools updates on Windows. Approved by one reviewer and merged. | |
| #3432 spread tests: remove legacy plugin tests | snapcraft | merged | Merged removal of legacy plugin tests from the spread test suite. Deleted 665 lines across 29 files. Approved by reviewer, passed CI, and maintained coverage. Unrelated test failures were addressed in a separate PR. | |
| #2417 fix: fix a series of breaking spread tests | charmcraft | merged | Merged after fixing multiple breaking spread tests. Commits resolve individual failures, while remaining broken tests are marked non-blocking for core24 migration. Approved by reviewers and merged following CI validation. | |
| #3090 ci: move staging store tests to spread | snapcraft | merged | Merged into master. The change migrated staging store tests to the spread testing framework, removing 1434 lines across 27 files. Approved by two reviewers, passed CI, and achieved 100% diff coverage prior to integration. |