test: migrate to openstack
Metadata
Current evaluation
Merged PR #6370 (commit eabad1564) migrated Snapcraft's spread integration tests from LXD-on-GitHub runners to OpenStack instances, modelled on rockcraft#1279 (SNAPCRAFT-1349). Remaining CI failures were attributed to unrelated flakiness tracked in #6381.
Resolution: closed resolved
Reason: The PR was approved by 2 reviewers and merged into main as commit eabad1564, replacing the LXD-based spread runners with OpenStack ubuntu-22.04/24.04/26.04 images. The author confirmed in the final comment that leftover red checks were unrelated flakes tracked separately in #6381.
Evaluated by: mr-cal-bot
Issue body
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha | — | closed resolved | Merged PR #6370 (commit eabad1564) migrated Snapcraft's spread integration tests from LXD-on-GitHub runners to OpenStack instances, modelled on rockcraft#1279 (SNAPCRAFT-1349). Remaining CI failures were attributed to unrelated flakiness tracked in #6381. | |
| stealth/space-bunny-alpha | — | closed resolved | Merged PR #6370 as eabad1564, migrating Spread tests to OpenStack; remaining reported test failures were attributed to unrelated flakiness. | |
| qwen/qwen3.6-35b-a3b | — | — | Migrated spread tests to OpenStack. Approved by two reviewers and merged after CI checks passed for target platforms. Unrelated test failures were noted as flaky and did not block the merge. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
10
Complexity:
45
Confidence:
85
|
needs review | Migrates spread integration tests from LXD to OpenStack. Two reviewers have approved the changes, with one unresolved comment and several CI checks still pending. Author notes minor test flakiness under investigation. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
15
Complexity:
45
Confidence:
85
|
needs review | Migrates spread tests to OpenStack. Approved by two reviewers with one unresolved comment. CI pending for OpenStack integration tests and publishing jobs. Author notes minor test flakiness and one known failure. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
10
Complexity:
55
Confidence:
85
|
needs review | Migrates spread tests to OpenStack. Currently approved by two reviewers with one unresolved comment and some flaky LXD/CI failures. Author indicates it is ready for final review and merge. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
10
Complexity:
50
Confidence:
90
|
needs review | Migrates spread integration tests to OpenStack. Approved by one reviewer with two unresolved comments. CI passes most checks but pending OpenStack spread tests; a few security/lint jobs fail. Author notes random LXD errors and one kernel-deb failure. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
15
Complexity:
45
Confidence:
85
|
needs review | Migrates spread tests to OpenStack. Awaiting review with two unresolved comments. Core CI passes, but OpenStack spread tests and lint checks are pending/failing. Author notes ~95% completion and intermittent LXD errors. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
10
Complexity:
45
Confidence:
85
|
needs review | Migrates spread integration tests to OpenStack. Currently under review with one approval, two unresolved comments, and mixed CI status. Author reports investigating random LXD failures and one OpenStack-specific test failure. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
10
Complexity:
45
Confidence:
85
|
needs review | Migrates spread tests to OpenStack. Currently under review with one approval and eight unresolved comments. CI shows several failing integration tests on OpenStack targets. Author notes it is 95% complete and ready for review. | |
| qwen3.6-35b-a3b-mtp-q6 |
Staleness:
5
Complexity:
45
Confidence:
85
|
needs review | Migrates spread tests to OpenStack. Currently approved with one unresolved comment and several failing CI checks, including OpenStack integration tests and LXD container startup errors. Author requests review. | |
| qwen3.6-35b-a3b-mtp-q6 |
Staleness:
5
Complexity:
45
Confidence:
85
|
needs review | Migrates spread tests to OpenStack. Currently awaiting maintainer review with 0 reviewers. CI passes most checks but shows failing OpenStack integration tests and LXC forkstart errors. | |
| qwen3.6-35b-a3b-mtp-q6 |
Staleness:
5
Complexity:
35
Confidence:
90
|
needs review | Migrates spread testing infrastructure to OpenStack. Currently awaiting maintainer review with passing CI checks and no comments or reviews yet. | |
| qwen3.6-35b-a3b-mtp-q6 |
Staleness:
5
Complexity:
30
Confidence:
85
|
needs review | Migrates spread tests to OpenStack infrastructure. Changes span 11 files with 177 additions and 52 deletions. Currently awaiting maintainer review and final CI checks, with all passing checks confirmed. |
Update history
| Date | Change |
|---|---|
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| created |
Related work
-
Related To:
canonical/rockcraft#1279
(confidence 92%)
Cited in the PR body as the model for the migration; merged rockcraft spread tests from Google to OpenStack.
-
Caused By:
canonical/snapcraft#6381
(confidence 85%)
Open issue for random 'lxd forkstart' failures in the new OpenStack spread environment, which the author cited as the cause of the remaining CI failures.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #1279 test(spread): migrate from google to openstack | rockcraft | merged | PR #1279 by tigarmo migrated rockcraft's spread test setup from Google to OpenStack (spread.yaml, spread workflows, 14 files, +192/-17); merged as commit 132b18c4. Proxy-related spread failures were knowingly deferred. | |
| #637 Work/spread openstack | rockcraft | closed | Draft PR #637 to run spread tests on OpenStack was closed unmerged as superseded by merged PR #1279 (commit 132b18c4), which migrated spread tests from Google to OpenStack. |