ci: run tests on Ubuntu 26.04
Metadata
Current evaluation
Adds Ubuntu 26.04 CI testing with Python 3.14. Approved by 2 reviewers but the new ubuntu-26.04 slow tests CI check is failing.
Suggested action: needs review
Reason: PR has 2 approvals but the new Ubuntu 26.04 slow tests CI check is failing. A maintainer should evaluate whether the test failures are acceptable, need fixing, or indicate a broader compatibility issue. The craft-platforms#227 issue provides relevant context that Ubuntu 26.04 official GitHub-hosted runners may not yet be available, which could explain the failures.
Issue body
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| qwen3.6-35b-a3b-mtp-q6 |
Impact:
50
Quick Win:
37.5
Staleness:
35
Complexity:
25
Confidence:
65
|
needs review | Adds Ubuntu 26.04 CI testing with Python 3.14. Approved by 2 reviewers but the new ubuntu-26.04 slow tests CI check is failing. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
30
Confidence:
90
|
needs review | Adds CI configuration to run tests on Ubuntu 26.04 LTS with Python 3.14. Approved by two reviewers, with CI jobs currently pending. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
15
Confidence:
90
|
needs review | Adds CI configuration to run tests on Ubuntu 26.04 LTS with Python 3.14. Approved by two reviewers, pending one security scan, and has five unresolved review comments. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
0
Complexity:
15
Confidence:
90
|
needs review | Updates CI configuration to run tests on Ubuntu 26.04 LTS with Python 3.14. Approved by two reviewers, all CI checks passing, but has 5 unresolved review comments. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
35
Confidence:
85
|
needs review | Adds CI configuration to run tests on Ubuntu 26.04 LTS with Python 3.14. Approved by two reviewers but has five unresolved comments and one failing CI job for Java plugins on the new target. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
35
Confidence:
85
|
needs review | Adds CI configuration to run tests on Ubuntu 26.04 LTS with Python 3.14. Approved by two reviewers but has five unresolved comments and multiple failing slow test jobs. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
25
Confidence:
90
|
needs review | Adds CI configuration to run tests on Ubuntu 26.04 LTS with Python 3.14. Approved by two reviewers, pending several slow test jobs, with five unresolved review comments. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
0
Complexity:
15
Confidence:
90
|
keep open | Configures CI to run tests on Ubuntu 26.04 LTS with Python 3.14. Approved by two reviewers, pending resolution of five comments and completion of slow test jobs. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
30
Confidence:
85
|
needs review | Adds CI configuration to run tests on Ubuntu 26.04 LTS with Python 3.14. Currently approved by two reviewers but has five unresolved comments and two failing CI jobs on the new platform. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
35
Confidence:
90
|
needs review | Adds CI configuration to run tests on Ubuntu 26.04 LTS with Python 3.14. Approved by two reviewers with 5 unresolved comments. CI is passing with several test jobs still pending. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
15
Confidence:
90
|
keep open | Adds CI configuration to run tests on Ubuntu 26.04 LTS with Python 3.14. Approved by one reviewer, with 5 unresolved comments and CI checks currently pending. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
15
Confidence:
85
|
needs review | Adds CI configuration to run tests on Ubuntu 26.04 LTS with Python 3.14. Approved by one reviewer, has 4 unresolved comments, and several slow tests are still pending. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
15
Confidence:
85
|
needs review | Adds CI configuration to run tests on Ubuntu 26.04 LTS with Python 3.14. Approved by one reviewer but has 4 unresolved comments and one failing CI job. Many tests are still pending. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
0
Complexity:
15
Confidence:
90
|
needs review | Adds CI configuration to run tests on Ubuntu 26.04 LTS with Python 3.14. Currently pending maintainer review with 4 unresolved comments and multiple CI jobs still running. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
15
Confidence:
90
|
needs review | Adds CI configuration to run tests on Ubuntu 26.04 LTS with Python 3.14. Currently pending maintainer review with several CI jobs still running. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
15
Confidence:
85
|
needs review | Adds CI configuration to run tests on Ubuntu 26.04 LTS with Python 3.14. Currently pending maintainer review with 4 unresolved comments and several CI checks still running or failing on unrelated platforms. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
25
Confidence:
80
|
needs review | Updates CI configuration to run tests on Ubuntu 26.04 LTS with Python 3.14. Currently pending review with several slow test checks failing or pending. Needs maintainer validation and approvals. | |
| qwen/qwen3.6-35b-a3b |
Staleness:
5
Complexity:
15
Confidence:
90
|
needs review | Adds CI configuration to run tests on Ubuntu 26.04 LTS with Python 3.14. Currently pending maintainer review, with 11 unresolved comments and one failing CI check (zizmor). Many test jobs are still pending. |
Update history
| Date | Change |
|---|---|
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| created |
Related work
-
Related To:
craft-platforms#227
(confidence 80%)
Same topic (Ubuntu 26.04 CI testing) in craft-platforms; closed because the maintainer deferred implementation until official GitHub-hosted runners are available, suggesting runner availability may be the root cause of test failures here.
-
Related To:
craft-cli#448
(confidence 75%)
Similar PR merged in craft-cli adding Ubuntu 26.04 testing using a self-hosted runner, providing a potential reference implementation.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #189 ci: test on Python 3.14 and Ubuntu 26.04 (Resolute) | craft-grammar | open | CI workflow update to add Python 3.14 and Ubuntu 26.04 testing; inactive for 79 days with 3 unresolved review comments and failing CI checks | |
| #90 ci: test on Python 3.14 and Ubuntu 26.04 (Resolute) | craft-artifacts | open | Adds Python 3.14 and Ubuntu 26.04 (Resolute) CI testing. Approved by 1 reviewer but typecheck-with-ty CI check is failing and has been inactive for 91 days. | |
| #1607 ci: test on Python 3.14 and Ubuntu 26.04 (Resolute) | craft-parts | closed | CI testing for Python 3.14 and Ubuntu 26.04 was proposed via a pull request that closed without merging. Multiple CI checks failed, and a reviewer questioned runner root requirements, leaving the changes abandoned. | |
| #971 ci: test on Python 3.14 and Ubuntu 26.04 (Resolute) | craft-providers | closed | Closed without merging due to unresolved review comments and multiple failing CI checks. The workflow updates for Python 3.14 and Ubuntu 26.04 remain abandoned. | |
| #980 fix(tests): fix tests that were broken on Ubuntu 26.04 | craft-application | merged | Merged a fix for tests failing on Ubuntu 26.04. Approved by two reviewers and passing all CI checks, the change modifies two files with six additions and two deletions to resolve platform-specific test failures. | |
| #230 ci: test on Ubuntu 26.04 (Resolute) | craft-platforms | merged | Merged following two reviewer approvals and successful CI validation. The change adds Ubuntu 26.04 and 26.04-arm to fast and slow test platforms in qa.yaml, resolving issue #226. Four lines were added to one file. | |
| #225 ci: test on Python 3.14 and Ubuntu 26.04 (Resolute) | craft-archives | merged | Merged after two approvals and passing all CI checks. The update adds continuous integration testing for Python 3.14 and Ubuntu 26.04 (Resolute) using a dedicated self-hosted runner, modifying two files with minimal changes. | |
| #448 ci: test on Ubuntu 26.04 (Resolute) | craft-cli | merged | Merged to add Ubuntu 26.04 (Resolute) testing to the CI workflow using a self-hosted runner. Approved by a reviewer and passed all CI checks. | |
| #89 Test on Python 3.14 and Ubuntu 26.04 (Resolute) | craft-artifacts | open | CI enhancement request to add Python 3.14 and Ubuntu 26.04 testing. Unlabelled, no maintainer engagement after 93 days. | |
| #1376 ci: test on Python 3.14 | craft-parts | closed | Closed without merging after adding Python 3.14 to CI. Multiple slow tests failed across various architectures and versions. The change received no reviews or comments and was ultimately abandoned. |