Core22 unit tests in snapcraft fails with craft application 5.5.0
Metadata
Current evaluation
Closed and deferred. The core22 test failure was traced to a validation change in craft-application PR #812. The issue was logged internally as SNAPCRAFT-1188 for tracking.
Suggested action: —
No scores available.
Issue body
### What needs to get done
Updating to craft-application 5.5.0 causes core22 unit tests to fail with:
```
Bad snapcraft.yaml content:
- 'platforms' key is not supported for base 'core22'. Use 'architectures' key instead.
```
([source](https://github.com/canonical/snapcraft/actions/runs/16371073855/job/46263753870?pr=5612#step:4:368))
This is due to [this line](https://github.com/canonical/craft-application/pull/812/files#diff-5a1e547ec3a0d86ebd396803eabf6624306b1a16cef192d4c55487897a9d8ea6R476) from https://github.com/canonical/craft-application/pull/812.
We don't yet know if snapcraft mis-using craft-application or if this is a craft-application regression.
### Why it needs to get done
So Snapcraft can get `craft test` fixes from craft-app 5.5.0.
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| qwen/qwen3.6-35b-a3b | — | — | Closed and deferred. The core22 test failure was traced to a validation change in craft-application PR #812. The issue was logged internally as SNAPCRAFT-1188 for tracking. | |
| qwen/qwen3.6-35b-a3b | — | — | Closed. The craft-application 5.5.0 validation regression causing core22 unit test failures was resolved, allowing snapcraft to adopt upstream craft test fixes. Tracked as Jira SNAPCRAFT-1188. | |
| qwen/qwen3.6-35b-a3b | — | — | Closed without resolution and deferred. The craft-application 5.5.0 regression breaking core22 tests was tracked via internal Jira ticket SNAPCRAFT-1188 for further investigation. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Upgrading to craft-application 5.5.0 broke core22 unit tests due to a platforms key validation error. The issue was closed and triaged, with an internal Jira ticket SNAPCRAFT-1188 created to track the fix. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Closed without resolution. The test failure stems from craft-application 5.5.0 enforcing architecture validation. Root cause remains under investigation between snapcraft and craft-application, with no fix applied. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #77 core22-8 spread tests fail on classic-patchelf test | snapcraft-rocks | closed | core22-8 spread tests failed on classic-patchelf due to missing snapcraft output, likely from stdout/stderr handling. Closed and fixed by pull request #80. | |
| #1986634 "snapcraft extension" does not recognize core22 extensions | snapcraft (launchpad) | closed | The snapcraft extension command failed to recognize core22 extensions despite listing them. It was closed without resolution or comments, indicating abandonment or stale status due to prolonged inactivity. | |
| #2033882 snapcraft first run doesn't verify parts in parts after keyword on core22 | snapcraft (launchpad) | closed | Closed without resolution. Snapcraft fails to validate non-existent parts in the after keyword on core22, a regression from core20, remains unaddressed. | |
| #5604 `snapcraft try` for `core24` | snapcraft | open | Implement `snapcraft try` for core24 snaps, a known core24 migration gap. Triaged (Jira SNAPCRAFT-1185); a maintainer noted in July 2025 it's now implementable after Craft Application 5.0 refactoring, but the command still raises FeatureNotImplemented. | |
| #6336 Snapcraft 9: snapcraftctl errors in core22 snaps | snapcraft | open | Regression in snapcraft 9: core22 snaps using snapcraftctl in override-build fail validation. Maintainer confirmed as a regression. | |
| #1957803 Support Core22 | snapcraft (launchpad) | closed | Core22 support request was closed without discussion, likely abandoned or superseded by subsequent Snapcraft Core22 implementation. | |
| #1978844 snapcraft try not available for core22-based snap | snapcraft (launchpad) | closed | Closed without resolution or comments. The snapcraft try command remains unavailable for core22-based snaps, with attempts failing or falling back to legacy implementations. | |
| #4486 $CRAFT_ARCH_TRIPLET_BUILD_FOR doesn't work on core22 | snapcraft | closed | Resolved. The $CRAFT_ARCH_TRIPLET_BUILD_FOR substitution failure in core22 environment blocks was fixed in snapcraft 8. A maintainer confirmed the fix with a working test case demonstrating correct variable replacement. | |
| #4870 snapcraft pack error obtuse on snapd errors | snapcraft | closed | Closed as a duplicate of issue #4548. The snapcraft pack error handling regression affecting core22 and core24 is superseded by the referenced tracking issue. | |
| #1973376 SNAPCRAFT_ARCH_TRIPLET not usable with core22 base | snapcraft (launchpad) | closed | Closed without resolution. The report details a core22 build failure where snapcraft rejects SNAPCRAFT_ARCH_TRIPLET in layout mount points during packing. Core20 remains compatible. |