← Back to issue list

ci: correctly run from snap

View original Github issue

Metadata

Project
snapcraft
Number
#1803
Type
pull request
State
merged
Author
sergiusens
Labels
Created
Updated
Closed

Current evaluation

Merged a CI fix to correctly run tests from snap by separating development and runtime dependencies. Approved by one reviewer, passed CI, and resolved dependency isolation to expose hidden bugs for future fixes.

Suggested action:

No scores available.

Issue body

We loosly assume tests are using the snap to run, what is worse is that we setup all the development dependencies together with the runtime ones to hide this fact Signed-off-by: Sergio Schvezov <sergio.schvezov@canonical.com> - [x] Have you followed the [guidelines for contributing](https://github.com/snapcore/snapcraft/blob/master/CONTRIBUTING.md)? - [x] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)? - [x] If this is a bugfix. Have you checked that there is a bug report open for the issue you are trying to fix on [bug reports](https://bugs.launchpad.net/snapcraft)? - [x] If this is a new feature. Have you discussed the design on the [forum](https://forum.snapcraft.io)? - [x] Have you successfully run `./runtests.sh static`? - [x] Have you successfully run `./runtests.sh unit`? -----

Evaluation history

Date Model Scores Action Summary
qwen/qwen3.6-35b-a3b Merged a CI fix to correctly run tests from snap by separating development and runtime dependencies. Approved by one reviewer, passed CI, and resolved dependency isolation to expose hidden bugs for future fixes.
qwen3.6-35b-a3b-mtp-q6 Merged CI updates to correctly run tests from within a snap environment. The change stops bundling development dependencies with runtime ones to mask incorrect test assumptions, aiming to expose hidden bugs for future fixes.
qwen3.6-35b-a3b-mtp-q6 Merged CI updates to correctly execute tests from snap by separating development and runtime dependencies. This change exposes previously masked bugs for future fixes while ensuring accurate test execution.

Update history

No update history recorded yet.

Related issues

Issue Project State Summary Similarity
#4380 ci: download snap to tests dir snapcraft merged Merged a CI fix that ensures scheduled spread tests download the snap to the tests directory. Approved by two reviewers, passed CI checks, and modified one file.
77%
#2900 ci: publish the CI built snap to the Snap Store snapcraft merged Merged into master. Adds CI configuration to automatically publish built snaps to the Snap Store. Approved by a maintainer, passed all checks, and introduced 29 lines across two files with 100% diff coverage.
74%
#4755 tests: fix devel base snap test snapcraft merged Merged a fix for the devel base snap test. The update ensures snapcraft correctly creates and utilizes the devel base. Approved by two reviewers, passed CI checks, and applied with a minimal one-file change.
72%
#2030 ci: build the snap on self-hosted runners charmcraft merged Merged a two-line CI configuration update to build snaps on self-hosted amd64 runners. The change ensures containerized builds match the amd64 architecture required by downstream tests. Approved by two reviewers.
72%
#5899 ci: improve the state of some flaky tests snapcraft merged Merged CI updates fixing flaky tests. Several unstable tests were resolved, while integration store, remote build, and snapd tests were excluded due to upstream issues. Approved by two reviewers and passed all CI checks before merge.
72%
#228 packages: run snap operations silently craft-parts merged Merged to fix #218 by running snap subprocesses silently, preventing stdout leakage that conflicts with craft-cli during lifecycle execution. Approved by one reviewer, passed CI, and modified two files (+32/-15 lines).
72%
#432 ci: speed up spread testing workflow fetch-service merged Merged CI workflow optimization that decouples snap-test from snap-build, reducing pipeline latency. The build job remains for artifact retrieval. Approved by two reviewers, passed all checks, and modified one file.
71%
#1542 tests: add integration tests for build snaps snapcraft merged Merged integration tests for build snaps. Approved by two reviewers and passed CI. Two test scenarios omitted due to known bugs.
71%
#2045 ci: separate snap build and PR publish jobs charmcraft merged Merged CI changes separating snap build and PR publish jobs. Approved by two reviewers, this update allows concurrent snap testing while the store processes branch publishing, streamlining the release workflow.
70%
#5248 ci: publish snaps to arm64 snapcraft merged Merged CI updates to build and publish test snaps for arm64. Approved by two reviewers with passing checks, the change enables automated testing for related snapcraft and craft-providers issues.
70%