ci: run plugin tests separately
Metadata
Current evaluation
Merged PR #1272 separated plugin tests from the main CI test run; all reported lint, policy, security, and test checks passed.
Resolution: closed resolved
Reason: PR canonical/craft-parts#1272 was merged, adding a separate test-plugins CI job. Its main and plugin test suites, lint, policy, and security checks all passed.
Evaluated by: mr-cal-bot
No scores available.
Issue body
- [ ] Have you followed the guidelines for contributing?
- [ ] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
- [ ] Have you successfully run `make lint && make test`?
- [ ] Have you added an entry to the changelog (`docs/reference/changelog.rst`)?
---
Future work: Provide a way in starflow for us to skip installing all those dependencies (probably by providing a way to add environment variables).
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha | — | closed resolved | Merged PR #1272 separated plugin tests from the main CI test run; all reported lint, policy, security, and test checks passed. | |
| stealth/space-bunny-alpha | — | closed resolved | Separated plugin tests from main CI jobs into dedicated test-plugins jobs. PR #1272 was merged with all reported CI checks passing. | |
| stealth/space-bunny-alpha | — | closed resolved | Plugin testing was separated from the main CI tests. canonical/craft-parts#1272 was merged, changing three files (+22/-2), with all reported test, lint, security, and policy checks passing. | |
| qwen/qwen3.6-35b-a3b | — | — | Merged to update CI configuration for running plugin tests separately. The pull request modified three files (+22/-2 lines), passed all continuous integration checks, and required no reviewer changes. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | CI plugin test separation was proposed but closed without merging. Zero review comments indicate the contribution was abandoned. Future dependency management improvements remain pending. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #1275 ci: run plugin integration tests in separate jobs | craft-parts | merged | Merged PR canonical/craft-parts#1275 (commit 2e6bb9a2, CRAFT-4767) split plugin integration tests into separate CI jobs (test-common, test-python-plugins, test-java-plugins, test-other-plugins), speeding up CI and isolating dependency-heavy java plugin tests. | |
| #1252 ci: split plugin integration tests out. | snapcraft | merged | Merged PR #1252 in commit 1387c0aa9, splitting plugin integration tests into separate Travis CI runs to stay within time limits. | |
| #1277 ci: run other plugin tests on more platforms | craft-parts | closed | Closed unmerged after lint and platform-test failures; PR #1311 later replaced it by merging the expanded non-Java/Python plugin CI matrix in a20b49d1. | |
| #1278 ci: run java plugin tests on more platforms | craft-parts | closed | PR #1278 (expand Java plugin CI to more platforms, stacked on merged #1275) was closed unmerged; the same goal was delivered by merged PR #1303, commit fc3a4a35. |