← Back to issue list

ci: run plugin integration tests in separate jobs

View original Github issue

Metadata

Project
craft-parts
Number
#1275
Type
pull request
State
merged
Author
lengau
Labels
—
Created
Updated
Closed

Current evaluation

Merged PR canonical/craft-parts#1275 (commit 2e6bb9a2, CRAFT-4767) split plugin integration tests into separate CI jobs (test-common, test-python-plugins, test-java-plugins, test-other-plugins), speeding up CI and isolating dependency-heavy java plugin tests.

Resolution: closed resolved

Reason: The PR itself was merged into main as commit 2e6bb9a2 ('ci: run plugin integration tests in separate jobs (#1275)') after approval by two reviewers, with all CI checks passing. It created the job matrix now visible in .github/workflows/qa.yaml.

Evaluated by: mr-cal-bot

No scores available.

Issue body

- [x] Have you followed the guidelines for contributing? - [x] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)? - [x] Have you successfully run `make lint && make test`? - [ ] Have you added an entry to the changelog (`docs/reference/changelog.rst`)? --- This runs the integration tests from the various plugins in separate jobs, speeding up CI overall and making it faster for plugin authors to see the results of their particular tests. This is especially beneficial for changes that don't touch the java plugins, as they require many extra dependencies that take a while to install. By separating CI out into these groups, we also reduce the likelihood of dependency-related surprises. CRAFT-4767

Evaluation history

Date Model Scores Action Summary
stealth/space-bunny-alpha — closed resolved Merged PR canonical/craft-parts#1275 (commit 2e6bb9a2, CRAFT-4767) split plugin integration tests into separate CI jobs (test-common, test-python-plugins, test-java-plugins, test-other-plugins), speeding up CI and isolating dependency-heavy java plugin tests.
stealth/space-bunny-alpha — closed resolved Merged the CI change to run common, Java, Python, and other plugin integration tests in separate jobs, reducing unnecessary Java dependency installation and speeding up plugin test feedback.
qwen/qwen3.6-35b-a3b — — Merged. Splits plugin integration tests into separate CI jobs to accelerate pipeline execution, isolate results for plugin authors, and reduce dependency conflicts. Approved by two reviewers with all checks passing. Resolves CRAFT-4767.
qwen3.6-35b-a3b-mtp-q6 — — Merged changes to split plugin integration tests into separate CI jobs, accelerating pipeline execution and isolating results for plugin authors. This reduces dependency conflicts, particularly for Java plugins, and resolves CRAFT-4767.

Update history

No update history recorded yet.

Related work

  • Related To: canonical/craft-parts#1279 (confidence 85%)

    Follow-up by same maintainer splitting non-plugin tests into its own job (commit 4193bd04), completing the split started here

  • Related To: canonical/craft-parts#1276 (confidence 80%)

    Follow-up expanding Python plugin test coverage onto the new test-python-plugins job (commit b1e7fdff)

  • Related To: canonical/craft-parts#1303 (confidence 75%)

    Later PR testing java plugins on more platforms (commit fc3a4a35), building on the test-java-plugins job created here

  • Related To: canonical/craft-parts#1311 (confidence 70%)

    Later PR testing non-java/python plugins on more platforms (commit a20b49d1), extending the test-other-plugins job

Related issues

Issue Project State Summary Similarity
#1252 ci: split plugin integration tests out. snapcraft merged Merged PR #1252 in commit 1387c0aa9, splitting plugin integration tests into separate Travis CI runs to stay within time limits.
78%
#1272 ci: run plugin tests separately craft-parts closed Merged PR #1272 separated plugin tests from the main CI test run; all reported lint, policy, security, and test checks passed.
78%
#1279 ci: run non-plugin tests on more platforms craft-parts merged Merged in canonical/craft-parts#1279 as 4193bd04, expanding non-plugin CI tests across more platforms and architectures.
74%
#1286 test: run all plugin tests with partitions craft-parts merged Merged #1286 in commit e6bcc7a8, refactoring 26 files so all plugin tests run with partitions enabled (CRAFT-4767).
74%
#131 build: separate unit and integration tests in CI craft-application merged Merged CI change separating unit and integration tests in canonical/craft-application#131 (commit 3a4a2b64).
73%
#77 tests: add integration tests for application plugins (CRAFT-69) craft-parts merged Merged #77 (commit 7aaeb020, merge 04ffbf6e), adding integration coverage for application-defined plugin registration and behavior.
70%