ci: split plugin integration tests out.
Metadata
Current evaluation
Merged to split plugin integration tests across multiple jobs, resolving Travis CI timeout limits. The change modified 23 files with minimal additions and required no review.
Suggested action: —
No scores available.
Issue body
We have passed the time allowed by travis for a run, splitting the test
runs out takes care of that.
Signed-off-by: Sergio Schvezov <sergio.schvezov@canonical.com>
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| qwen/qwen3.6-35b-a3b | — | — | Merged to split plugin integration tests across multiple jobs, resolving Travis CI timeout limits. The change modified 23 files with minimal additions and required no review. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged to resolve Travis CI timeout limits by splitting plugin integration tests into separate runs. This change optimizes build duration while preserving test coverage. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged to resolve Travis CI timeout limits by splitting plugin integration tests into separate runs, reducing overall build duration. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #1275 ci: run plugin integration tests in separate jobs | craft-parts | merged | Merged. Splits plugin integration tests into separate CI jobs to accelerate pipeline execution, isolate results for plugin authors, and reduce dependency conflicts. Approved by two reviewers with all checks passing. Resolves CRAFT-4767. | |
| #2614 [WIP] travis-ci: split spread tests to reduce job times | snapcraft | closed | Closed without merging. The Travis CI spread test split failed to reduce job times due to existing worker logic. The author abandoned the PR in favor of PR #2615, which implements the correct optimization. | |
| #1638 tests: reorganize unit and integration suites to make them easier to split for travis | snapcraft | merged | Merged following two approvals. Reorganized unit and integration test suites to facilitate splitting for Travis CI. A transient CI network error was observed but did not prevent the merge. | |
| #1272 ci: run plugin tests separately | craft-parts | closed | Merged to update CI configuration for running plugin tests separately. The pull request modified three files (+22/-2 lines), passed all continuous integration checks, and required no reviewer changes. | |
| #1716 tests: split the integration autopkgtests | snapcraft | merged | Merged after splitting integration autopkgtests to eliminate timeout failures. The change adds minor per-test setup overhead but resolves recurring execution timeouts. Approved by two reviewers with passing CI checks. | |
| #107 ci: separate unit and integration tests | starbase | merged | Merged into main after approval and passing CI checks. The PR separated unit and integration tests in the CI pipeline, modifying two files (+46/-7 lines). Code coverage remained unchanged at 100%. | |
| #2217 Travis test | snapcraft | merged | Merged after approval. Updated Travis CI configuration across 26 files, reducing 483 lines. A Codecov base commit warning appeared but did not prevent the merge. | |
| #2057 tests: extract lifecycle suite from general suite | snapcraft | merged | Merged changes extracting the lifecycle test suite from the oversized general suite to resolve Travis CI timeouts. The refactor splits tests across 19 files, successfully addressing the timeout issue. | |
| #7 tools: Split unit and integration tests | starbase | merged | Merged changes splitting unit and integration tests into separate directories. Approved by one reviewer. The update modifies six files, adding 33 net lines. The integration folder was created solely for structural separation. |