← Back to issue list

spread: separate legacy tests

View original Github issue

Metadata

Project
snapcraft
Number
#4248
Type
pull request
State
closed
Author
lengau
Labels
—
Created
Updated
Closed

Current evaluation

PR #4248 was merged into main, separating legacy spread tests into dedicated GitHub Actions runs to reduce repeated test execution after failures.

Resolution: closed resolved

Reason: Repository metadata identifies snapcore/snapcraft#4248 as merged into main. The merged change split legacy spread tests into separate GitHub Actions runs, implementing the requested reduction in repeated test runs.

Evaluated by: mr-cal-bot

No scores available.

Issue body

The primary purpose of this is to place the tests into separate GitHub Actions runs, reducing the repeated test runs if a test fails. A little Python script reading the GHA logs reveals that the following groups of tests take the longest (in worker time, not actual time): 1. `plugins/v2/` (12443 s) 2. `providers/legacy/` (2942 s) 3. `plugins/craft-parts/` (2659 s) 4. `general/package-repositories/` (1181 s) 5. `general/pack/` (1044 s) The total time of the 20.04 runs is about 22000 s, so this splits the 20.04 run roughly in half, with the group that's likely to expand in time currently being smaller. - [x] Have you followed the [guidelines for contributing](https://github.com/snapcore/snapcraft/blob/master/CONTRIBUTING.md)? - [x] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)? - [x] Have you successfully run `make lint`? - [x] Have you successfully run `pytest tests/unit`? -----

Evaluation history

Date Model Scores Action Summary
stealth/space-bunny-alpha — closed resolved PR #4248 was merged into main, separating legacy spread tests into dedicated GitHub Actions runs to reduce repeated test execution after failures.
stealth/space-bunny-alpha — closed resolved Merged into main as #4248 (commit 3cb37a1), separating legacy spread tests into distinct GitHub Actions runs to reduce repeated runs after failures.
stealth/space-bunny-alpha — closed resolved Merged into main: PR #4248 (commit 3cb37a1) split legacy Spread tests into separate GitHub Actions runs to reduce repeated test execution.
stealth/space-bunny-alpha — closed resolved Merged into main via #4248, splitting legacy spread tests into separate GitHub Actions runs to reduce repeated test execution after a failure.
qwen/qwen3.6-35b-a3b — — Merged into main. The pull request separated legacy spread tests into dedicated GitHub Actions workflows to reduce redundant CI execution time and improve pipeline efficiency.
qwen3.6-35b-a3b-mtp-q6 — — Merged into main. Splits legacy spread tests into separate GitHub Actions workflows to reduce CI runtime and retry overhead. Codecov reported a 0.01% coverage increase upon integration.

Update history

No update history recorded yet.

Related issues

Issue Project State Summary Similarity
#4247 spread: separate legacy tests snapcraft closed Closed PR #4247 was superseded by merged PR #4248, which split legacy spread tests into separate GitHub Actions runs to reduce repeated work after failures.
96%
#2276 spread: move legacy wiki tests to spread snapcraft merged Merged PR #2276 as commit 806b0b0db, moving all non-fake-server legacy wiki tests from the general integration suite to Spread.
77%
#3432 spread tests: remove legacy plugin tests snapcraft merged PR #3432 (commit 950fa2508, f2c9caa04) merged: deleted 665 lines of legacy plugin spread tests across 29 files, removing outdated plugin coverage without affecting code coverage (90.83%).
76%
#3374 [wip] ci: migrate spread tests to github actions snapcraft closed WIP PR to migrate spread tests from Travis CI to GitHub Actions, closed unmerged. Superseded by PR #3375, merged as commit 6c59e9f55 with the identical +84/-6, 3-file change.
74%
#3375 ci: migrate spread tests to github actions snapcraft merged Merged #3375 moved spread tests from Travis CI to GitHub Actions, updating three CI files (+84/-6).
72%
#3966 Spread multipass tests snapcraft merged Merged #3966 as f787c56fe, moving manual Multipass Spread tests out of the legacy test directory while noting they cannot run on Google infrastructure.
72%
#2763 fix(tests/spread): fix reactive spread tests charmcraft merged Merged #2763 as 6e775f4a: split reactive spread coverage by legacy/Resolute, enabled binary wheels, and removed obsolete build flags.
72%
#895 ci: move prometheus test to spread charmcraft merged PR #895 moved the Prometheus test from GitHub Actions to Spread and was merged via 5487dfe6; implementation commit eb4b47b9.
72%
#291 Refactor spread testing to use spread extensions fetch-service closed Fixed by merged PR #299 (commit 44d9906), which refactored spread tests to generate spread.yaml and use the new spread extension framework.
71%
#519 spread: reorganize spread tests rockcraft merged Merged PR #519 as commit 90d85343, consolidating most spread tests in the renamed rockcraft suite on Jammy VMs and adding a foreign suite for cross-system tests.
71%