tests: add testcraft fake application and spread tests
Metadata
Current evaluation
Added the fake testcraft application, spread tests, and CI workflows in merged PR #666 (commit 621d1a32), resolving #97.
Resolution: closed resolved
Reason: The maintainer closed #97 with “Completed in #666.” PR #666 merged as commit 621d1a32 and introduced the testcraft application and spread-test setup.
Evaluated by: mr-cal-bot
No scores available.
Issue body
### What needs to get done
Add some basic spread tests running with a fake "testcraft" application
### Why it needs to get done
The main goal is to bridge the gap between integration tests in craft-application (which are useful but can never reproduce the "production" environment of an app) and the spread tests of one of our applications (which are the ultimate source of "right" and "wrong" but are _very_ expensive to run).
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha | — | closed resolved | Added the fake testcraft application, spread tests, and CI workflows in merged PR #666 (commit 621d1a32), resolving #97. | |
| stealth/space-bunny-alpha | — | closed resolved | Added the fake testcraft application, spread tests and CI workflows in merged PR #666 (commit 621d1a32), completing the planned testing bridge. | |
| stealth/space-bunny-alpha | — | closed resolved | Delivered the testcraft fake application and spread tests in merged PR #666 (commit 621d1a32), adding CI workflows, a reusable configuration template, and library-testing canaries. | |
| qwen/qwen3.6-35b-a3b | — | — | Implemented via PR #666. Added a fake testcraft application with spread tests and CI workflows to bridge integration and production testing environments, providing a configuration template and canary for craft libraries. | |
| qwen/qwen3.6-35b-a3b | — | — | Requested a fake testcraft application and spread tests to bridge integration and production testing gaps. Completed via pull request #666, providing a reusable template and canary for library changes. |
Update history
No update history recorded yet.
Related work
-
Likely Fixed By:
canonical/craft-application#666
(confidence 100%)
Merged PR #666 added the fake testcraft application, spread tests, and related CI workflow.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #109 tests: add testcraft fake application and spread tests | craft-application | closed | Closed as a duplicate of canonical/craft-application#97; the fake testcraft app and spread tests were delivered by merged PR #666 (commit 621d1a32). | |
| #16 tests: add spread support | rockcraft | merged | Merged PR #16 added Spread support for CRAFT-865 via commit 3aeba2b3 (merge commit 5bf2680a). | |
| #1325 test(spread): consolidate basic init/build tests | charmcraft | merged | Merged PR #1325 as commit 90e25caf, consolidating basic Spread init/build tests for CRAFT-2127 and reducing duplicated setup across four files. | |
| #386 tests: update testing to use craft-test | fetch-service | merged | Merged #386 as commit 323b0e1, replacing direct Spread calls with snapcraft test and updating the test base to core24. | |
| #943 test(spread): test on more bases | craft-application | merged | Merged PR #943: added an external Python runtime for testcraft and expanded Spread tests across multiple snap bases to detect base-specific bugs earlier. | |
| #944 test(spread): speed up the skip-retest spread test | craft-application | closed | PR #944 was closed unmerged and superseded by craft-application#964, which carried the spread-test speedup changes forward and merged the adjusted repack-test setup. | |
| #1272 tests: initial setup for the snapcraft snap tests with spread | snapcraft | merged | Merged PR #1272 as commit 545344442, adding initial Spread-based test infrastructure for the snapcraft snap. | |
| #1114 test: enable pro spread tests | craft-application | merged | Merged canonical/craft-application#1114, raising craft-providers to >=3.7.1 and re-enabling Ubuntu Pro spread tests. | |
| #6018 fix(craft-test): enable spread tests with 26.04 backends | snapcraft | merged | Merged #6018 as commit 3ac850650, documenting a temporary craft-test workaround that uses ubuntu-daily for Ubuntu 26.04 spread-test backends. | |
| #13 test(spread): add more spread tests | snapcraft-rocks | merged | Merged PR #13 added Spread tests for architectures, Chisel slices, craftctl, package repositories, and patchelf (+206/-5 across 15 files). |