test(spread): test real chisel run with updates and security pockets
Metadata
Current evaluation
Merged #656, expanding the Chisel spread test to run curl across base, updates, and security pockets, clean artifacts, verify curl in chroot, and record approved package metadata.
Resolution: closed resolved
Reason: Pull request #656 was merged after approval, adding the real curl_bins test, cleanup handling, a chroot execution check, and assertions that Packages metadata was approved and recorded.
Evaluated by: mr-cal-bot
No scores available.
Issue body
- [x] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
-----
Extend the chisel inspector spread test to perform a real Chisel slice (`curl_bins`) that pulls dependencies across `noble`, `noble-updates`, and `noble-security` pockets:
- Add `prepare` and `restore` cleanup for artifacts, rootfs directories, and downloaded snaps.
- Verify that the resulting sliced binary is executable in the target root (`chroot root /usr/bin/curl --version`).
- Assert in the session report that `Packages` metadata from `noble-updates` or `noble-security` was approved and recorded.
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha | — | closed resolved | Merged #656, expanding the Chisel spread test to run curl across base, updates, and security pockets, clean artifacts, verify curl in chroot, and record approved package metadata. | |
| stealth/space-bunny-alpha | — | closed resolved | Merged test enhancement: the Chisel spread test now runs curl_bins across base, updates, and security pockets, cleans artifacts, verifies curl in chroot, and records approved Packages metadata. | |
| stealth/space-bunny-alpha |
Impact:
32
Quick Win:
15
Complexity:
28
Confidence:
91
Actionability:
65
|
needs review | Extends Chisel spread coverage to run curl_bins with update/security dependencies, clean artifacts, and verify chroot execution. Core checks pass; OSV-scanner fails and snap tests are pending. |
Update history
| Date | Change |
|---|---|
| merged | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| updated | |
| created |
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #13 test(spread): add more spread tests | snapcraft-rocks | merged | Merged PR #13 added Spread tests for architectures, Chisel slices, craftctl, package repositories, and patchelf (+206/-5 across 15 files). | |
| #456 fix(spread): tests must also use newer Chisel | rockcraft | merged | Merged as b3bc4d70 in PR #456: spread tests now install Chisel from the Snap Store instead of building a hardcoded commit, resolving failures exposed by chisel-releases#78. | |
| #466 fix(spread): tests must also use newer Chisel (#456) | rockcraft | merged | Merged the 1.1.2 cherry-pick of #456 (main commit b3bc4d70), updating spread tests to install newer Chisel from the Snap Store instead of a hardcoded build. | |
| #467 fix(spread): tests must also use newer Chisel (#456) (#466) | rockcraft | closed | Merged into the 1.1.2 release branch as a cherry-pick of #466, updating spread tests to use Chisel from the Snap Store; originating fix: #456, commit b3bc4d70. | |
| #1304 test(spread): fix cross-test contamination | rockcraft | merged | Merged PR #1304: spread variants shared the python-from-chisel-bare dir, causing cross-test contamination; each test now copies a clean rockcraft.yaml template in first (+6 lines, 2 files). | |
| #4795 tests: update chisel-base test to use core24 | snapcraft | merged | Updated the chisel-base spread test to use core24 after devel moved to Ubuntu 24.10; merged in commit 14622fd60 via PR #4795. | |
| #469 fix(spread): tests must also use newer Chisel (#456) (#466) | rockcraft | closed | Merged #469, backporting #456 as b3bc4d70 so spread tests use the newer Chisel from the Snap Store in the 1.1.2 release. |