The plainbox-provider plug should run "validate" during the build step
Metadata
Current evaluation
Plainbox provider validation was added during builds by snapcore/snapcraft#1095, commit 725546824.
Resolution: closed resolved
Reason: PR snapcore/snapcraft#1095 implemented the requested validation and was recorded as commit 725546824 ("plainbox-provider plugin: run validate").
Evaluated by: mr-cal-bot
No scores available.
Issue body
The provider management script in plainbox has a command called "validate" that reports errors in job definitions that must be fixed for the provider to be parsed and run correctly by Checkbox.
http://checkbox.readthedocs.io/en/latest/snappy.html#check-your-test-is-valid
The plugin should run this command prior to build to give the developer confidence their snap will run correctly.
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| stealth/space-bunny-alpha | — | closed resolved | Plainbox provider validation was added during builds by snapcore/snapcraft#1095, commit 725546824. | |
| stealth/space-bunny-alpha | — | closed resolved | Implemented and merged in snapcraft PR #1095 (commit 725546824, "plainbox-provider plugin: run validate"), adding build-time plainbox validate plus PROVIDERPATH support and an integration test. Issue closed by maintainer elopio. | |
| stealth/space-bunny-alpha | — | closed resolved | Build-time plainbox validation was implemented by merged PR canonical/snapcraft#1095 (commit 725546824), which also added PROVIDERPATH support and an integration test. | |
| qwen/qwen3.6-35b-a3b | — | — | The request to run plainbox validate during the build step was closed without implementation. Zero comments and prolonged inactivity indicate the feature request was abandoned. | |
| qwen/qwen3.6-35b-a3b | — | — | Closed without implementation. The request to run the plainbox-provider validate command during the build step was abandoned, with no code changes or resolution applied. | |
| qwen/qwen3.6-35b-a3b | — | — | Closed without implementation or discussion. The request to run plainbox validate during the build step was abandoned. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Closed without implementation or comments. The proposal to execute plainbox validate during the plainbox-provider plug build step was abandoned. |
Update history
| Date | Change |
|---|---|
| created |
Related work
-
Likely Fixed By:
snapcore/snapcraft#1095
(confidence 99%)
The referenced PR added the plainbox-provider validate step and resolves the reported build validation gap.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #1095 Plainbox providers run validate | snapcraft | merged | Merged as commit 725546824, making plainbox-provider builds run validate with PROVIDERPATH support and an integration test to catch invalid providers and jobs. | |
| #1722833 plainbox-provider plugin: validation of the first provider in a snap can fail based on host system configuration | snapcraft (launchpad) | closed | Host-dependent plainbox-provider validation failure was fixed by merged snapcraft PR #1611 (commit 467e3f040, "plainbox-provider plugin: init PROVIDERPATH"), which initializes PROVIDERPATH so host provider/test definitions can't leak into the build. | |
| #1552369 Add a plugin for Plainbox Providers | snapcraft (launchpad) | closed | Upstream Plainbox Provider support was merged via canonical/snapcraft#609 (commit 2b8ace75b), adding the plugin and Checkbox integration tests. |