← Back to issue list

Execute spread testing

View original Github issue

Metadata

Project
craft-application
Number
#613
Type
issue
State
closed
Author
cmatsuoka
Labels
—
Created
Updated
Closed

Current evaluation

Implemented a service to execute spread tests for craft projects. The feature was completed and merged via pull request #694 in the canonical/craft-application repository.

Suggested action: —

No scores available.

Issue body

### What needs to get done Add a service that takes the test specification file (craft-specific spread.yaml) and executes the necessary tests. It may be necessary to specify an artifact to test, depending on the application (e.g. to test a pre-packed snap). ### Why it needs to get done We need an easy and standard way to test craft projects.

Evaluation history

Date Model Scores Action Summary
qwen/qwen3.6-35b-a3b — — Implemented a service to execute spread tests for craft projects. The feature was completed and merged via pull request #694 in the canonical/craft-application repository.
qwen/qwen3.8-27b
Impact: 20
Quick Win: 8.0
Staleness: 78
Complexity: 60
Confidence: 90
Support Request: 0
close stale Task to add a service executing spread tests from a craft-specific spread.yaml with optional artifact. Implemented via TestingService and the 'test' command (PR #694); spread.yaml since deprecated for <app-name>-test.yaml. Stale since 2025, only a bot comment.
qwen/qwen3.6-35b-a3b
Staleness: 90
Complexity: 65
Confidence: 90
Support Request: 10
needs triage Feature request to add a service for executing spread testing on craft projects via a craft-specific spread.yaml. Unlabelled, no maintainer response, inactive for over a year.
qwen3.6-35b-a3b-mtp-q6
Staleness: 80
Complexity: 65
Confidence: 85
Support Request: 10
needs triage Feature request to add a service for executing spread tests on craft projects. Unlabeled, no maintainer response, and inactive for over a year. Requires prioritization and triage to determine current relevance.
qwen3.6-35b-a3b-mtp-q6
Staleness: 75
Complexity: 60
Confidence: 90
Support Request: 0
needs triage Proposes a service to run spread tests using a craft-specific spread.yaml, optionally targeting artifacts like snaps. Open over a year, last active months ago, and synced to Jira CRAFT-3969. Currently inactive and awaiting triage or assignment.

Update history

Date Change
closed

Related issues

Issue Project State Summary Similarity
#16 tests: add spread support rockcraft merged Merged after approval and passing CI, adding spread support to tests per CRAFT-865.
77%
#291 Refactor spread testing to use spread extensions fetch-service closed Abandoned. The request to refactor spread testing was synced to internal Jira ticket CRAFT-3690 and closed without implementation. No code changes or resolution were provided.
76%
#3530 tests: manual spread task for MaaS (CRAFT-225) snapcraft merged Merged a manual spread task for MaaS (CRAFT-225). Approved by reviewer, passed CI, and successfully executed two spread tasks.
73%
#665 Start using `spread` for integration tests charmcraft closed Completed and merged via pull request #862, which implemented the spread infrastructure and added integration tests. The issue was closed after the changes were successfully integrated.
72%
#1386 fix: final spread test fixes for craft-application charmcraft merged Merged after approval by two reviewers. Resolves final spread test issues for craft-application across seven files, removing 127 lines and adding 104. Changes integrated into the main branch.
72%
#3561 spread tests: store metrics against staging (CRAFT-391) snapcraft merged Merged spread tests to store metrics against staging. Approved, passed CI, and added four lines without affecting coverage.
72%
#1325 test(spread): consolidate basic init/build tests charmcraft merged Merged after approval by two reviewers. Consolidates basic init and build spread tests across four files, reducing 80 lines and adding 28. Resolves CRAFT-2127.
71%
#775 feat: add support to spread test expressions craft-application merged Merged feature adding spread test expression support to the test command. Filters jobs by craft backend and CI host system. Approved by two reviewers and merged despite unreviewed commits and a failing OSV-scanner check. Fixes #748.
70%