← Back to issue list

test(spread): mark doc tests as manual

View original Github issue

Metadata

Project
rockcraft
Number
#801
Type
pull request
State
open
Author
tigarmo
Labels
Created
Updated
Closed

Current evaluation

Marks doc spread tests as manual so they don't run on every code change. Pending review, 0 comments, no CI. Docs tests now run via a separate conditional workflow (spread-docs.yaml) on a weekly schedule and only when docs code changes.

Suggested action: needs review

Reason: The PR (577 days old, last activity 381 days ago, 0 comments, pending review) aims to mark doc spread tests as manual to avoid running them on every code change. However, the current repo already has a separate .github/workflows/spread-docs.yaml that runs docs spread tests conditionally (on a weekly cron and only when docs/**/code/** changes), and the docs suites in spread.yaml are not marked manual. This suggests the goal may have been achieved via a different mechanism, so a maintainer should confirm whether this PR is still needed or superseded before merging or closing.

Impact: 30 Quick Win: 22.5 Staleness: 72 Complexity: 25 Confidence: 55

Issue body

These tests take a disproportional amount of time to run, and don't need to run on every code change. - [ ] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)? ---

Evaluation history

Date Model Scores Action Summary
qwen/qwen3.8-27b
Impact: 30
Quick Win: 22.5
Staleness: 72
Complexity: 25
Confidence: 55
needs review Marks doc spread tests as manual so they don't run on every code change. Pending review, 0 comments, no CI. Docs tests now run via a separate conditional workflow (spread-docs.yaml) on a weekly schedule and only when docs code changes.
qwen/qwen3.6-35b-a3b
Staleness: 90
Complexity: 15
Confidence: 85
close stale Marks documentation spread tests as manual to reduce CI execution time. Inactive for over a year, lacks CLA and CI runs, and test configuration has likely evolved since submission.
qwen3.6-35b-a3b-mtp-q6
Staleness: 95
Complexity: 5
Confidence: 85
close stale Marks documentation tests as manual to reduce CI execution time. PR has been inactive for over 326 days with no review or CI feedback.
qwen3.6-35b-a3b-mtp-q6
Staleness: 95
Complexity: 5
Confidence: 85
close stale Marks spread documentation tests as manual to reduce CI execution time. The PR has been inactive for over 323 days with no reviews or CI status.
qwen3.6-35b-a3b-mtp-q6
Staleness: 90
Complexity: 10
Confidence: 85
close stale Marks spread doc tests as manual to reduce CI run time. Open for 500 days with zero comments and no activity for 304 days. Requires triage and maintainer review to merge or close.

Update history

No update history recorded yet.

Related issues

Issue Project State Summary Similarity
#143 docs: make docs spread-testable craft-store merged Merged documentation spread-testing infrastructure setup. Approved by two reviewers and passing CI, the change modifies six files (+136/-41 lines) to enable local spread test execution for documentation.
78%
#2126 ci(docs): spread test documentation charmcraft merged Merged changes adding a CI workflow for spread testing documentation and adjusting tasks for Google runners. Approved by two reviewers, the update modifies five files (+100/-22 lines) and resolves CRAFT-3798.
76%
#1206 ci: make workflows conditional, add docs-only spread tests rockcraft merged Merged after approval. Updates CI workflows to run conditionally on changed files, splitting source and documentation spread tests into separate runners. Predictable initial failures were acknowledged, and the changes were merged.
73%
#5434 ci: add check for each manual spread test job snapcraft merged Merged CI configuration changes adding explicit checks for manual spread test jobs. This prevents jobs from incorrectly showing as skipped when the manual label is absent. Approved by reviewers and passed all CI checks.
72%
#6245 ci: make workflows conditional, add docs-only spread tests snapcraft merged Merged. Configured CI workflows to run conditionally based on changed files, separating source and documentation pipelines. Added a docs-only spread test workflow. Approved and merged.
72%
#1287 tests: minor cleanups on the spread tests snapcraft merged Merged minor spread test cleanups into master. Modified four files with 16 additions and 6 deletions. Approved by one reviewer with zero unresolved comments, maintaining 95.27% coverage upon integration.
71%
#4433 tests(spread): add remote-build spread test snapcraft merged Merged changes adding spread tests for new and legacy remote-build, resolving issue #4398. Approved by two reviewers with passing CI checks.
70%
#534 test(spread): workaround for flaky test fetch-service merged Merged a workaround for a flaky spread test (issue #533). The change adjusts one file (+2/-1 lines) to skip a no-op name query check while retaining other validations. Approved by two reviewers and passed all CI checks.
70%