← Back to issue list

Set up weekly tests for tests that don't need to run on each PR

View original Github issue

Metadata

Project
craft-providers
Number
#765
Type
issue
State
open
Author
lengau
Labels
Type: Enhancement
Created
Updated
Closed
—

Current evaluation

Enhancement request to add weekly Linux integration tests. Weekly test workflow exists but only covers macOS; Linux tests and full base coverage remain incomplete.

Suggested action: keep open

Reason: The issue is a valid enhancement request that remains relevant: the weekly test workflow exists but only covers macOS (integration-macos and integration-slow-macos jobs), while the issue specifically requests Linux integration tests. The code in tests/integration/test_relaunch.py still references this issue with a comment saying 'We should enable all of these for weekly tests' (line 43), confirming the work is incomplete.

Impact: 50 Quick Win: 30.0 Staleness: 65 Complexity: 40 Confidence: 70 Support Request: 10

Issue body

### What needs to get done We should have a job in our weekly test job that runs integration tests on Linux that don't need to run all the time. For example, this would test the snap installer integration tests on all bases (not just core22), test relaunching instances with all bases, etc. ### Why it needs to get done Currently we have a lot of combinations that aren't tested. They don't need to delay PRs, but they could begin to break, in which case we should be notified and fix them.

Evaluation history

Date Model Scores Action Summary
qwen3.6-35b-a3b-mtp-q6
Impact: 50
Quick Win: 30.0
Staleness: 65
Complexity: 40
Confidence: 70
Support Request: 10
keep open Enhancement request to add weekly Linux integration tests. Weekly test workflow exists but only covers macOS; Linux tests and full base coverage remain incomplete.
qwen/qwen3.6-35b-a3b
Staleness: 45
Complexity: 60
Confidence: 85
Support Request: 0
keep open Request to add weekly integration tests for scenarios not required per PR to prevent regressions. Currently awaiting implementation.
qwen3.6-35b-a3b-mtp-q6
Staleness: 70
Complexity: 20
Confidence: 80
Support Request: 0
keep open Maintainer-requested enhancement to add a weekly CI job for integration tests that do not require PR gating. Currently unassigned and inactive for approximately 81 days.
qwen3.6-35b-a3b-mtp-q6
Staleness: 65
Complexity: 30
Confidence: 75
Support Request: 5
needs triage Enhancement to add a weekly CI job for integration tests that don't need to run on every PR. Currently inactive with only an automated Jira sync comment and no maintainer triage or assignment.

Update history

No update history recorded yet.

Related work

  • Related To: craft-providers#765 (confidence 95%)

    This is the issue itself - the test_relaunch.py file explicitly references it with a TODO comment to enable all bases for weekly tests.

Related issues

No related issues found above the similarity threshold.