← Back to issue list

Create a workflow for testing dev environments

View original Github issue

Metadata

Project
starflow
Number
#85
Type
issue
State
open
Author
mr-cal
Labels
Type: Enhancement Status: Triaged
Created
Updated
Closed

Current evaluation

Enhancement to add a test-dev-environment.yaml GitHub workflow running make setup/lint/format/test/docs in clean LXD environments across a distro/arch matrix, plus a self-test workflow for starbase. Triaged and open; last activity 201 days ago noted a ty versioning edge case in make setup.

Suggested action: keep open

Reason: The issue is labelled Status: Triaged and Type: Enhancement, authored by a maintainer (mr-cal), and was still being actively discussed 201 days ago when @PraaneshSelvaraj reported a related edge case (ty versioning during make setup) while working on craft-providers. It is a scoped, valid enhancement with no evidence it has been implemented or superseded, so it should remain open.

Impact: 45 Quick Win: 20.25 Staleness: 55 Complexity: 55 Confidence: 55 Support Request: 5

Issue body

## Overview Our development environment should be tested across a variety of distros and architectures. ## Rationale Project maintainers rarely set up pristine development environments, so we rarely experience what it's like for new contributors to follow our [getting started guides](https://github.com/canonical/snapcraft/blob/main/CONTRIBUTING.md#set-up-for-development). ## Specification * Create a `test-dev-environment.yaml` workflow that runs: ```bash make setup make lint make format make test make docs ``` * Run the workflow in clean LXD environments. * Note that a github runner isn't a good environment, since it has tons of pre-installed software. * By default, the workflow should run 6 tests with the matrix: * distros * Ubuntu 22.04 * Ubuntu 24.04 * Debian Trixie * architectures: * amd64 * arm64 * The distros and architectures should be configurable inputs, similar to other workflows ([example](https://github.com/canonical/starflow/blob/b447744488c725ad99f00498b85ddec3edce2f4a/.github/workflows/test-python.yaml#L4)) * Create a `self-test-dev-environment.yaml` workflow that clones starbase and runs the `test-dev-environment.yaml` workflow * Use this workflow in starbase (https://github.com/canonical/starbase/issues/438)

Evaluation history

Date Model Scores Action Summary
qwen/qwen3.8-27b
Impact: 45
Quick Win: 20.25
Staleness: 55
Complexity: 55
Confidence: 55
Support Request: 5
keep open Enhancement to add a test-dev-environment.yaml GitHub workflow running make setup/lint/format/test/docs in clean LXD environments across a distro/arch matrix, plus a self-test workflow for starbase. Triaged and open; last activity 201 days ago noted a ty versioning edge case in make setup.
qwen/qwen3.6-35b-a3b
Staleness: 45
Complexity: 55
Confidence: 85
Support Request: 10
keep open Request to create GitHub Actions workflows testing development environments across multiple Linux distributions and architectures using LXD. Currently triaged, with recent discussion on dependency versioning edge cases.
qwen3.6-35b-a3b-mtp-q6
Staleness: 55
Complexity: 40
Confidence: 75
Support Request: 10
keep open Enhancement to create a GitHub Actions workflow testing dev environments across distros and architectures using LXD. Currently triaged but inactive for ~5 months, with a recent comment noting a ty versioning edge case in make setup.
qwen3.6-35b-a3b-mtp-q6
Staleness: 55
Complexity: 40
Confidence: 80
Support Request: 5
keep open GitHub Actions workflow to test dev environments across Ubuntu and Debian on amd64 and arm64 using clean LXD containers. Triaged. A contributor flagged a ty versioning edge case during setup that impacts lint consistency.

Update history

No update history recorded yet.

Related work

  • Related To: canonical/starbase#438 (confidence 70%)

    Explicitly referenced in the issue body as the place the new self-test-dev-environment.yaml workflow should be used.

Related issues

Issue Project State Summary Similarity
#127 feat: Create workflow for testing dev environments starflow open WIP workflow creating LXD containers in GitHub Actions to test makefile dev-environment commands, referenced as work for #85. No maintainer review, CLA check failing, author notes it fails when run; no activity for 143 days.
72%