← Back to issue list

feat: add test-pr skill for testing PRs across downstream repos

View original Github issue

Metadata

Project
starflow
Number
#201
Type
pull request
State
open
Author
lengau
Labels
—
Created
Updated
Closed
—

Current evaluation

Adds a test-pr agent skill to automate downstream CI integration testing across 17 team repositories. CI passing, awaiting maintainer review with no unresolved comments.

Suggested action: needs review

Reason: CI is fully passing with no failing or pending checks, the author has responded to prior feedback (breaking into separate steps per @lengau's comment), and there are 0 unresolved review comments. The PR is ready for maintainer review but has 0 reviewers assigned and is still pending review.

Evaluated by: mr-cal-bot

Impact: 65 Quick Win: 27 Complexity: 45 Confidence: 75 Actionability: 75

Issue body

This PR introduces the `test-pr` agent skill in `.github/skills/test-pr/` to automate downstream CI integration testing across all team repositories. ### Downstream Test PRs | Repository | Draft PR | Test Workflow Runs | | :--- | :--- | :--- | | **canonical/charmcraft** | [#2954](https://github.com/canonical/charmcraft/pull/2954) | [Check policy](https://github.com/canonical/charmcraft/actions/runs/38664054853), [QA](https://github.com/canonical/charmcraft/actions/runs/38664055139), [Check policy](https://github.com/canonical/charmcraft/actions/runs/38663601796), [QA](https://github.com/canonical/charmcraft/actions/runs/38663601808), [Running Copilot Code Review](https://github.com/canonical/charmcraft/actions/runs/38663087703), [Schema](https://github.com/canonical/charmcraft/actions/runs/38663077879), [Check policy](https://github.com/canonical/charmcraft/actions/runs/38663078487), [QA](https://github.com/canonical/charmcraft/actions/runs/38663078309) | | **canonical/craft-application** | [#1226](https://github.com/canonical/craft-application/pull/1226) | [Copilot Setup Steps](https://github.com/canonical/craft-application/actions/runs/38664502441), [Check policy](https://github.com/canonical/craft-application/actions/runs/38664049266), [QA](https://github.com/canonical/craft-application/actions/runs/38664049550), [QA](https://github.com/canonical/craft-application/actions/runs/38663626685), [Check policy](https://github.com/canonical/craft-application/actions/runs/38663626943), [Running Copilot Code Review](https://github.com/canonical/craft-application/actions/runs/38663116296), [QA](https://github.com/canonical/craft-application/actions/runs/38663107403), [Spread](https://github.com/canonical/craft-application/actions/runs/38663107068), [Check policy](https://github.com/canonical/craft-application/actions/runs/38663107379) | | **canonical/craft-archives** | [#266](https://github.com/canonical/craft-archives/pull/266) | [Check policy](https://github.com/canonical/craft-archives/actions/runs/38664042623), [QA](https://github.com/canonical/craft-archives/actions/runs/38664042555), [Check policy](https://github.com/canonical/craft-archives/actions/runs/38663637866), [QA](https://github.com/canonical/craft-archives/actions/runs/38663637442), [Running Copilot Code Review](https://github.com/canonical/craft-archives/actions/runs/38663138998), [QA](https://github.com/canonical/craft-archives/actions/runs/38663128951), [Check policy](https://github.com/canonical/craft-archives/actions/runs/38663128934) | | **canonical/craft-cli** | [#503](https://github.com/canonical/craft-cli/pull/503) | [QA](https://github.com/canonical/craft-cli/actions/runs/38664041290), [Check policy](https://github.com/canonical/craft-cli/actions/runs/38664041289), [Check policy](https://github.com/canonical/craft-cli/actions/runs/38663652701), [QA](https://github.com/canonical/craft-cli/actions/runs/38663652564), [QA](https://github.com/canonical/craft-cli/actions/runs/38663148116), [Check policy](https://github.com/canonical/craft-cli/actions/runs/38663148055), [Running Copilot Code Review](https://github.com/canonical/craft-cli/actions/runs/38662604121), [QA](https://github.com/canonical/craft-cli/actions/runs/38662595601), [Check policy](https://github.com/canonical/craft-cli/actions/runs/38662595672) | | **canonical/craft-grammar** | [#224](https://github.com/canonical/craft-grammar/pull/224) | [Check policy](https://github.com/canonical/craft-grammar/actions/runs/38664040011), [QA](https://github.com/canonical/craft-grammar/actions/runs/38664039985), [Check policy](https://github.com/canonical/craft-grammar/actions/runs/38663666259), [QA](https://github.com/canonical/craft-grammar/actions/runs/38663666210), [Running Copilot Code Review](https://github.com/canonical/craft-grammar/actions/runs/38663168695), [QA](https://github.com/canonical/craft-grammar/actions/runs/38663160715), [Check policy](https://github.com/canonical/craft-grammar/actions/runs/38663160545) | | **canonical/craft-parts** | [#1771](https://github.com/canonical/craft-parts/pull/1771) | [Check policy](https://github.com/canonical/craft-parts/actions/runs/38664048335), [QA](https://github.com/canonical/craft-parts/actions/runs/38664048459), [QA](https://github.com/canonical/craft-parts/actions/runs/38663696598), [Check policy](https://github.com/canonical/craft-parts/actions/runs/38663696507), [Running Copilot Code Review](https://github.com/canonical/craft-parts/actions/runs/38663195474), [Check policy](https://github.com/canonical/craft-parts/actions/runs/38663184373), [QA](https://github.com/canonical/craft-parts/actions/runs/38663184239) | | **canonical/craft-platforms** | [#281](https://github.com/canonical/craft-platforms/pull/281) | [QA](https://github.com/canonical/craft-platforms/actions/runs/38664041585), [Check policy](https://github.com/canonical/craft-platforms/actions/runs/38664041997), [Security scan](https://github.com/canonical/craft-platforms/actions/runs/38664041941), [Running Copilot Code Review](https://github.com/canonical/craft-platforms/actions/runs/38663221845), [QA](https://github.com/canonical/craft-platforms/actions/runs/38663211534), [Check policy](https://github.com/canonical/craft-platforms/actions/runs/38663211354), [Security scan](https://github.com/canonical/craft-platforms/actions/runs/38663211438) | | **canonical/craft-providers** | [#1025](https://github.com/canonical/craft-providers/pull/1025) | [Check policy](https://github.com/canonical/craft-providers/actions/runs/38664044642), [QA](https://github.com/canonical/craft-providers/actions/runs/38664044573), [weekly-tests](https://github.com/canonical/craft-providers/actions/runs/38664044439), [Running Copilot Code Review](https://github.com/canonical/craft-providers/actions/runs/38663248368), [weekly-tests](https://github.com/canonical/craft-providers/actions/runs/38663235018), [QA](https://github.com/canonical/craft-providers/actions/runs/38663235441), [Check policy](https://github.com/canonical/craft-providers/actions/runs/38663235423) | | **canonical/craft-store** | [#443](https://github.com/canonical/craft-store/pull/443) | [Check policy](https://github.com/canonical/craft-store/actions/runs/38664043102), [QA](https://github.com/canonical/craft-store/actions/runs/38664043138), [Running Copilot Code Review](https://github.com/canonical/craft-store/actions/runs/38663271929), [QA](https://github.com/canonical/craft-store/actions/runs/38663263272), [Check policy](https://github.com/canonical/craft-store/actions/runs/38663263495) | | **canonical/debcraft** | [#207](https://github.com/canonical/debcraft/pull/207) | [Check policy](https://github.com/canonical/debcraft/actions/runs/38664040373), [QA](https://github.com/canonical/debcraft/actions/runs/38664040382), [Running Copilot Code Review](https://github.com/canonical/debcraft/actions/runs/38663299621), [Schema](https://github.com/canonical/debcraft/actions/runs/38663288991), [QA](https://github.com/canonical/debcraft/actions/runs/38663289543), [Check policy](https://github.com/canonical/debcraft/actions/runs/38663289252) | | **canonical/fetch-service** | [#667](https://github.com/canonical/fetch-service/pull/667) | [Sync to Launchpad](https://github.com/canonical/fetch-service/actions/runs/38664494083), [Security scan](https://github.com/canonical/fetch-service/actions/runs/38664043963), [Running Copilot Code Review](https://github.com/canonical/fetch-service/actions/runs/38663378788), [Tests](https://github.com/canonical/fetch-service/actions/runs/38663308953), [cla-check](https://github.com/canonical/fetch-service/actions/runs/38663308935), [Security scan](https://github.com/canonical/fetch-service/actions/runs/38663309254), [Sync to Launchpad](https://github.com/canonical/fetch-service/actions/runs/38663302056) | | **canonical/imagecraft** | [#500](https://github.com/canonical/imagecraft/pull/500) | [Check policy](https://github.com/canonical/imagecraft/actions/runs/38664049322), [QA](https://github.com/canonical/imagecraft/actions/runs/38664049275), [Running Copilot Code Review](https://github.com/canonical/imagecraft/actions/runs/38663330138), [Check policy](https://github.com/canonical/imagecraft/actions/runs/38663322793), [Run a spread test of the generated snap](https://github.com/canonical/imagecraft/actions/runs/38663322321), [Snap](https://github.com/canonical/imagecraft/actions/runs/38663322467), [QA](https://github.com/canonical/imagecraft/actions/runs/38663322737) | | **canonical/pydantic-kitbash** | [#181](https://github.com/canonical/pydantic-kitbash/pull/181) | [QA](https://github.com/canonical/pydantic-kitbash/actions/runs/38664043130), [Check policy](https://github.com/canonical/pydantic-kitbash/actions/runs/38664043052), [Running Copilot Code Review](https://github.com/canonical/pydantic-kitbash/actions/runs/38663352319), [Zizmor](https://github.com/canonical/pydantic-kitbash/actions/runs/38663343687), [QA](https://github.com/canonical/pydantic-kitbash/actions/runs/38663344241), [Check policy](https://github.com/canonical/pydantic-kitbash/actions/runs/38663344255) | | **canonical/rockcraft** | [#1390](https://github.com/canonical/rockcraft/pull/1390) | [Check policy](https://github.com/canonical/rockcraft/actions/runs/38664051641), [QA](https://github.com/canonical/rockcraft/actions/runs/38664051747), [Pull Request Labeler](https://github.com/canonical/rockcraft/actions/runs/38664049125), [Running Copilot Code Review](https://github.com/canonical/rockcraft/actions/runs/38663378351), [Check policy](https://github.com/canonical/rockcraft/actions/runs/38663369432), [QA](https://github.com/canonical/rockcraft/actions/runs/38663369194), [Spread tests for source](https://github.com/canonical/rockcraft/actions/runs/38663368974), [Spread (manual - large/flaky)](https://github.com/canonical/rockcraft/actions/runs/38663368968), [Schema](https://github.com/canonical/rockcraft/actions/runs/38663369021), [Pull Request Labeler](https://github.com/canonical/rockcraft/actions/runs/38663369253) | | **canonical/snapcraft** | [#6496](https://github.com/canonical/snapcraft/pull/6496) | [Running Copilot Code Review](https://github.com/canonical/snapcraft/actions/runs/38664078750), [Check policy](https://github.com/canonical/snapcraft/actions/runs/38664066851), [QA](https://github.com/canonical/snapcraft/actions/runs/38664066790) | | **canonical/starbase** | [#634](https://github.com/canonical/starbase/pull/634) | [Copilot Setup Steps](https://github.com/canonical/starbase/actions/runs/38664498258), [Running Copilot Code Review](https://github.com/canonical/starbase/actions/runs/38664060867), [Check policy](https://github.com/canonical/starbase/actions/runs/38664049055), [QA](https://github.com/canonical/starbase/actions/runs/38664049039) |

Evaluation history

Date Model Scores Action Summary
qwen/qwen3.6-35b-a3b
Impact: 65
Quick Win: 27
Complexity: 45
Confidence: 75
Actionability: 75
needs review Adds a test-pr agent skill to automate downstream CI integration testing across 17 team repositories. CI passing, awaiting maintainer review with no unresolved comments.

Update history

Date Change
updated
updated
updated
updated
updated
created

Related issues

Issue Project State Summary Similarity
#1584 feat: Add agent skill to create new plugins craft-parts open Maintainer-authored feat adding a .github/skills agent skill (SKILL.md plus references, +2387/-0, 27 files) to guide writing new build-system plugins. No reviews yet; CI red on lint/files, minimum-deps and all test-other-plugins slow jobs, 7 unresolved review comments.
71%