tests: move the catkin integration tests to a separate suite
Metadata
Current evaluation
Merged after relocating catkin integration tests to a dedicated suite to prevent main suite timeouts. Approved by one reviewer, passed CI checks, and modified eight files. Similar refactoring planned for Python and Ruby tests.
Suggested action: —
No scores available.
Issue body
- [x] Have you followed the [guidelines for contributing](https://github.com/snapcore/snapcraft/blob/master/CONTRIBUTING.md)?
- [x] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
- [x] If this is a bugfix. Have you checked that there is a bug report open for the issue you are trying to fix on [bug reports](https://bugs.launchpad.net/snapcraft)?
- [x] If this is a new feature. Have you discussed the design on the [forum](https://forum.snapcraft.io)?
- [x] Have you successfully run `./runtests.sh static`?
- [x] Have you successfully run `./runtests.sh unit`?
-----
Applying the results of the discussion with @kyrofa earlier this week. This is not a nice solution, but none of the alternatives were nice either. We have some grand ideas to make the suite dynamic, but that's very complex.
I think that we will start hitting the timeouts often in the remaining plugins suite, so we probably will have to do the same for the python or ruby tests.
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| qwen/qwen3.6-35b-a3b | — | — | Merged after relocating catkin integration tests to a dedicated suite to prevent main suite timeouts. Approved by one reviewer, passed CI checks, and modified eight files. Similar refactoring planned for Python and Ruby tests. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged changes moving catkin integration tests to a separate suite to prevent main plugin suite timeouts, with plans to apply similar restructuring to python and ruby tests. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged changes that relocate catkin integration tests to a dedicated suite, preventing main suite timeouts. The author notes this is a temporary workaround pending a future dynamic test framework. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #2206 tests: add spread suite for catkin plugin | snapcraft | merged | Merged migration of Catkin plugin integration tests to a Spread suite, resolving Launchpad bug #1783828. Approved by one reviewer, passed CI, and maintained coverage across 37 files. | |
| #1731 demo tests: bump catkin timeout by a lot | snapcraft | merged | Merged. Increased Catkin test timeouts to prevent adt timeouts during priming and snapping. Approved by one reviewer, passed CI, and merged with minor changes to two files. Timeouts will be removed entirely soon. | |
| #1791 tests: python plugin integration tests moved to a separate suite | snapcraft | merged | Merged. Python plugin integration tests were split into a separate suite to prevent timeout failures in the main plugins test suite. Approved by reviewer, passed CI, and modified seven files. |