tests: python plugin integration tests moved to a separate suite
Metadata
Current evaluation
Merged. Python plugin integration tests were split into a separate suite to prevent timeout failures in the main plugins test suite. Approved by reviewer, passed CI, and modified seven files.
Suggested action: —
No scores available.
Issue body
The plugins suite is again causing time outs because it's too big.
We discussed about an ugly hack to split the suite, and we already applied it to the catkin plugin. Here we are doing the same for python, and we might have to do it again for ruby or catkin.
- [x] Have you followed the [guidelines for contributing](https://github.com/snapcore/snapcraft/blob/master/CONTRIBUTING.md)?
- [x] Have you signed the [CLA](http://www.ubuntu.com/legal/contributors/)?
- [x] If this is a bugfix. Have you checked that there is a bug report open for the issue you are trying to fix on [bug reports](https://bugs.launchpad.net/snapcraft)?
- [x] If this is a new feature. Have you discussed the design on the [forum](https://forum.snapcraft.io)?
- [x] Have you successfully run `./runtests.sh static`?
- [x] Have you successfully run `./runtests.sh unit`?
-----
Evaluation history
| Date | Model | Scores | Action | Summary |
|---|---|---|---|---|
| qwen/qwen3.6-35b-a3b | — | — | Merged. Python plugin integration tests were split into a separate suite to prevent timeout failures in the main plugins test suite. Approved by reviewer, passed CI, and modified seven files. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged. Python plugin integration tests were split into a separate suite to resolve timeouts in the oversized plugins test suite, mirroring a prior split applied to the catkin plugin. | |
| qwen3.6-35b-a3b-mtp-q6 | — | — | Merged. Python plugin integration tests were split into a separate suite to prevent timeout failures in the larger plugins test suite, following a similar approach used for the catkin plugin. |
Update history
No update history recorded yet.
Related issues
| Issue | Project | State | Summary | Similarity |
|---|---|---|---|---|
| #1944 tests: split the plugins tests in the same directory | snapcraft | merged | Merged. Fixes Python 3.6 unittest discovery crashes by restructuring plugin test directories, replacing a temporary workaround that relied on missing init files. Approved and merged with 24 files changed. | |
| #771 Python plugin improvements | snapcraft | merged | Merged Python plugin improvements after reviewer approval. Entry point conflicts were resolved via filesets and integration tests passed. Documentation and unit test updates remain pending but did not block the merge. | |
| #199 tests: refactor plugin dependency tests | craft-parts | merged | Merged after approval and passing CI. Refactored plugin dependency tests by replacing redundant fixtures with a fixture factory in conftest.py, optimizing 4 files. Addressed reviewer feedback regarding test configuration. | |
| #1716 tests: split the integration autopkgtests | snapcraft | merged | Merged after splitting integration autopkgtests to eliminate timeout failures. The change adds minor per-test setup overhead but resolves recurring execution timeouts. Approved by two reviewers with passing CI checks. | |
| #947 tests: deduplicate tests for python-based plugins | craft-parts | merged | Merged changes that deduplicate tests for Python-based plugins, resolving #935 and CRAFT-3807. Approved by three reviewers, passed CI, and modified six files with a net reduction of 98 lines. | |
| #1760 tests: move the catkin integration tests to a separate suite | snapcraft | merged | Merged after relocating catkin integration tests to a dedicated suite to prevent main suite timeouts. Approved by one reviewer, passed CI checks, and modified eight files. Similar refactoring planned for Python and Ruby tests. | |
| #389 plugins: refactor python plugin for subclassing | craft-parts | merged | Merged a refactor of the Python plugin to enable subclassing and method overriding for custom interpreter location logic. Approved by one reviewer, passed CI checks, and modified three files. | |
| #77 tests: add integration tests for application plugins (CRAFT-69) | craft-parts | merged | Merged integration tests for application plugins. Approved by two reviewers, passed CI checks, and added 203 lines across two files to verify plugin registration and functionality. |