← Back to issue list

Build python packages with multiple threads

View original Github issue

Metadata

Project
charmcraft
Number
#1159
Type
issue
State
open
Author
dstathis
Labels
—
Created
Updated
Closed
—

Current evaluation

Maintainer-acknowledged request to speed source-only Python dependency builds with parallel pip compilation; Charmcraft’s parallel-build count is not yet wired to pip or MAKEFLAGS.

Suggested action: keep open

Reason: Maintainer lengau explicitly said the request “definitely makes sense” and identified it as work to coordinate with #1140 and potentially implement in craft-parts. The existing build environment exposes CRAFT_PARALLEL_BUILD_COUNT and several craft-parts plugins use it, but Charmcraft’s Poetry plugin still invokes pip without parallel build options, so the performance gap remains.

Evaluated by: mr-cal-bot

Impact: 50 Quick Win: 16 Complexity: 51 Confidence: 91 Actionability: 66

Issue body

### What needs to get done It would be really nice to tell charmcraft to use multiple threads for pip. This is normally done with `MAKEFLAGS="-j4" pip install --no-binary ...` for example. It would be great to have a flag for number of threads or, even better, to simply pass the value of `MAKEFLAGS` into the container so the user could set whatever they want. ### Why it needs to get done Some packages take a *really* long time to build.

Evaluation history

Date Model Scores Action Summary
stealth/space-bunny-alpha
Impact: 50
Quick Win: 16
Complexity: 51
Confidence: 91
Actionability: 66
keep open Maintainer-acknowledged request to speed source-only Python dependency builds with parallel pip compilation; Charmcraft’s parallel-build count is not yet wired to pip or MAKEFLAGS.
qwen/qwen3.6-35b-a3b
Impact: 65
Quick Win: 25
Complexity: 45
Confidence: 75
Actionability: 70
keep open Feature request to enable parallel pip install for faster Python package builds. Maintainer acknowledged; craft-parts has parallel_build_count for other build systems but not pip.
qwen/qwen3.8-27b
Impact: 35
Quick Win: 16
Staleness: 70
Complexity: 55
Confidence: 70
Support Request: 10
keep open Feature request to build Python packages from source with parallel threads (e.g. MAKEFLAGS/-j) in charmcraft. Maintainer acknowledged in 2023 and flagged design questions around mixed build systems; no label, no further activity for over a year.
qwen/qwen3.6-35b-a3b
Staleness: 75
Complexity: 60
Confidence: 80
Support Request: 10
keep open Feature request to add a flag for controlling pip build threads or passing MAKEFLAGS to speed up package builds. Acknowledged by a maintainer but inactive for 11 months with no labels or assignee.
qwen3.6-35b-a3b-mtp-q6
Staleness: 85
Complexity: 45
Confidence: 65
Support Request: 10
needs triage Feature request to enable parallel builds for Python packages in charmcraft via a flag or passing MAKEFLAGS. Open ~3 years with a maintainer comment 10 months ago discussing implementation complexity. Lacks labels and assignee.
qwen3.6-35b-a3b-mtp-q6
Staleness: 85
Complexity: 65
Confidence: 75
Support Request: 10
close stale Feature request to enable multi-threaded pip builds in charmcraft via flags or environment variables. Open for ~3 years with a maintainer comment requesting architectural input, but no further progress or labels.

Update history

No update history recorded yet.

Related work

  • Related To: charmcraft#1140 (confidence 95%)

    The maintainer explicitly requested coordination with #1140; that dependency-management redesign moved Python dependency handling toward the Python and Poetry plugins.

Related issues

No related issues found above the similarity threshold.