← Back to issue list

Build python packages with multiple threads

View original Github issue

Metadata

Project
charmcraft
Number
#1159
Type
issue
State
open
Author
dstathis
Labels
—
Created
Updated
Closed
—

Current evaluation

Feature request to build Python packages from source with parallel threads (e.g. MAKEFLAGS/-j) in charmcraft. Maintainer acknowledged in 2023 and flagged design questions around mixed build systems; no label, no further activity for over a year.

Suggested action: keep open

Reason: Maintainer lengau explicitly triaged and endorsed the request ('This definitely makes sense, especially in coordination with #1140') and raised a real design question about mixed build systems, so it has maintainer buy-in despite 381 days of inactivity. The feature is still unimplemented (no MAKEFLAGS handling in charmcraft code) and the need persists since the python plugin still runs pip with --no-binary=:all: in strict mode; a partial workaround exists via the part's build-environment key, which lowers but does not eliminate the value of a dedicated option.

Impact: 35 Quick Win: 15.75 Staleness: 70 Complexity: 55 Confidence: 70 Support Request: 10

Issue body

### What needs to get done It would be really nice to tell charmcraft to use multiple threads for pip. This is normally done with `MAKEFLAGS="-j4" pip install --no-binary ...` for example. It would be great to have a flag for number of threads or, even better, to simply pass the value of `MAKEFLAGS` into the container so the user could set whatever they want. ### Why it needs to get done Some packages take a *really* long time to build.

Evaluation history

Date Model Scores Action Summary
qwen/qwen3.8-27b
Impact: 35
Quick Win: 15.75
Staleness: 70
Complexity: 55
Confidence: 70
Support Request: 10
keep open Feature request to build Python packages from source with parallel threads (e.g. MAKEFLAGS/-j) in charmcraft. Maintainer acknowledged in 2023 and flagged design questions around mixed build systems; no label, no further activity for over a year.
qwen/qwen3.6-35b-a3b
Staleness: 75
Complexity: 60
Confidence: 80
Support Request: 10
keep open Feature request to add a flag for controlling pip build threads or passing MAKEFLAGS to speed up package builds. Acknowledged by a maintainer but inactive for 11 months with no labels or assignee.
qwen3.6-35b-a3b-mtp-q6
Staleness: 85
Complexity: 45
Confidence: 65
Support Request: 10
needs triage Feature request to enable parallel builds for Python packages in charmcraft via a flag or passing MAKEFLAGS. Open ~3 years with a maintainer comment 10 months ago discussing implementation complexity. Lacks labels and assignee.
qwen3.6-35b-a3b-mtp-q6
Staleness: 85
Complexity: 65
Confidence: 75
Support Request: 10
close stale Feature request to enable multi-threaded pip builds in charmcraft via flags or environment variables. Open for ~3 years with a maintainer comment requesting architectural input, but no further progress or labels.
qwen3.6-35b-a3b-mtp-q6
Staleness: 85
Complexity: 50
Confidence: 75
Support Request: 10
close stale Request to pass MAKEFLAGS or a thread count to charmcraft for parallel pip builds, speeding up long Python package compilations. Implementation suggested for craft-parts. Open, awaiting team review and assignment.

Update history

No update history recorded yet.

Related work

  • Related To: canonical/charmcraft#1140 (confidence 80%)

    Referenced in the maintainer comment as coordination context for python dependency management; closed as a discussion/tracking issue with the pip redesign deferred.

Related issues

No related issues found above the similarity threshold.