[parser] find a better solution than pulling the entire wiki contents into memory

Metadata

Project: snapcraft (launchpad)
Number: #1599974
Type: issue
State: open
Author: ~joetalbott
Labels: wiki
Created: 2016-07-07 07:32 PM UTC
Updated: 2016-12-15 10:18 PM UTC
Closed: —

Current evaluation

Performance suggestion to stream wiki contents via a generator instead of loading them all into memory, targeting the old snapcraft wiki-based parts parser. 10 years old, zero comments, and the wiki parser no longer exists in the modern craft-parts-based codebase.

Suggested action: close stale

Reason: The issue targets the legacy wiki-based parts parser from snapcraft 1.x, which has been superseded by YAML-based parts (craft-parts); the current repo layout shows no wiki parser component, and the issue has had zero comments or maintainer engagement for ~10 years (last activity 3546 days ago). The proposed splitgen generator is moot since the code path it optimizes no longer exists.

Impact: 5 Quick Win: 3.5 Staleness: 95 Complexity: 30 Confidence: 70 Support Request: 10

Issue body

Facundo Batista recommends something along these lines for the part processing def splitgen(text, sep): pos_from = 0 while True: try: pos_to = text.index(sep, pos_from) except ValueError: yield text[pos_from:] break yield text[pos_from:pos_to] pos_from = pos_to + len(sep) test = [ 'foo', 'foo\n---\nbar', 'foo\n---\n', 'foo\n---\nbar\n---\n', 'foo\n---\n\n---\nbar\n---\n', ] for t in test: assert t.split("\n---\n") == list(splitgen(t, "\n---\n"))

Evaluation history

Date	Model	Scores	Action	Summary
2026-09-01 07:19 AM UTC	qwen/qwen3.8-27b	Impact: 5 Quick Win: 3.5 Staleness: 95 Complexity: 30 Confidence: 70 Support Request: 10	close stale	Performance suggestion to stream wiki contents via a generator instead of loading them all into memory, targeting the old snapcraft wiki-based parts parser. 10 years old, zero comments, and the wiki parser no longer exists in the modern craft-parts-based codebase.
2026-07-23 11:47 AM UTC	qwen/qwen3.6-35b-a3b	Staleness: 98 Complexity: 10 Confidence: 95 Support Request: 5	close stale	Suggests a memory-efficient string splitting generator for a wiki parser. Unaddressed for over 10 years with no maintainer interaction.
2026-07-22 12:18 PM UTC	qwen/qwen3.6-35b-a3b	Staleness: 98 Complexity: 15 Confidence: 90 Support Request: 10	close stale	Memory optimization suggestion for a wiki parser using a custom generator instead of loading full contents. Open for over 10 years with zero maintainer interaction or comments.
2026-07-09 06:00 PM UTC	qwen3.6-35b-a3b-mtp-q6	Staleness: 98 Complexity: 15 Confidence: 90 Support Request: 0	close stale	A decade-old suggestion to replace text.split() with a memory-efficient generator for parsing wiki content. Zero maintainer engagement or comments.
2026-06-20 02:37 PM UTC	qwen3.6-35b-a3b-mtp-q6	Staleness: 98 Complexity: 20 Confidence: 90 Support Request: 5	close stale	Proposes a streaming split generator to replace memory-heavy wiki parsing, avoiding full content loads. Open with zero comments and over nine years of inactivity, awaiting discussion and triage.

Update history

No update history recorded yet.

Related issues

No related issues found above the similarity threshold.