Admin

LLM token usage

Token consumption by the LLM evaluation pipeline.

Last 7 days

Evaluations Total Tokens Input Tokens Output Tokens Avg Tokens per Eval
121,966 12,781,189 6,443,393 6,337,796 105

Lifetime

Evaluations Total Tokens Input Tokens Output Tokens Avg Tokens per Eval
980,999 183,422,407 75,124,664 108,297,743 187

LLM evaluation service

Status of the continuous evaluate worker, and its recent output.

Status

Running

Last poll

Last result

Issues needing evaluations

Never evaluated Eval version outdated Content changed since last eval
0 0 1,312

Daily evaluations (last 14 days)

Date Evaluations
2026-09-01 1,645
2026-09-03 68
2026-09-04 113
2026-09-05 204
2026-09-06 528
2026-09-07 661
2026-09-08 678
2026-09-09 624
2026-09-10 671
2026-09-11 629
2026-09-12 202

Recent evaluations

Project Issue Title Model Verdict When
snapcraft (launchpad) snapcraft (launchpad)
issue #1677002
closed
Catkin plugin: support needed for both python2 and python3 qwen/qwen3.6-35b-a3b Unknown
snapcraft (launchpad) snapcraft (launchpad)
issue #1674952
closed
snapcraft tour broken when installed from snap qwen/qwen3.6-35b-a3b Unknown
snapcraft (launchpad) snapcraft (launchpad)
issue #1671939
closed
build-packages doesn't support specifying a version qwen/qwen3.6-35b-a3b Unknown
snapcraft (launchpad) snapcraft (launchpad)
issue #1671546
closed
godeps plugin does not installing the git package by itself qwen/qwen3.6-35b-a3b Unknown
snapcraft (launchpad) snapcraft (launchpad)
issue #1669730
closed
No feedback for long running operation qwen/qwen3.6-35b-a3b Unknown
snapcraft (launchpad) snapcraft (launchpad)
issue #1666656
closed
stage-packages doesn't support versions qwen/qwen3.6-35b-a3b Unknown
snapcraft (launchpad) snapcraft (launchpad)
issue #1666488
closed
python plugin uses incorrect headers when using staged python qwen/qwen3.6-35b-a3b Unknown
snapcraft (launchpad) snapcraft (launchpad)
issue #1665661
closed
kernel plugin: remove MAKEFLAGS from the environment qwen/qwen3.6-35b-a3b Unknown
snapcraft (launchpad) snapcraft (launchpad)
issue #1665656
closed
kernel plugin: install all dtbs qwen/qwen3.6-35b-a3b Unknown
snapcraft (launchpad) snapcraft (launchpad)
issue #1665650
closed
Snapcraft: 96boards fixes qwen/qwen3.6-35b-a3b Unknown

Eval queue depth over time

Pending issues (queued for evaluation), sampled from worker polls of /api/eval/next. Only accumulates while some worker (in-cluster or remote) is actively polling.


Daily invalidations by signal

Rolling 7-day total: 0 invalidations.

Issues invalidated (evidence_generation bumped) per day by the commit scanner, broken out by which signal fired: an exact cross-repo reference, a changed evidence path, a semantic commit match, a same-repo bare #N reference, or a cross-source LP: #N Launchpad reference. Note: an issue matched by two signals in one pass is counted in both buckets but bumped once, so the stacked total overstates unique invalidations — the rolling total above is the honest headline.