Commits · f54428cfa2e1bc7f5b21f49a3b275066895cd48d · nexlab / coderai · GitLab

Aug 27, 2026
- vram: don't ratchet down a model's learned GPU-layer split under contention · f54428cf
  Stefy Lanza (nextime / spora ) authored Aug 27, 2026
  f54428cf
- logging: durable request-debug sink + non-silent engine log pump · ced55385
  Stefy Lanza (nextime / spora ) authored Aug 27, 2026
  ced55385
- config(multi-config): fix GGUF dispatch + per-config-id measured persistence · f9f2a373
  Stefy Lanza (nextime / spora ) authored Aug 27, 2026
  f9f2a373
- config: honor same-path multi-config at runtime (key siblings by alias) · 6ec4af1c
  Stefy Lanza (nextime / spora ) authored Aug 27, 2026
  6ec4af1c
- rerank: resolve model via embedding category to pass manager type-validation · b72896e5
  Stefy Lanza (nextime / spora ) authored Aug 27, 2026
  b72896e5
- deps: bump bitsandbytes to >=0.50.2 (fix 4-bit load on transformers 5.12) · 28d7711d
  Stefy Lanza (nextime / spora ) authored Aug 27, 2026
  28d7711d
- rerank: add /v1/rerank cross-encoder endpoint + surface OCR in /v1/models · e44d41ac
  Stefy Lanza (nextime / spora ) authored Aug 27, 2026
  e44d41ac
Aug 26, 2026
- embeddings(bge-m3): vectorize sparse/colbert aggregation on GPU · 59f6ebe0
  Stefy Lanza (nextime / spora ) authored Aug 26, 2026
  59f6ebe0
- embeddings(bge-m3): reliable sparse_head resolution via cache glob · 8fb4f85a
  Stefy Lanza (nextime / spora ) authored Aug 26, 2026
  8fb4f85a
- embeddings(bge-m3): fix loader crash + head dtype/grad · cc06016d
  Stefy Lanza (nextime / spora ) authored Aug 26, 2026
  cc06016d
- embeddings: native bge-m3 dense+sparse(+colbert) multi-vector support · 66f5540b
  Stefy Lanza (nextime / spora ) authored Aug 26, 2026
  66f5540b
Aug 22, 2026
- ocr: make managed Surya-2 vLLM reclaimable by VRAM eviction · 2c419247
  Stefy Lanza (nextime / spora ) authored Aug 22, 2026
  2c419247
Aug 21, 2026
- ocr: participate in thermal throttling + VRAM eviction · 3a01becb
  Stefy Lanza (nextime / spora ) authored Aug 21, 2026
  3a01becb
- tasks: report recent terminal tasks per engine so the Tasks page shows last-N across ALL engines · 2cd16b91
  Stefy Lanza (nextime / spora ) authored Aug 21, 2026
  2cd16b91
- vllm: first-class engine NODE (shows in engine/task page like nvidia/radeon) · b9a84c01
  Stefy Lanza (nextime / spora ) authored Aug 21, 2026
  b9a84c01
- vllm: accept HF repo ids (not just local dirs) in model resolution · 714f66d0
  Stefy Lanza (nextime / spora ) authored Aug 21, 2026
  714f66d0
- vllm: serve models from the model list (nvidia/radeon-style), model_id optional · 7dee70a4
  Stefy Lanza (nextime / spora ) authored Aug 21, 2026
  7dee70a4
- vllm: cooperative VRAM co-tenancy + GPU selection (full engine parity) · 4223107e
  Stefy Lanza (nextime / spora ) authored Aug 21, 2026
  4223107e
- ocr(surya): parse Surya2 (>=0.20) result.blocks[].html + reading order · edf2125a
  Stefy Lanza (nextime / spora ) authored Aug 21, 2026
  edf2125a
- ocr(docs): surya venv version depends on serve mode (0.17 local / >=0.20 vllm) · 91cf6236
  Stefy Lanza (nextime / spora ) authored Aug 21, 2026
  91cf6236
- vllm: default VLLM_USE_FLASHINFER=0 (no runtime JIT toolchain) · 077e61bd
  Stefy Lanza (nextime / spora ) authored Aug 21, 2026
  077e61bd
- Add vLLM as a first-class managed engine backend (LLM + OCR Surya2) · a5d9fe82
  Stefy Lanza (nextime / spora ) authored Aug 21, 2026
  a5d9fe82
Aug 20, 2026
- ocr: fix PaddleOCR 3.x API + pin surya-ocr to classic local-torch 0.6.4 · 2654d749
  Stefy Lanza (nextime / spora ) authored Aug 20, 2026
  2654d749
- ocr(paddle): pin paddlepaddle-gpu==3.3.1 to stop resolver backtracking · 2be68d4c
  Stefy Lanza (nextime / spora ) authored Aug 20, 2026
  2be68d4c
Aug 16, 2026
- ocr: non-blocking first-use isolated-venv build (background + 503 retry) · f8b86701
  Stefy Lanza (nextime / spora ) authored Aug 16, 2026
  f8b86701
- Add dedicated OCR subsystem + finalize multi-engine backends · 2485403f
  Stefy Lanza (nextime / spora ) authored Aug 16, 2026
  2485403f
Jul 31, 2026
- embeddings 300ms default + admin GUI throttle fields; radeon crash-loop breaker · 07dd05a1
  Stefy Lanza (nextime / spora ) authored Jul 31, 2026
  07dd05a1
Jul 30, 2026
- embeddings: per-model throttle + default 200ms pacing · dc6026ef
  Stefy Lanza (nextime / spora ) authored Jul 30, 2026
  dc6026ef
Jul 29, 2026
- colibri: single-client run_serve mode (kv_slots=1) to keep MTP enabled · 98963164
  Stefy Lanza (nextime / spora ) authored Jul 29, 2026
  98963164
- engines: scope cross-backend pooling to the split's lead engine only · cedaabb3
  Stefy Lanza (nextime / spora ) authored Jul 29, 2026
  cedaabb3
- embeddings: admission gate (bounded concurrency + backlog shedding + pacing) · bbac56b1
  Stefy Lanza (nextime / spora ) authored Jul 29, 2026
  bbac56b1
- colibri: stop at GLM turn boundary + clean output + resolve model_id alias · 58f945de
  Stefy Lanza (nextime / spora ) authored Jul 29, 2026
  58f945de
- thermal: CPU-hot pauses ALL engines (incl colibri) — revert per-engine exemption · 8ff477c1
  Stefy Lanza (nextime / spora ) authored Jul 29, 2026
  8ff477c1
Jul 28, 2026
- thermal: engine-level CPU wait also gated on per-engine CPU relevance · c44376a9
  Stefy Lanza (nextime / spora ) authored Jul 28, 2026
  c44376a9
- thermal: attribute CPU heat per-engine + graceful colibri pause; add credits · bba1203d
  Stefy Lanza (nextime / spora ) authored Jul 28, 2026
  bba1203d
- colibri: size the context window (CTX) from n_ctx — fixes "prompt does not fit" · 2c2f5af8
  Stefy Lanza (nextime / spora ) authored Jul 28, 2026
  2c2f5af8
- colibri: enable the GPU backend (COLI_CUDA=1) — fixes "exited before READY" · 63904b77
  Stefy Lanza (nextime / spora ) authored Jul 28, 2026
  63904b77
- colibri: pre-compile like ds4 (don't compile in the runtime container) · 8e147d78
  Stefy Lanza (nextime / spora ) authored Jul 28, 2026
  8e147d78
- colibri/models: don't false-flag a complete HF model as "incomplete" · 556b4238
  Stefy Lanza (nextime / spora ) authored Jul 28, 2026
  556b4238
- colibri: download the GLM-5.2 container from the Models interface like any other · 1b7187d4
  Stefy Lanza (nextime / spora ) authored Jul 28, 2026
  1b7187d4