Commits · 17604ab49be827204ccf66acbc6f2f94bd00943a · nexlab / coderai · GitLab

Sep 06, 2026
- runpod(phase2): serverless request path + per-model config + no-local-download · 17604ab4
  Stefy Lanza (nextime / spora ) authored Sep 06, 2026
  17604ab4
Sep 05, 2026
- runpod(phase1): account config + GraphQL client + admin key/GPU-catalog plumbing · 7c057af2
  Stefy Lanza (nextime / spora ) authored Sep 05, 2026
  7c057af2
Sep 02, 2026
- audio(whisper-server): convert mp4/any input with our ffmpeg (fix stuck-queue hang) · 717ab1ad
  Stefy Lanza (nextime / spora ) authored Sep 02, 2026
  717ab1ad
Sep 01, 2026
- audio: CrisperWhisper long-form overlap windowing (no seam drops) · b6f6ca9e
  Stefy Lanza (nextime / spora ) authored Sep 01, 2026
  b6f6ca9e
- audio: CrisperWhisper long-form windowing + worker self-heal · b0483e8c
  Stefy Lanza (nextime / spora ) authored Sep 01, 2026
  b0483e8c
- audio: CrisperWhisper support (isolated venv, verbatim + word timestamps) · b069137b
  Stefy Lanza (nextime / spora ) authored Sep 01, 2026
  b069137b
- audio: FP16 wav2vec2 on GPU (halves VRAM) · d51f46d2
  Stefy Lanza (nextime / spora ) authored Sep 01, 2026
  d51f46d2
- audio: sliding-window speaker embeddings (window/step) · ed8c014d
  Stefy Lanza (nextime / spora ) authored Sep 01, 2026
  ed8c014d
- audio: STT backends, diarization, speaker embeddings/ID, word timestamps · 7e5a925c
  Stefy Lanza (nextime / spora ) authored Sep 01, 2026
  7e5a925c
Aug 27, 2026
- vram: don't ratchet down a model's learned GPU-layer split under contention · f54428cf
  Stefy Lanza (nextime / spora ) authored Aug 27, 2026
  f54428cf
- logging: durable request-debug sink + non-silent engine log pump · ced55385
  Stefy Lanza (nextime / spora ) authored Aug 27, 2026
  ced55385
- config(multi-config): fix GGUF dispatch + per-config-id measured persistence · f9f2a373
  Stefy Lanza (nextime / spora ) authored Aug 27, 2026
  f9f2a373
- config: honor same-path multi-config at runtime (key siblings by alias) · 6ec4af1c
  Stefy Lanza (nextime / spora ) authored Aug 27, 2026
  6ec4af1c
- rerank: resolve model via embedding category to pass manager type-validation · b72896e5
  Stefy Lanza (nextime / spora ) authored Aug 27, 2026
  b72896e5
- deps: bump bitsandbytes to >=0.50.2 (fix 4-bit load on transformers 5.12) · 28d7711d
  Stefy Lanza (nextime / spora ) authored Aug 27, 2026
  28d7711d
- rerank: add /v1/rerank cross-encoder endpoint + surface OCR in /v1/models · e44d41ac
  Stefy Lanza (nextime / spora ) authored Aug 27, 2026
  e44d41ac
Aug 26, 2026
- embeddings(bge-m3): vectorize sparse/colbert aggregation on GPU · 59f6ebe0
  Stefy Lanza (nextime / spora ) authored Aug 26, 2026
  59f6ebe0
- embeddings(bge-m3): reliable sparse_head resolution via cache glob · 8fb4f85a
  Stefy Lanza (nextime / spora ) authored Aug 26, 2026
  8fb4f85a
- embeddings(bge-m3): fix loader crash + head dtype/grad · cc06016d
  Stefy Lanza (nextime / spora ) authored Aug 26, 2026
  cc06016d
- embeddings: native bge-m3 dense+sparse(+colbert) multi-vector support · 66f5540b
  Stefy Lanza (nextime / spora ) authored Aug 26, 2026
  66f5540b
Aug 22, 2026
- ocr: make managed Surya-2 vLLM reclaimable by VRAM eviction · 2c419247
  Stefy Lanza (nextime / spora ) authored Aug 22, 2026
  2c419247
Aug 21, 2026
- ocr: participate in thermal throttling + VRAM eviction · 3a01becb
  Stefy Lanza (nextime / spora ) authored Aug 21, 2026
  3a01becb
- tasks: report recent terminal tasks per engine so the Tasks page shows last-N across ALL engines · 2cd16b91
  Stefy Lanza (nextime / spora ) authored Aug 21, 2026
  2cd16b91
- vllm: first-class engine NODE (shows in engine/task page like nvidia/radeon) · b9a84c01
  Stefy Lanza (nextime / spora ) authored Aug 21, 2026
  b9a84c01
- vllm: accept HF repo ids (not just local dirs) in model resolution · 714f66d0
  Stefy Lanza (nextime / spora ) authored Aug 21, 2026
  714f66d0
- vllm: serve models from the model list (nvidia/radeon-style), model_id optional · 7dee70a4
  Stefy Lanza (nextime / spora ) authored Aug 21, 2026
  7dee70a4
- vllm: cooperative VRAM co-tenancy + GPU selection (full engine parity) · 4223107e
  Stefy Lanza (nextime / spora ) authored Aug 21, 2026
  4223107e
- ocr(surya): parse Surya2 (>=0.20) result.blocks[].html + reading order · edf2125a
  Stefy Lanza (nextime / spora ) authored Aug 21, 2026
  edf2125a
- ocr(docs): surya venv version depends on serve mode (0.17 local / >=0.20 vllm) · 91cf6236
  Stefy Lanza (nextime / spora ) authored Aug 21, 2026
  91cf6236
- vllm: default VLLM_USE_FLASHINFER=0 (no runtime JIT toolchain) · 077e61bd
  Stefy Lanza (nextime / spora ) authored Aug 21, 2026
  077e61bd
- Add vLLM as a first-class managed engine backend (LLM + OCR Surya2) · a5d9fe82
  Stefy Lanza (nextime / spora ) authored Aug 21, 2026
  a5d9fe82
Aug 20, 2026
- ocr: fix PaddleOCR 3.x API + pin surya-ocr to classic local-torch 0.6.4 · 2654d749
  Stefy Lanza (nextime / spora ) authored Aug 20, 2026
  2654d749
- ocr(paddle): pin paddlepaddle-gpu==3.3.1 to stop resolver backtracking · 2be68d4c
  Stefy Lanza (nextime / spora ) authored Aug 20, 2026
  2be68d4c
Aug 16, 2026
- ocr: non-blocking first-use isolated-venv build (background + 503 retry) · f8b86701
  Stefy Lanza (nextime / spora ) authored Aug 16, 2026
  f8b86701
- Add dedicated OCR subsystem + finalize multi-engine backends · 2485403f
  Stefy Lanza (nextime / spora ) authored Aug 16, 2026
  2485403f
Jul 31, 2026
- embeddings 300ms default + admin GUI throttle fields; radeon crash-loop breaker · 07dd05a1
  Stefy Lanza (nextime / spora ) authored Jul 31, 2026
  07dd05a1
Jul 30, 2026
- embeddings: per-model throttle + default 200ms pacing · dc6026ef
  Stefy Lanza (nextime / spora ) authored Jul 30, 2026
  dc6026ef
Jul 29, 2026
- colibri: single-client run_serve mode (kv_slots=1) to keep MTP enabled · 98963164
  Stefy Lanza (nextime / spora ) authored Jul 29, 2026
  98963164
- engines: scope cross-backend pooling to the split's lead engine only · cedaabb3
  Stefy Lanza (nextime / spora ) authored Jul 29, 2026
  cedaabb3
- embeddings: admission gate (bounded concurrency + backlog shedding + pacing) · bbac56b1
  Stefy Lanza (nextime / spora ) authored Jul 29, 2026
  bbac56b1