Commits · 17604ab49be827204ccf66acbc6f2f94bd00943a · nexlab / coderai · GitLab

Sep 06, 2026
- runpod(phase2): serverless request path + per-model config + no-local-download · 17604ab4
  Stefy Lanza (nextime / spora ) authored Sep 06, 2026
  17604ab4
Sep 05, 2026
- runpod(phase1): account config + GraphQL client + admin key/GPU-catalog plumbing · 7c057af2
  Stefy Lanza (nextime / spora ) authored Sep 05, 2026
  7c057af2
Sep 02, 2026
- audio(whisper-server): convert mp4/any input with our ffmpeg (fix stuck-queue hang) · 717ab1ad
  Stefy Lanza (nextime / spora ) authored Sep 02, 2026
  717ab1ad
Sep 01, 2026
- audio: CrisperWhisper support (isolated venv, verbatim + word timestamps) · b069137b
  Stefy Lanza (nextime / spora ) authored Sep 01, 2026
  b069137b
- audio: STT backends, diarization, speaker embeddings/ID, word timestamps · 7e5a925c
  Stefy Lanza (nextime / spora ) authored Sep 01, 2026
  7e5a925c
Aug 27, 2026
- vram: don't ratchet down a model's learned GPU-layer split under contention · f54428cf
  Stefy Lanza (nextime / spora ) authored Aug 27, 2026
  f54428cf
- config(multi-config): fix GGUF dispatch + per-config-id measured persistence · f9f2a373
  Stefy Lanza (nextime / spora ) authored Aug 27, 2026
  f9f2a373
- rerank: add /v1/rerank cross-encoder endpoint + surface OCR in /v1/models · e44d41ac
  Stefy Lanza (nextime / spora ) authored Aug 27, 2026
  e44d41ac
Aug 21, 2026
- vllm: serve models from the model list (nvidia/radeon-style), model_id optional · 7dee70a4
  Stefy Lanza (nextime / spora ) authored Aug 21, 2026
  7dee70a4
- vllm: cooperative VRAM co-tenancy + GPU selection (full engine parity) · 4223107e
  Stefy Lanza (nextime / spora ) authored Aug 21, 2026
  4223107e
- Add vLLM as a first-class managed engine backend (LLM + OCR Surya2) · a5d9fe82
  Stefy Lanza (nextime / spora ) authored Aug 21, 2026
  a5d9fe82
Aug 16, 2026
- Add dedicated OCR subsystem + finalize multi-engine backends · 2485403f
  Stefy Lanza (nextime / spora ) authored Aug 16, 2026
  2485403f
Jul 29, 2026
- thermal: CPU-hot pauses ALL engines (incl colibri) — revert per-engine exemption · 8ff477c1
  Stefy Lanza (nextime / spora ) authored Jul 29, 2026
  8ff477c1
Jul 28, 2026
- thermal: engine-level CPU wait also gated on per-engine CPU relevance · c44376a9
  Stefy Lanza (nextime / spora ) authored Jul 28, 2026
  c44376a9
- colibri: GLM-5.2 tool-call parsing + treat colibri as a normal VRAM-eviction citizen · e2081488
  Stefy Lanza (nextime / spora ) authored Jul 28, 2026
  e2081488
- colibri: integrate GLM-5.2 native C engine (driven directly, no colibri Python) · 50f54eb3
  Stefy Lanza (nextime / spora ) authored Jul 28, 2026
  50f54eb3
Jul 24, 2026
- fix: config-key shadow dropped mmproj on GGUF vision model reload · 1126bdbc
  Stefy Lanza (nextime / spora ) authored Jul 24, 2026
  1126bdbc
- thermal: filter impossible GPU temps at the source (gpu_detect + read chokepoint) · 9ff0f709
  Stefy Lanza (nextime / spora ) authored Jul 24, 2026
  9ff0f709
Jul 23, 2026
- thermal: ignore physically impossible GPU temperature readings · 3c9536e1
  Stefy Lanza (nextime / spora ) authored Jul 23, 2026
  3c9536e1
- dinov2.cpp GGUF backend on Vulkan + Tasks-page compute-device badges · 1ca4a83b
  Stefy Lanza (nextime / spora ) authored Jul 23, 2026
  1ca4a83b
Jul 22, 2026
- video: fix VRAM teardown leak + track in-flight loads with reservations · 2ea24b0b
  Stefy Lanza (nextime / spora ) authored Jul 22, 2026
  2ea24b0b
- turboquant: ship turboquant-py + accurate bit-width errors for the library backend · 4d2aeb69
  Stefy Lanza (nextime / spora ) authored Jul 22, 2026
  4d2aeb69
Jul 03, 2026
- lora-train: cross-engine GPU lock so nothing reloads mid-training (fix intermittent OOM) · 18c6a358
  Stefy Lanza (nextime / spora ) authored Jul 03, 2026
  18c6a358
Jul 02, 2026
- lora-train: evict co-located sibling engine's VRAM before training (fix OOM) · e300e9c4
  Stefy Lanza (nextime / spora ) authored Jul 02, 2026
  e300e9c4
Jul 01, 2026
- pipeline-cache: reject corrupt-JSON caches (stop the empty-tokenizer death spiral) · 31793b05
  Stefy Lanza (nextime / spora ) authored Jul 01, 2026
  31793b05
- manager: clean cross-engine VRAM swap (evict a busy sibling at its unit boundary) · c9791579
  Stefy Lanza (nextime / spora ) authored Jul 01, 2026
  c9791579
Jun 29, 2026
- manager: universal footprint rule — already-quantized (cached) models measured... · 88c1e787
  Stefy Lanza (nextime / spora ) authored Jun 29, 2026
  88c1e787
- manager: measured_vram_gb = FULL model footprint (GPU + offloaded), not the resident slice · 273eb23c
  Stefy Lanza (nextime / spora ) authored Jun 29, 2026
  273eb23c
- video: OOM fallback LADDER (no 5xx until exhausted) + monolithic cache finalize · b8bcdfea
  Stefy Lanza (nextime / spora ) authored Jun 29, 2026
  b8bcdfea
- manager: sweep orphan VRAM + untracked-VRAM diagnostic before every video load · 2ab70301
  Stefy Lanza (nextime / spora ) authored Jun 29, 2026
  2ab70301
Jun 28, 2026
- video: incremental per-component pipeline cache (load/build/cache one component at a time) · 93e2a4b9
  Stefy Lanza (nextime / spora ) authored Jun 28, 2026
  93e2a4b9
- video: stop the offload retry death-spiral; log swallowed load/gen errors; robust pipeline cache · e48b90e0
  Stefy Lanza (nextime / spora ) authored Jun 28, 2026
  e48b90e0
- manager: don't strand VRAM or churn the live model on eviction · bb95ab1d
  Stefy Lanza (nextime / spora ) authored Jun 28, 2026
  bb95ab1d
Jun 27, 2026
- gpu: scope per-engine VRAM to the engine's own card (fix Radeon showing NVIDIA) · ff39ee42
  Stefy Lanza (nextime / spora ) authored Jun 27, 2026
  ff39ee42
- gpu: context-free VRAM query so idle/GGUF engine pins no CUDA context · 9c150b3e
  Stefy Lanza (nextime / spora ) authored Jun 27, 2026
  9c150b3e
Jun 26, 2026
- fix: apply peft<->gptqmodel AWQ shim on the inference LoRA path too · 3fb6c9b9
  Stefy Lanza (nextime / spora ) authored Jun 26, 2026
  3fb6c9b9
Jun 25, 2026
- quant: fix settings showing "GPTQModel not installed" when it is installed · e72e33eb
  Stefy Lanza (nextime / spora ) authored Jun 25, 2026
  e72e33eb
- engines: cross-engine VRAM eviction for co-located GGUF/torch engines · 88063940
  Stefy Lanza (nextime / spora ) authored Jun 25, 2026
  88063940
Jun 24, 2026
- nvidia HF loader: parity with hf_loading (precision, flash key, buffers, RAM cap) · 8c1ea33d
  Stefy Lanza (nextime / spora ) authored Jun 24, 2026
  8c1ea33d
- hf: resolve relative offload_dir to the configured dir; forward HF_TOKEN · fe7da690
  Stefy Lanza (nextime / spora ) authored Jun 24, 2026
  fe7da690