Commits · 3a01becbc464369948f7eecc7a215c0dd96a7585 · nexlab / coderai · GitLab

Aug 21, 2026
- vllm: accept HF repo ids (not just local dirs) in model resolution · 714f66d0
  Stefy Lanza (nextime / spora ) authored Aug 21, 2026
  714f66d0
- vllm: serve models from the model list (nvidia/radeon-style), model_id optional · 7dee70a4
  Stefy Lanza (nextime / spora ) authored Aug 21, 2026
  7dee70a4
- Add vLLM as a first-class managed engine backend (LLM + OCR Surya2) · a5d9fe82
  Stefy Lanza (nextime / spora ) authored Aug 21, 2026
  a5d9fe82
Aug 16, 2026
- Add dedicated OCR subsystem + finalize multi-engine backends · 2485403f
  Stefy Lanza (nextime / spora ) authored Aug 16, 2026
  2485403f
Jul 29, 2026
- colibri: stop at GLM turn boundary + clean output + resolve model_id alias · 58f945de
  Stefy Lanza (nextime / spora ) authored Jul 29, 2026
  58f945de
Jul 28, 2026
- colibri: download the GLM-5.2 container from the Models interface like any other · 1b7187d4
  Stefy Lanza (nextime / spora ) authored Jul 28, 2026
  1b7187d4
- colibri: integrate GLM-5.2 native C engine (driven directly, no colibri Python) · 50f54eb3
  Stefy Lanza (nextime / spora ) authored Jul 28, 2026
  50f54eb3
Jul 22, 2026
- vulkan: vision requests must bypass the fast chat-render path · 40635282
  Stefy Lanza (nextime / spora ) authored Jul 22, 2026
  40635282
Jun 24, 2026
- nvidia HF loader: parity with hf_loading (precision, flash key, buffers, RAM cap) · 8c1ea33d
  Stefy Lanza (nextime / spora ) authored Jun 24, 2026
  8c1ea33d
- hf: resolve relative offload_dir to the configured dir; forward HF_TOKEN · fe7da690
  Stefy Lanza (nextime / spora ) authored Jun 24, 2026
  fe7da690
Jun 22, 2026
- engine: render chat prompt with a plain (cached) Jinja env — fixes ~40s per request · 080ecff7
  Stefy Lanza (nextime / spora ) authored Jun 22, 2026
  080ecff7
- engine: time-split chat generation (build vs prefill) to locate pre-gen latency · e501bab0
  Stefy Lanza (nextime / spora ) authored Jun 22, 2026
  e501bab0
- engine: route hot-path logs through os.write (fast_print) instead of print() · e2db1b5c
  Stefy Lanza (nextime / spora ) authored Jun 22, 2026
  e2db1b5c
- vulkan: add gemma stop sequences so generation halts after the tool call · ddb48b2d
  Stefy Lanza (nextime / spora ) authored Jun 22, 2026
  ddb48b2d
- gpu: performance split respects per-card VRAM cap; harden process naming · 5b4ff469
  Stefy Lanza (nextime / spora ) authored Jun 22, 2026
  5b4ff469
- gpu: global VRAM cap is now per physical card (nvidia/radeon), auto-enumerated · f416117a
  Stefy Lanza (nextime / spora ) authored Jun 22, 2026
  f416117a
- gpu: secondary-card VRAM cap (per-model + global), effective = lowest of the two · 82aec0f9
  Stefy Lanza (nextime / spora ) authored Jun 22, 2026
  82aec0f9
- gpu: performance-split KV-aware fit + progressive CPU-offload retry on OOM · f1f11723
  Stefy Lanza (nextime / spora ) authored Jun 22, 2026
  f1f11723
- gpu: performance split strategy (fast card first) — per-model + global, UI-configurable · 64187292
  Stefy Lanza (nextime / spora ) authored Jun 22, 2026
  64187292
- front/engine: responsive Tasks under load — front-side in-flight tracking + thermal cadence · afefee53
  Stefy Lanza (nextime / spora ) authored Jun 22, 2026
  afefee53
- gpu: exclude llvmpipe from split, mmproj-aware headroom + CPU spill when pool is full · b5acbc2c
  Stefy Lanza (nextime / spora ) authored Jun 22, 2026
  b5acbc2c
- ui/gpu: explicit "Split — <card> first" options; auto = single GPU; confine non-split models · 0490e2c9
  Stefy Lanza (nextime / spora ) authored Jun 22, 2026
  0490e2c9
Jun 21, 2026
- ui: cross-GPU split controls (global + per-model) with auto VRAM-proportional ratio · c060e6dc
  Stefy Lanza (nextime / spora ) authored Jun 22, 2026
  c060e6dc
- gpu: make VRAM accounting/eviction ALWAYS multi-device, not just under split · 067a797e
  Stefy Lanza (nextime / spora ) authored Jun 21, 2026
  067a797e
- gpu: cross-GPU VRAM accounting for split models (Phase 3) · 32f20536
  Stefy Lanza (nextime / spora ) authored Jun 21, 2026
  32f20536
- gpu: per-engine backend isolation (fix docker cross-GPU split) + opt-in... · 018396c1
  Stefy Lanza (nextime / spora ) authored Jun 21, 2026
  018396c1
- docker/backend: graceful llama-cpp load + additive GPU modes + libcuda... · c077b7da
  Stefy Lanza (nextime / spora ) authored Jun 21, 2026
  c077b7da
Jun 20, 2026
- backend: per-model kv_offload flag to keep the KV cache in host RAM · 4754beff
  Stefy Lanza (nextime / spora ) authored Jun 20, 2026
  4754beff
- text: stop runaway tool-call loops + honor client repetition penalties · a535c27f
  Stefy Lanza (nextime / spora ) authored Jun 20, 2026
  a535c27f
- ds4: cache-cleanup safety, in-flight gate, default-model downloader, low-quant tool parse · e23dd2a7
  Stefy Lanza (nextime / spora ) authored Jun 20, 2026
  e23dd2a7
- ds4: per-model launch overrides, multibyte-safe streaming, UI tweaks · 6a111627
  Stefy Lanza (nextime / spora ) authored Jun 20, 2026
  6a111627
Jun 19, 2026
- vulkan: fold system role by template signal, not just architecture · 64eb74b7
  Stefy Lanza (nextime / spora ) authored Jun 19, 2026
  64eb74b7
- vulkan: fold system message into user turn when template rejects it · 39a62745
  Stefy Lanza (nextime / spora ) authored Jun 19, 2026
  39a62745
- vulkan: resolve bare-alias gguf locally before trying HuggingFace · eb138bfa
  Stefy Lanza (nextime / spora ) authored Jun 19, 2026
  eb138bfa
- vulkan: read free VRAM from amdgpu sysfs (CUDA query is NVIDIA-only) · f204f399
  Stefy Lanza (nextime / spora ) authored Jun 19, 2026
  f204f399
- ds4: auto-downloaded weights land in coderai GGUF cache + show on models page · ef106ba1
  Stefy Lanza (nextime / spora ) authored Jun 19, 2026
  ef106ba1
- fix(ds4+config): resolve bare model ids, don't over-estimate VRAM, robust config · 8c85e16a
  Stefy Lanza (nextime / spora ) authored Jun 19, 2026
  8c85e16a
- feat(ds4): auto-route deepseek4 GGUFs by architecture; serve the requested file · 6a153c58
  Stefy Lanza (nextime / spora ) authored Jun 19, 2026
  6a153c58
- feat: model "to-download" list, mmproj vision, styled modals, broker + packaging · cbf7f147
  Stefy Lanza (nextime / spora ) authored Jun 19, 2026
  cbf7f147
Jun 18, 2026
- Almost all ready · 9d023ec2
  Stefy Lanza (nextime / spora ) authored Jun 18, 2026
  
  9d023ec2