Commits · 124941a429e9732c92469b0772b63a66a96680fc · nexlab / coderai · GitLab

Sep 20, 2026
- cluster: mDNS discovery with a shared token, prefix-cache routing, Prometheus... · 0d4a338b
  Stefy Lanza (nextime / spora ) authored Sep 20, 2026
  0d4a338b
Sep 19, 2026
- cluster: nodes as engines, one GGUF over llama.cpp RPC, vLLM/SGLang... · f5ca2d82
  Stefy Lanza (nextime / spora ) authored Sep 19, 2026
  f5ca2d82
Sep 14, 2026
- text: LoRA and QLoRA on text models, locally and on RunPod · 34d08890
  Stefy Lanza (nextime / spora ) authored Sep 14, 2026
  34d08890
Sep 12, 2026
- gguf: stop reserving KV headroom that a measured footprint already includes · 2511b348
  Stefy Lanza (nextime / spora ) authored Sep 12, 2026
  2511b348
- gguf: never fall back to a 2048 context · 0ba09055
  Stefy Lanza (nextime / spora ) authored Sep 12, 2026
  0ba09055
Sep 11, 2026
- gguf: resolve split-GGUF shards and say what's missing · 12887a46
  Stefy Lanza (nextime / spora ) authored Sep 11, 2026
  12887a46
- gguf: try swa_full before quantizing, and add a finer KV ladder · 5eb92e2c
  Stefy Lanza (nextime / spora ) authored Sep 11, 2026
  5eb92e2c
- gguf: plan where the KV cache goes instead of discovering it by OOM · f440cdbb
  Stefy Lanza (nextime / spora ) authored Sep 11, 2026
  f440cdbb
Jul 22, 2026
- vulkan: vision requests must bypass the fast chat-render path · 40635282
  Stefy Lanza (nextime / spora ) authored Jul 22, 2026
  40635282
Jun 22, 2026
- engine: render chat prompt with a plain (cached) Jinja env — fixes ~40s per request · 080ecff7
  Stefy Lanza (nextime / spora ) authored Jun 22, 2026
  080ecff7
- engine: time-split chat generation (build vs prefill) to locate pre-gen latency · e501bab0
  Stefy Lanza (nextime / spora ) authored Jun 22, 2026
  e501bab0
- engine: route hot-path logs through os.write (fast_print) instead of print() · e2db1b5c
  Stefy Lanza (nextime / spora ) authored Jun 22, 2026
  e2db1b5c
- vulkan: add gemma stop sequences so generation halts after the tool call · ddb48b2d
  Stefy Lanza (nextime / spora ) authored Jun 22, 2026
  ddb48b2d
- gpu: performance split respects per-card VRAM cap; harden process naming · 5b4ff469
  Stefy Lanza (nextime / spora ) authored Jun 22, 2026
  5b4ff469
- gpu: global VRAM cap is now per physical card (nvidia/radeon), auto-enumerated · f416117a
  Stefy Lanza (nextime / spora ) authored Jun 22, 2026
  f416117a
- gpu: secondary-card VRAM cap (per-model + global), effective = lowest of the two · 82aec0f9
  Stefy Lanza (nextime / spora ) authored Jun 22, 2026
  82aec0f9
- gpu: performance-split KV-aware fit + progressive CPU-offload retry on OOM · f1f11723
  Stefy Lanza (nextime / spora ) authored Jun 22, 2026
  f1f11723
- gpu: performance split strategy (fast card first) — per-model + global, UI-configurable · 64187292
  Stefy Lanza (nextime / spora ) authored Jun 22, 2026
  64187292
- front/engine: responsive Tasks under load — front-side in-flight tracking + thermal cadence · afefee53
  Stefy Lanza (nextime / spora ) authored Jun 22, 2026
  afefee53
- gpu: exclude llvmpipe from split, mmproj-aware headroom + CPU spill when pool is full · b5acbc2c
  Stefy Lanza (nextime / spora ) authored Jun 22, 2026
  b5acbc2c
- ui/gpu: explicit "Split — <card> first" options; auto = single GPU; confine non-split models · 0490e2c9
  Stefy Lanza (nextime / spora ) authored Jun 22, 2026
  0490e2c9
Jun 21, 2026
- ui: cross-GPU split controls (global + per-model) with auto VRAM-proportional ratio · c060e6dc
  Stefy Lanza (nextime / spora ) authored Jun 22, 2026
  c060e6dc
- gpu: make VRAM accounting/eviction ALWAYS multi-device, not just under split · 067a797e
  Stefy Lanza (nextime / spora ) authored Jun 21, 2026
  067a797e
- gpu: cross-GPU VRAM accounting for split models (Phase 3) · 32f20536
  Stefy Lanza (nextime / spora ) authored Jun 21, 2026
  32f20536
- gpu: per-engine backend isolation (fix docker cross-GPU split) + opt-in... · 018396c1
  Stefy Lanza (nextime / spora ) authored Jun 21, 2026
  018396c1
- docker/backend: graceful llama-cpp load + additive GPU modes + libcuda... · c077b7da
  Stefy Lanza (nextime / spora ) authored Jun 21, 2026
  c077b7da
Jun 20, 2026
- backend: per-model kv_offload flag to keep the KV cache in host RAM · 4754beff
  Stefy Lanza (nextime / spora ) authored Jun 20, 2026
  4754beff
- text: stop runaway tool-call loops + honor client repetition penalties · a535c27f
  Stefy Lanza (nextime / spora ) authored Jun 20, 2026
  a535c27f
Jun 19, 2026
- vulkan: fold system role by template signal, not just architecture · 64eb74b7
  Stefy Lanza (nextime / spora ) authored Jun 19, 2026
  64eb74b7
- vulkan: fold system message into user turn when template rejects it · 39a62745
  Stefy Lanza (nextime / spora ) authored Jun 19, 2026
  39a62745
- vulkan: resolve bare-alias gguf locally before trying HuggingFace · eb138bfa
  Stefy Lanza (nextime / spora ) authored Jun 19, 2026
  eb138bfa
- vulkan: read free VRAM from amdgpu sysfs (CUDA query is NVIDIA-only) · f204f399
  Stefy Lanza (nextime / spora ) authored Jun 19, 2026
  f204f399
- feat: model "to-download" list, mmproj vision, styled modals, broker + packaging · cbf7f147
  Stefy Lanza (nextime / spora ) authored Jun 19, 2026
  cbf7f147
Jun 18, 2026
- Almost all ready · 9d023ec2
  Stefy Lanza (nextime / spora ) authored Jun 18, 2026
  
  9d023ec2
- feat: smart context caching, VRAM offload fix, GPTQ/AWQ quant backend · 990f9471
  Stefy Lanza (nextime / spora ) authored Jun 18, 2026
  990f9471
- front/engine split, ds4 + media tooling, gemma-4 native tools; ignore runtime artifacts · b297b25f
  Stefy Lanza (nextime / spora ) authored Jun 18, 2026
  b297b25f
Jun 15, 2026
- township: 2-keyframe outcomes, referees, autogen, generation queue; favicons · 3bfefed0
  Stefy Lanza (nextime / spora ) authored Jun 15, 2026
  3bfefed0
Jun 11, 2026
- Add task management, quantization, and hardware telemetry · 8ad15128
  Stefy Lanza (nextime / spora ) authored Jun 11, 2026
  8ad15128
Jun 10, 2026
- Backends, API, and tooling updates; gitignore township_output · f21c6185
  Stefy Lanza (nextime / spora ) authored Jun 10, 2026
  f21c6185
Jun 03, 2026
- New version! · 3b2b487b
  Stefy Lanza (nextime / spora ) authored Jun 03, 2026
  
  3b2b487b