Commits · 72bbed6949c425747e991b86eea5b94e8265bd64 · nexlab / coderai · GitLab

Oct 17, 2026
- nothing on the event loop may block, and the loop now says when it did (v0.4.17) · 174a3753
  Stefy Lanza (nextime / spora ) authored Oct 17, 2026
  174a3753
Oct 15, 2026
- the bytes reached the pod, the entry did not (v0.3.93) · 123fe538
  Stefy Lanza (nextime / spora ) authored Oct 15, 2026
  123fe538
- vLLM was never launched able to accept tool calls (v0.3.92) · 7601bdf9
  Stefy Lanza (nextime / spora ) authored Oct 15, 2026
  7601bdf9
- a retrain keeps the name and changes the bytes (v0.3.91) · 6ac424e9
  Stefy Lanza (nextime / spora ) authored Oct 15, 2026
  6ac424e9
- the adapter was found by a name a seeded entry does not have (v0.3.88) · 36ed3da0
  Stefy Lanza (nextime / spora ) authored Oct 15, 2026
  36ed3da0
- shared pools: a name is not a path (v0.3.86) · 48fbcf76
  Stefy Lanza (nextime / spora ) authored Oct 15, 2026
  48fbcf76
Oct 13, 2026
- runpod: the bearer was read before the pod was acquired, so adoption 401'd (v0.3.58) · c72c2134
  Stefy Lanza (nextime / spora ) authored Oct 13, 2026
  c72c2134
- models: publish the context window, and say so when nobody does (v0.3.53) · 42356742
  Stefy Lanza (nextime / spora ) authored Oct 13, 2026
  42356742
- proxy: forward the fields coderai does not understand (v0.3.51) · 2a45785d
  Stefy Lanza (nextime / spora ) authored Oct 13, 2026
  2a45785d
Oct 12, 2026
- ocr: recover surya's accents on vLLM 0.27.1 from the token IDS (v0.3.31) · 3353ac28
  Stefy Lanza (nextime / spora ) authored Oct 12, 2026
  3353ac28
Oct 11, 2026
- ocr: a confidence nobody measured is worse than none (v0.3.8) · 903797e0
  Stefy Lanza (nextime / spora ) authored Oct 11, 2026
  903797e0
- runpod: a proxy that edits the request decides for the server · a484119e
  Stefy Lanza (nextime / spora ) authored Oct 11, 2026
  a484119e
- ocr: surya should ask who serves the model, not where the GPU is (v0.3.7) · 51aa0d2f
  Stefy Lanza (nextime / spora ) authored Oct 11, 2026
  51aa0d2f
Sep 20, 2026
- cluster: mDNS discovery with a shared token, prefix-cache routing, Prometheus... · 0d4a338b
  Stefy Lanza (nextime / spora ) authored Sep 20, 2026
  0d4a338b
Sep 19, 2026
- cluster: nodes as engines, one GGUF over llama.cpp RPC, vLLM/SGLang... · f5ca2d82
  Stefy Lanza (nextime / spora ) authored Sep 19, 2026
  f5ca2d82
Sep 18, 2026
- runpod: drop a pod that refuses connections and retry once on a fresh one · 2315e84f
  Stefy Lanza (nextime / spora ) authored Sep 18, 2026
  2315e84f
Sep 17, 2026
- llama pod on the light core: the GGUF backend asks NVML about the card, not torch · 4866b69d
  Stefy Lanza (nextime / spora ) authored Sep 17, 2026
  4866b69d
- runpod: TLS on direct-TCP pods — both no-cutoff and encrypted · d83404ae
  Stefy Lanza (nextime / spora ) authored Sep 17, 2026
  d83404ae
Sep 14, 2026
- text: LoRA and QLoRA on text models, locally and on RunPod · 34d08890
  Stefy Lanza (nextime / spora ) authored Sep 14, 2026
  34d08890
- runpod: let several models share one pod until it saturates · 69d944a9
  Stefy Lanza (nextime / spora ) authored Sep 14, 2026
  69d944a9
Sep 13, 2026
- runpod: lock pods to a token, and scale them on real concurrency · 9ad9e19f
  Stefy Lanza (nextime / spora ) authored Sep 13, 2026
  9ad9e19f
- llm: make every text model remotizable, GGUF included · 6c6646c4
  Stefy Lanza (nextime / spora ) authored Sep 13, 2026
  6c6646c4
Sep 12, 2026
- gguf: stop reserving KV headroom that a measured footprint already includes · 2511b348
  Stefy Lanza (nextime / spora ) authored Sep 12, 2026
  2511b348
- gguf: never fall back to a 2048 context · 0ba09055
  Stefy Lanza (nextime / spora ) authored Sep 12, 2026
  0ba09055
Sep 11, 2026
- gguf: resolve split-GGUF shards and say what's missing · 12887a46
  Stefy Lanza (nextime / spora ) authored Sep 11, 2026
  12887a46
- gguf: try swa_full before quantizing, and add a finer KV ladder · 5eb92e2c
  Stefy Lanza (nextime / spora ) authored Sep 11, 2026
  5eb92e2c
- gguf: plan where the KV cache goes instead of discovering it by OOM · f440cdbb
  Stefy Lanza (nextime / spora ) authored Sep 11, 2026
  f440cdbb
Sep 06, 2026
- runpod: fix pods /v1 path; add stale-pod reaper, multi-GPU fallback, pod logs · b911310a
  Stefy Lanza (nextime / spora ) authored Sep 06, 2026
  b911310a
- runpod(phase3-5): pod pool + scaler + cost ledger, budgets, global-gate bypass, spillover, stats UI · 7649c9c2
  Stefy Lanza (nextime / spora ) authored Sep 06, 2026
  7649c9c2
- runpod(phase2): serverless request path + per-model config + no-local-download · 17604ab4
  Stefy Lanza (nextime / spora ) authored Sep 06, 2026
  17604ab4
Aug 21, 2026
- vllm: accept HF repo ids (not just local dirs) in model resolution · 714f66d0
  Stefy Lanza (nextime / spora ) authored Aug 21, 2026
  714f66d0
- vllm: serve models from the model list (nvidia/radeon-style), model_id optional · 7dee70a4
  Stefy Lanza (nextime / spora ) authored Aug 21, 2026
  7dee70a4
- Add vLLM as a first-class managed engine backend (LLM + OCR Surya2) · a5d9fe82
  Stefy Lanza (nextime / spora ) authored Aug 21, 2026
  a5d9fe82
Aug 16, 2026
- Add dedicated OCR subsystem + finalize multi-engine backends · 2485403f
  Stefy Lanza (nextime / spora ) authored Aug 16, 2026
  2485403f
Jul 29, 2026
- colibri: stop at GLM turn boundary + clean output + resolve model_id alias · 58f945de
  Stefy Lanza (nextime / spora ) authored Jul 29, 2026
  58f945de
Jul 28, 2026
- colibri: download the GLM-5.2 container from the Models interface like any other · 1b7187d4
  Stefy Lanza (nextime / spora ) authored Jul 28, 2026
  1b7187d4
- colibri: integrate GLM-5.2 native C engine (driven directly, no colibri Python) · 50f54eb3
  Stefy Lanza (nextime / spora ) authored Jul 28, 2026
  50f54eb3
Jul 22, 2026
- vulkan: vision requests must bypass the fast chat-render path · 40635282
  Stefy Lanza (nextime / spora ) authored Jul 22, 2026
  40635282
Jun 24, 2026
- nvidia HF loader: parity with hf_loading (precision, flash key, buffers, RAM cap) · 8c1ea33d
  Stefy Lanza (nextime / spora ) authored Jun 24, 2026
  8c1ea33d
- hf: resolve relative offload_dir to the configured dir; forward HF_TOKEN · fe7da690
  Stefy Lanza (nextime / spora ) authored Jun 24, 2026
  fe7da690