Commits · d94b144e0246a5fd3fc6c390e2023a9cff911267 · nexlab / coderai · GitLab

Oct 19, 2026
- raise every connection ceiling past a 128-pod fleet (v0.4.45) · 86e7f7c5
  Stefy Lanza (nextime / spora ) authored Oct 19, 2026
  86e7f7c5
- httpx's default connection pool was the throughput ceiling (v0.4.36) · 9ecc4122
  Stefy Lanza (nextime / spora ) authored Oct 19, 2026
  9ecc4122
Oct 17, 2026
- nothing on the event loop may block, and the loop now says when it did (v0.4.17) · 174a3753
  Stefy Lanza (nextime / spora ) authored Oct 17, 2026
  174a3753
Oct 15, 2026
- an OCR run starved the server of threads to answer on (v0.3.102) · f4426b19
  Stefy Lanza (nextime / spora ) authored Oct 16, 2026
  f4426b19
Oct 12, 2026
- front: an in-flight request that leaks freezes the install, so stop leaking one (v0.3.27) · cbd51a4a
  Stefy Lanza (nextime / spora ) authored Oct 12, 2026
  cbd51a4a
- ocr: Chandra, the document VLM that is asked for its layout (v0.3.24) · e982ff73
  Stefy Lanza (nextime / spora ) authored Oct 12, 2026
  e982ff73
Oct 11, 2026
- ocr: surya should ask who serves the model, not where the GPU is (v0.3.7) · 51aa0d2f
  Stefy Lanza (nextime / spora ) authored Oct 11, 2026
  51aa0d2f
Oct 10, 2026
- oom: the server should be the last thing the kernel kills, not the first · 860b3dd1
  Stefy Lanza (nextime / spora ) authored Oct 10, 2026
  860b3dd1
Oct 09, 2026
- front: expose active tasks on /metrics so training blocks an upgrade (v0.2.92) · dadb0196
  Stefy Lanza (nextime / spora ) authored Oct 09, 2026
  dadb0196
- front: compare forward-auth peers as addresses, not strings (v0.2.90) · 7b570bc1
  Stefy Lanza (nextime / spora ) authored Oct 09, 2026
  7b570bc1
Oct 08, 2026
- front: forward-auth peers from env, and say why one was refused (v0.2.88) · 0945f123
  Stefy Lanza (nextime / spora ) authored Oct 08, 2026
  0945f123
- admin: optional SSO through a trusted reverse proxy (v0.2.85) · e51b5b14
  Stefy Lanza (nextime / spora ) authored Oct 08, 2026
  e51b5b14
- front: enforce the API bearer on /v1, and do not fall open (v0.2.84) · 83bad126
  Stefy Lanza (nextime / spora ) authored Oct 08, 2026
  83bad126
Oct 07, 2026
- runpod: a region and a warm-pod schedule per model, spend over the API (v0.2.82) · c6c1017c
  Stefy Lanza (nextime / spora ) authored Oct 07, 2026
  c6c1017c
Oct 05, 2026
- longcat: VRAM accounting, a draining releaser, and video in the front queue (v0.2.32) · 409880f3
  Stefy Lanza (nextime / spora ) authored Oct 05, 2026
  409880f3
Oct 04, 2026
- front: OCR takes its turn at the shared-GPU swap gate, unless it runs off-box · 3cb4d23d
  Stefy Lanza (nextime / spora ) authored Oct 04, 2026
  3cb4d23d
Sep 20, 2026
- cluster: mDNS discovery with a shared token, prefix-cache routing, Prometheus... · 0d4a338b
  Stefy Lanza (nextime / spora ) authored Sep 20, 2026
  0d4a338b
Sep 19, 2026
- cluster: work-parallel fan-out of one request over engines and nodes · d7e6600f
  Stefy Lanza (nextime / spora ) authored Sep 19, 2026
  d7e6600f
- tagline: complete orchestration, distribution and escalation of remotizable advanced inference · c11d02dc
  Stefy Lanza (nextime / spora ) authored Sep 19, 2026
  c11d02dc
- cluster: nodes as engines, one GGUF over llama.cpp RPC, vLLM/SGLang... · f5ca2d82
  Stefy Lanza (nextime / spora ) authored Sep 19, 2026
  f5ca2d82
Sep 14, 2026
- config: make a settings save reach the engine and the front · b95ba611
  Stefy Lanza (nextime / spora ) authored Sep 14, 2026
  b95ba611
- runpod: let several models share one pod until it saturates · 69d944a9
  Stefy Lanza (nextime / spora ) authored Sep 14, 2026
  69d944a9
Sep 13, 2026
- runpod: lock pods to a token, and scale them on real concurrency · 9ad9e19f
  Stefy Lanza (nextime / spora ) authored Sep 13, 2026
  9ad9e19f
- front: burst to RunPod when the local model is busy, and to pods · c104bcc9
  Stefy Lanza (nextime / spora ) authored Sep 13, 2026
  c104bcc9
Sep 06, 2026
- runpod: guarantee a host node on GPU-less / unknown-backend deployments · 97d16a0a
  Stefy Lanza (nextime / spora ) authored Sep 06, 2026
  97d16a0a
- runpod(phase3-5): pod pool + scaler + cost ledger, budgets, global-gate bypass, spillover, stats UI · 7649c9c2
  Stefy Lanza (nextime / spora ) authored Sep 06, 2026
  7649c9c2
- runpod(phase2): serverless request path + per-model config + no-local-download · 17604ab4
  Stefy Lanza (nextime / spora ) authored Sep 06, 2026
  17604ab4
Sep 01, 2026
- audio: STT backends, diarization, speaker embeddings/ID, word timestamps · 7e5a925c
  Stefy Lanza (nextime / spora ) authored Sep 01, 2026
  7e5a925c
Aug 27, 2026
- logging: durable request-debug sink + non-silent engine log pump · ced55385
  Stefy Lanza (nextime / spora ) authored Aug 27, 2026
  ced55385
- rerank: add /v1/rerank cross-encoder endpoint + surface OCR in /v1/models · e44d41ac
  Stefy Lanza (nextime / spora ) authored Aug 27, 2026
  e44d41ac
Aug 21, 2026
- vllm: first-class engine NODE (shows in engine/task page like nvidia/radeon) · b9a84c01
  Stefy Lanza (nextime / spora ) authored Aug 21, 2026
  b9a84c01
- Add vLLM as a first-class managed engine backend (LLM + OCR Surya2) · a5d9fe82
  Stefy Lanza (nextime / spora ) authored Aug 21, 2026
  a5d9fe82
Aug 16, 2026
- Add dedicated OCR subsystem + finalize multi-engine backends · 2485403f
  Stefy Lanza (nextime / spora ) authored Aug 16, 2026
  2485403f
Jul 31, 2026
- embeddings 300ms default + admin GUI throttle fields; radeon crash-loop breaker · 07dd05a1
  Stefy Lanza (nextime / spora ) authored Jul 31, 2026
  07dd05a1
Jul 29, 2026
- engines: scope cross-backend pooling to the split's lead engine only · cedaabb3
  Stefy Lanza (nextime / spora ) authored Jul 29, 2026
  cedaabb3
- thermal: CPU-hot pauses ALL engines (incl colibri) — revert per-engine exemption · 8ff477c1
  Stefy Lanza (nextime / spora ) authored Jul 29, 2026
  8ff477c1
Jul 28, 2026
- thermal: attribute CPU heat per-engine + graceful colibri pause; add credits · bba1203d
  Stefy Lanza (nextime / spora ) authored Jul 28, 2026
  bba1203d
- colibri: download the GLM-5.2 container from the Models interface like any other · 1b7187d4
  Stefy Lanza (nextime / spora ) authored Jul 28, 2026
  1b7187d4
- colibri: integrate GLM-5.2 native C engine (driven directly, no colibri Python) · 50f54eb3
  Stefy Lanza (nextime / spora ) authored Jul 28, 2026
  50f54eb3
Jul 24, 2026
- fix: front-driven thermal pause indicator no longer erased by engine poll · a7a09b13
  Stefy Lanza (nextime / spora ) authored Jul 24, 2026
  a7a09b13