Commits · 0894af9b0a203dad8d31db4b2a886beca7de1991 · nexlab / coderai · GitLab

Oct 05, 2026
- longcat: the worker, the isolated service and the dispatch branch (v0.2.31) · 0894af9b
  Stefy Lanza (nextime / spora ) authored Oct 05, 2026
  0894af9b
- longcat: the isolated Python 3.10 venv and its packaging (v0.2.30) · 7f7597ff
  Stefy Lanza (nextime / spora ) authored Oct 05, 2026
  7f7597ff
- runpod: let a pod serve the VLM OCR engines it was configured for (v0.2.29) · 8ae02a35
  Stefy Lanza (nextime / spora ) authored Oct 05, 2026
  8ae02a35
- vllm: size the share down too, from the cache a successful boot reports (v0.2.28) · bb2389ff
  Stefy Lanza (nextime / spora ) authored Oct 05, 2026
  bb2389ff
- vllm: discover the share an engine needs instead of trusting a constant (v0.2.27) · aa085f85
  Stefy Lanza (nextime / spora ) authored Oct 05, 2026
  aa085f85
- ocr: size the VLM share to the measured footprint and cap its batch (v0.2.26) · f25592dc
  Stefy Lanza (nextime / spora ) authored Oct 05, 2026
  f25592dc
Oct 04, 2026
- front: OCR takes its turn at the shared-GPU swap gate, unless it runs off-box · 3cb4d23d
  Stefy Lanza (nextime / spora ) authored Oct 04, 2026
  3cb4d23d
- ocr: hand the card over at a page boundary, so OCR takes turns like any model · 4be32ede
  Stefy Lanza (nextime / spora ) authored Oct 04, 2026
  4be32ede
- ocr: size a VLM engine's vLLM against free VRAM, and never answer 503 (v0.2.25) · b1004ebd
  Stefy Lanza (nextime / spora ) authored Oct 04, 2026
  b1004ebd
Oct 02, 2026
- ocr: olmOCR-2 as an alternative engine, and stop the Surya-2 crash loop (v0.2.24) · 75200c0b
  Stefy Lanza (nextime / spora ) authored Oct 02, 2026
  75200c0b
Sep 30, 2026
- compose: talking presenter (lip-synced character) and /v1/video/talking-head · b8b5ba3a
  Stefy Lanza (nextime / spora ) authored Sep 30, 2026
  b8b5ba3a
- characters/voices: accept /v1/files paths and sha256 upload ids as media · be1ecdf4
  Stefy Lanza (nextime / spora ) authored Sep 30, 2026
  be1ecdf4
- compose: POST /v1/video/compose and POST /v1/files/upload (v0.2.22) · 5abbb81d
  Stefy Lanza (nextime / spora ) authored Sep 30, 2026
  5abbb81d
Sep 20, 2026
- cluster: mDNS discovery with a shared token, prefix-cache routing, Prometheus... · 0d4a338b
  Stefy Lanza (nextime / spora ) authored Sep 20, 2026
  0d4a338b
Sep 19, 2026
- host pools: keep the single-host wording and _run signature; start/stop... · 70453cd6
  Stefy Lanza (nextime / spora ) authored Sep 19, 2026
  70453cd6
- docs: distributed generation, pipeline parts on other machines, multi-node LoRA training; v0.2.20 · 2614bccf
  Stefy Lanza (nextime / spora ) authored Sep 19, 2026
  2614bccf
- cluster: parts of a video pipeline on other machines · ff2a7f37
  Stefy Lanza (nextime / spora ) authored Sep 19, 2026
  ff2a7f37
- cluster: LoRA / QLoRA training over several machines · b0e7a66a
  Stefy Lanza (nextime / spora ) authored Sep 19, 2026
  b0e7a66a
- cluster: work-parallel fan-out of one request over engines and nodes · d7e6600f
  Stefy Lanza (nextime / spora ) authored Sep 19, 2026
  d7e6600f
- tagline: complete orchestration, distribution and escalation of remotizable advanced inference · c11d02dc
  Stefy Lanza (nextime / spora ) authored Sep 19, 2026
  c11d02dc
- cluster: nodes as engines, one GGUF over llama.cpp RPC, vLLM/SGLang... · f5ca2d82
  Stefy Lanza (nextime / spora ) authored Sep 19, 2026
  f5ca2d82
Sep 18, 2026
- runpod: direct TCP is the default for coderai images · c9fa479c
  Stefy Lanza (nextime / spora ) authored Sep 18, 2026
  c9fa479c
- gateway: retry a fresh pod's first not-found/unavailable answers before believing them · b3b684cc
  Stefy Lanza (nextime / spora ) authored Sep 18, 2026
  b3b684cc
- vllm / engines-kt pods: a C compiler for Triton, and a root-cause error tail · b3b4dc5c
  Stefy Lanza (nextime / spora ) authored Sep 18, 2026
  b3b4dc5c
- runpod: drop a pod that refuses connections and retry once on a fresh one · 2315e84f
  Stefy Lanza (nextime / spora ) authored Sep 18, 2026
  2315e84f
Sep 17, 2026
- llama pod on the light core: the GGUF backend asks NVML about the card, not torch · 4866b69d
  Stefy Lanza (nextime / spora ) authored Sep 17, 2026
  4866b69d
- runpod: coderai-vllm and coderai-llama — the LLM servers as coderai pods · d11f14ae
  Stefy Lanza (nextime / spora ) authored Sep 17, 2026
  d11f14ae
- pod_http: delegate ordinary URLs to requests' own verbs · 12c72909
  Stefy Lanza (nextime / spora ) authored Sep 17, 2026
  12c72909
- runpod: TLS on direct-TCP pods — both no-cutoff and encrypted · d83404ae
  Stefy Lanza (nextime / spora ) authored Sep 17, 2026
  d83404ae
- runpod: direct_tcp — reach a pod at its public ip:port, bypassing the Cloudflare-fronted proxy · 9ce38f02
  Stefy Lanza (nextime / spora ) authored Sep 17, 2026
  9ce38f02
Sep 16, 2026
- runpod: ktransformers on pods — engines-kt image with SGLang + kt-kernel in their own venv · 37f46a33
  Stefy Lanza (nextime / spora ) authored Sep 16, 2026
  37f46a33
- runpod: an engines pod image — ds4, colibri, k3 compiled for every pod GPU · 1e093d27
  Stefy Lanza (nextime / spora ) authored Sep 16, 2026
  1e093d27
- admin: make 'runs only on RunPod' a visible placement choice; host backend gets a form · 362ff475
  Stefy Lanza (nextime / spora ) authored Sep 16, 2026
  362ff475
- version: 0.2.18 · c7d43c5a
  Stefy Lanza (nextime / spora ) authored Sep 16, 2026
  c7d43c5a
- runpod: multi-GPU pods (gpu_count) and remote requests on the Tasks page · 3ae88a89
  Stefy Lanza (nextime / spora ) authored Sep 16, 2026
  3ae88a89
- runpod: let the operator state a model's size instead of estimating it · aa15a695
  Stefy Lanza (nextime / spora ) authored Sep 16, 2026
  aa15a695
- gateway: ask a pod for the engine it can serve, in the request itself · 69746387
  Stefy Lanza (nextime / spora ) authored Sep 16, 2026
  69746387
- xtts: keep the protocol clean and accept the licence; surya on a pod serves docTR · f0986acb
  Stefy Lanza (nextime / spora ) authored Sep 16, 2026
  f0986acb
- ocr: match the surya the local install actually runs, and stop hiding its errors · 64ac2d05
  Stefy Lanza (nextime / spora ) authored Sep 16, 2026
  64ac2d05
- host backend: a capability image on a machine you already have · 8310821e
  Stefy Lanza (nextime / spora ) authored Sep 16, 2026
  8310821e