Commits · 531ccfba066b2044aa47e2fffeb7414b80abed22 · nexlab / coderai · GitLab

Jul 22, 2026
- embeddings: verify chunk sizes after retokenization + serialize llama ctx access · 531ccfba
  Stefy Lanza (nextime / spora ) authored Jul 22, 2026
  531ccfba
- embeddings: chunk over-long GGUF inputs instead of truncating · ffd6629c
  Stefy Lanza (nextime / spora ) authored Jul 22, 2026
  ffd6629c
- embeddings: GGUF inputs longer than n_batch crashed the whole engine · 4ace5612
  Stefy Lanza (nextime / spora ) authored Jul 22, 2026
  4ace5612
- embeddings: GGUF backend via llama.cpp embedding mode · 18ab5ad1
  Stefy Lanza (nextime / spora ) authored Jul 22, 2026
  18ab5ad1
- embeddings: serialize per-model loads — concurrent bursts stacked duplicate copies · 540566b0
  Stefy Lanza (nextime / spora ) authored Jul 22, 2026
  540566b0
- video: fix VRAM teardown leak + track in-flight loads with reservations · 2ea24b0b
  Stefy Lanza (nextime / spora ) authored Jul 22, 2026
  2ea24b0b
- embeddings: evict-and-retry on CUDA OOM, like every other model type · 872f6c61
  Stefy Lanza (nextime / spora ) authored Jul 22, 2026
  872f6c61
- Revert "embeddings: CPU fallback when the GPU is owned by another workload" · 78037a0d
  Stefy Lanza (nextime / spora ) authored Jul 22, 2026
  78037a0d
- embeddings: CPU fallback when the GPU is owned by another workload · 7908670c
  Stefy Lanza (nextime / spora ) authored Jul 22, 2026
  7908670c
- api: fix vision-request usage crash in stream finalizer; raise embeddings rate limit · 018f9c51
  Stefy Lanza (nextime / spora ) authored Jul 22, 2026
  018f9c51
- vulkan: vision requests must bypass the fast chat-render path · 40635282
  Stefy Lanza (nextime / spora ) authored Jul 22, 2026
  40635282
- turboquant: ship turboquant-py + accurate bit-width errors for the library backend · 4d2aeb69
  Stefy Lanza (nextime / spora ) authored Jul 22, 2026
  4d2aeb69
- embeddings: re-normalize after matryoshka `dimensions` truncation · 1bfa441b
  Stefy Lanza (nextime / spora ) authored Jul 22, 2026
  1bfa441b
- embeddings: DINOv2 image-only backend + native GME-Qwen2-VL multimodal backend · 7980f408
  Stefy Lanza (nextime / spora ) authored Jul 22, 2026
  7980f408
Jul 21, 2026
- frontproxy: accept port-specific session_<port> cookie in telemetry auth · 8a9e0183
  Stefy Lanza (nextime / spora ) authored Jul 22, 2026
  8a9e0183
- embeddings: multimodal (text+image) support + correct VRAM tracking/eviction · dd848607
  Stefy Lanza (nextime / spora ) authored Jul 22, 2026
  dd848607
Jul 03, 2026
- lora-train: cross-engine GPU lock so nothing reloads mid-training (fix intermittent OOM) · 18c6a358
  Stefy Lanza (nextime / spora ) authored Jul 03, 2026
  18c6a358
- images: stop video's flash-attn backend leaking to image models (Z-Image attn_mask crash) · 0043eb2a
  Stefy Lanza (nextime / spora ) authored Jul 03, 2026
  0043eb2a
Jul 02, 2026
- lora-train: evict co-located sibling engine's VRAM before training (fix OOM) · e300e9c4
  Stefy Lanza (nextime / spora ) authored Jul 02, 2026
  e300e9c4
- images: quantized models must not load in f32 (FlashAttention needs fp16/bf16) · b3014a3d
  Stefy Lanza (nextime / spora ) authored Jul 02, 2026
  b3014a3d
Jul 01, 2026
- pipeline-cache: reject corrupt-JSON caches (stop the empty-tokenizer death spiral) · 31793b05
  Stefy Lanza (nextime / spora ) authored Jul 01, 2026
  31793b05
- frontproxy: fix leaked GPU-swap slot on request cancellation (queued swap never fired) · df948c48
  Stefy Lanza (nextime / spora ) authored Jul 01, 2026
  df948c48
- frontproxy: intelligent per-shared-GPU model-swap queue (batch, then swap) · c0a970b0
  Stefy Lanza (nextime / spora ) authored Jul 01, 2026
  c0a970b0
- manager: clean cross-engine VRAM swap (evict a busy sibling at its unit boundary) · c9791579
  Stefy Lanza (nextime / spora ) authored Jul 01, 2026
  c9791579
Jun 30, 2026
- video: fix dual-expert OOM regression + harden pipeline VRAM teardown · e1ab02b1
  Stefy Lanza (nextime / spora ) authored Jun 30, 2026
  e1ab02b1
Jun 29, 2026
- video: gate 'auto' attention on diffusers' real Sage usability · fcd74214
  Stefy Lanza (nextime / spora ) authored Jun 29, 2026
  fcd74214
- video: resident all-GPU experts + faster attention backend (flash/sage) · fe2cdee1
  Stefy Lanza (nextime / spora ) authored Jun 29, 2026
  fe2cdee1
- video: malloc_trim host RAM after each clip (stop glibc arena from hoarding decode buffers) · 6bbc2d31
  Stefy Lanza (nextime / spora ) authored Jun 29, 2026
  6bbc2d31
- manager: universal footprint rule — already-quantized (cached) models measured... · 88c1e787
  Stefy Lanza (nextime / spora ) authored Jun 29, 2026
  88c1e787
- manager: measured_vram_gb = FULL model footprint (GPU + offloaded), not the resident slice · 273eb23c
  Stefy Lanza (nextime / spora ) authored Jun 29, 2026
  273eb23c
- video: OOM fallback LADDER (no 5xx until exhausted) + monolithic cache finalize · b8bcdfea
  Stefy Lanza (nextime / spora ) authored Jun 29, 2026
  b8bcdfea
- manager: sweep orphan VRAM + untracked-VRAM diagnostic before every video load · 2ab70301
  Stefy Lanza (nextime / spora ) authored Jun 29, 2026
  2ab70301
- video: revert to model offload for injected components (the leak, not model offload, was the OOM) · 1dbf15ed
  Stefy Lanza (nextime / spora ) authored Jun 29, 2026
  1dbf15ed
- video: fix generation-OOM VRAM leak (traceback pin) + use sequential offload... · bc31e2d5
  Stefy Lanza (nextime / spora ) authored Jun 29, 2026
  bc31e2d5
Jun 28, 2026
- video: hook-based offload for injected cache components (fix device mismatch); gen retry safety net · 9ed35326
  Stefy Lanza (nextime / spora ) authored Jun 28, 2026
  9ed35326
- video: incremental per-component pipeline cache (load/build/cache one component at a time) · 93e2a4b9
  Stefy Lanza (nextime / spora ) authored Jun 28, 2026
  93e2a4b9
- video: stop the offload retry death-spiral; log swallowed load/gen errors; robust pipeline cache · e48b90e0
  Stefy Lanza (nextime / spora ) authored Jun 28, 2026
  e48b90e0
- manager: don't strand VRAM or churn the live model on eviction · bb95ab1d
  Stefy Lanza (nextime / spora ) authored Jun 28, 2026
  bb95ab1d
Jun 27, 2026
- router: pin video generation to a capable engine (never the gguf-only sibling) · cc6db025
  Stefy Lanza (nextime / spora ) authored Jun 27, 2026
  cc6db025
- gpu: scope per-engine VRAM to the engine's own card (fix Radeon showing NVIDIA) · ff39ee42
  Stefy Lanza (nextime / spora ) authored Jun 27, 2026
  ff39ee42