• Stefy Lanza (nextime / spora )'s avatar
    host RAM and reserved VRAM are two bars, not one (v0.4.82) · 039edfdb
    Stefy Lanza (nextime / spora ) authored
    The pods page drew one bar -- host RAM -- and printed VRAM underneath it as a
    line of small text. On a page whose job is "what is this rented A40 doing", the
    GPU was the one reading an operator had to take differently from everything
    else on the row.
    
    Both now get a bar, each labelled, each scaled to its own total. The colours
    differ on purpose: host RAM keeps the green/amber/red bands, because that is
    the ceiling that has actually killed pods (an OCR pod was OOM-killed at 128
    in-flight with the GPU never the constraint). VRAM gets a neutral bar and says
    "reserved", because vLLM claims its gpu_memory_utilization share at boot and so
    reads ~90% from the first second on every healthy pod -- run that through the
    load bands and every pod is permanently red, an alarm that is always on, which
    an operator learns to ignore and then ignores the real ones with it.
    
    Either bar is omitted when its telemetry is missing: a booting or unreachable
    pod has none, and an empty bar reads as "idle" when the truth is "unknown".
    
    Tested by running the page's own _memCell() in node over real payload shapes.
    Co-Authored-By: 's avatarClaude Opus 5 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_01S8LAP3ueNzQJtwzhgVbq66
    039edfdb
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
third_party Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
REQUEST-geoclip-embeddings.md Loading commit data...
REQUEST-vpr-embeddings.md Loading commit data...
amdgpu-coredump-05000.bin Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-crisperwhisper.txt Loading commit data...
requirements-h3.txt Loading commit data...
requirements-longcat-train.txt Loading commit data...
requirements-longcat.txt Loading commit data...
requirements-melotts.txt Loading commit data...
requirements-nemo.txt Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-ocr-paddle.txt Loading commit data...
requirements-ocr.txt Loading commit data...
requirements-pyannote.txt Loading commit data...
requirements-surya.txt Loading commit data...
requirements-vllm.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...