• Stefy Lanza (nextime / spora )'s avatar
    longcat: the new settings on the model page, and a compiler in the pod image (v0.2.78) · 43ce2008
    Stefy Lanza (nextime / spora ) authored
    Configurable means configurable from the UI, not only from models.json. The
    model page now carries the four settings added over the last commits — text
    encoder quantisation, block-sparse attention, the base checkpoint an avatar
    family borrows tokenizer/text_encoder/vae from, and the context-parallel tile —
    each with the trade-off in the option text, because "nf4" means nothing without
    "~2.8 GB, stays resident" beside it. They are in api_model_configure's
    whitelist too, or the page would offer settings it then dropped on save.
    
    And the RunPod image: block-sparse attention is pure Triton, Triton compiles its
    CUDA driver module the first time it runs, and neither capability base image
    carries a compiler. A pod would have failed with "Failed to find C compiler" on
    the first denoising step — exactly how Surya failed in the local image before
    v0.2.62. gcc and libc6-dev added, and the compiler test now covers this
    Dockerfile alongside the two local ones, since checking only some of them is how
    the gap got there in the first place.
    
    Only this one pod image installs requirements-longcat.txt, so it is the whole
    blast radius of the accelerate and bitsandbytes pins; the main venv already
    carried bitsandbytes for the diffusers 4-bit path, in a separate venv, so there
    is no conflict.
    Co-Authored-By: 's avatarClaude Opus 5 (1M context) <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_0185zEBiy3KWB37xNGSrxL7w
    43ce2008
Name
Last commit
Last update
..
archive.html Loading commit data...
base.html Loading commit data...
change_password.html Loading commit data...
chat.html Loading commit data...
cluster.html Loading commit data...
dashboard.html Loading commit data...
login.html Loading commit data...
models.html Loading commit data...
runpod.html Loading commit data...
settings.html Loading commit data...
tasks.html Loading commit data...
tokens.html Loading commit data...
users.html Loading commit data...