• Stefy Lanza (nextime / spora )'s avatar
    longcat: the new settings on the model page, and a compiler in the pod image (v0.2.78) · 43ce2008
    Stefy Lanza (nextime / spora ) authored
    Configurable means configurable from the UI, not only from models.json. The
    model page now carries the four settings added over the last commits — text
    encoder quantisation, block-sparse attention, the base checkpoint an avatar
    family borrows tokenizer/text_encoder/vae from, and the context-parallel tile —
    each with the trade-off in the option text, because "nf4" means nothing without
    "~2.8 GB, stays resident" beside it. They are in api_model_configure's
    whitelist too, or the page would offer settings it then dropped on save.
    
    And the RunPod image: block-sparse attention is pure Triton, Triton compiles its
    CUDA driver module the first time it runs, and neither capability base image
    carries a compiler. A pod would have failed with "Failed to find C compiler" on
    the first denoising step — exactly how Surya failed in the local image before
    v0.2.62. gcc and libc6-dev added, and the compiler test now covers this
    Dockerfile alongside the two local ones, since checking only some of them is how
    the gap got there in the first place.
    
    Only this one pod image installs requirements-longcat.txt, so it is the whole
    blast radius of the accelerate and bitsandbytes pins; the main venv already
    carried bitsandbytes for the diffusers 4-bit path, in a separate venv, so there
    is no conflict.
    Co-Authored-By: 's avatarClaude Opus 5 (1M context) <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_0185zEBiy3KWB37xNGSrxL7w
    43ce2008
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
third_party Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
REQUEST-geoclip-embeddings.md Loading commit data...
REQUEST-vpr-embeddings.md Loading commit data...
amdgpu-coredump-05000.bin Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-crisperwhisper.txt Loading commit data...
requirements-h3.txt Loading commit data...
requirements-longcat-train.txt Loading commit data...
requirements-longcat.txt Loading commit data...
requirements-melotts.txt Loading commit data...
requirements-nemo.txt Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-ocr-paddle.txt Loading commit data...
requirements-ocr.txt Loading commit data...
requirements-pyannote.txt Loading commit data...
requirements-surya.txt Loading commit data...
requirements-vllm.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...