• Stefy Lanza (nextime / spora )'s avatar
    images: stop attention slicing from silently killing every IP-Adapter load · 71f88d14
    Stefy Lanza (nextime / spora ) authored
    Found by actually running it, not by reading it. Every IP-Adapter load was
    failing with
    
      SlicedAttnProcessor.__init__() missing 1 required positional argument: 'slice_size'
    
    and _ensure_ip_adapter_loaded() caught it, logged a warning and returned False —
    so character_profiles fell back to the prompt hint on the ONE path that was
    supposed to have real identity conditioning. The image came back looking
    plausible, which is why it was never noticed.
    
    Cause: we enable attention slicing for VRAM headroom, and diffusers' adapter
    loader rebuilds every attention processor; re-instantiating a SlicedAttnProcessor
    without its required slice_size raises. Slicing is now disabled for the load and
    left off while the adapter is in use (re-enabling would swap the IP-Adapter
    processors straight back out), and restored if the load fails anyway.
    
    Verified: the SlicedAttnProcessor error is gone.
    
    NOT yet working — the next blocker, now visible underneath: on a QUANTIZED
    pipeline the load fails with "Casting a quantized model to a new dtype is
    unsupported". So IP-Adapter still cannot attach to a 4-bit image model, and
    identity conditioning needs an unquantized image model (or a follow-up that loads
    the image encoder with an explicit dtype). Do not describe character identity as
    working end to end until that is resolved.
    Co-Authored-By: 's avatarClaude Opus 5 (1M context) <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_01R6iugoNeEgt9PkajKrFyq4
    71f88d14
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
REQUEST-geoclip-embeddings.md Loading commit data...
REQUEST-vpr-embeddings.md Loading commit data...
amdgpu-coredump-05000.bin Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-crisperwhisper.txt Loading commit data...
requirements-nemo.txt Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-ocr-paddle.txt Loading commit data...
requirements-ocr.txt Loading commit data...
requirements-pyannote.txt Loading commit data...
requirements-surya.txt Loading commit data...
requirements-vllm.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...