• Stefy Lanza (nextime / spora )'s avatar
    longcat: serve the avatar families, which ship no text encoder (v0.2.72) · 4980fd8b
    Stefy Lanza (nextime / spora ) authored
    LongCat-Video-Avatar-1.5 is a transformer and an audio encoder: base_model/,
    base_model_int8/, lora/dmd_lora, scheduler/, whisper-large-v3/. It has NO
    tokenizer, text_encoder or vae. Its README says so in its own frontmatter
    (`base_model: meituan-longcat/LongCat-Video`) and upstream's instructions
    download both repos side by side.
    
    Validated against the base checkpoint's layout it reported four missing
    directories that were never part of the repo, and the loader would then have
    asked from_pretrained for a text_encoder/ that does not exist — and for
    subfolder="dit", where the avatar transformer is base_model/.
    
    So the layout is family-aware now. An avatar checkpoint contributes its
    scheduler, its transformer (base_model/ at bf16, base_model_int8/ at int8) and
    its LoRA; tokenizer/text_encoder/vae are borrowed from a base checkpoint, named
    by `base_model` per model or falling back to the upstream repo id, which
    resolve_checkpoint() turns into a local snapshot. A base checkpoint that is
    absent or incomplete is reported AS the base checkpoint, rather than as a
    tokenizer missing from the avatar repo, which sends you looking in the wrong
    place.
    
    Either transformer alone is enough to validate: base_model/ is 31.7 GB of bf16
    that cannot fit a 24 GB card, so it is deliberately not downloaded here.
    
    Verified against the real checkpoint: family avatar-1.5, shared components
    resolving to the base snapshot, 4 INT8 shards with 2241 keys matching the index
    and 633 quantised Linear layers (the base DiT has 437 — the difference is the
    audio cross-attention), dmd_lora present. All three validators return [].
    Co-Authored-By: 's avatarClaude Opus 5 (1M context) <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_0185zEBiy3KWB37xNGSrxL7w
    4980fd8b
test_longcat_avatar_layout.py 6.81 KB