• Stefy Lanza (nextime / spora )'s avatar
    install the engines the presenter has been preferring all along · 998d6d97
    Stefy Lanza (nextime / spora ) authored
    LatentSync and MuseTalk have been selectable by name for a while, and
    `engine: "auto"` has ranked both ahead of wav2lip whenever there was a clip to
    drive -- wav2lip works at 96x96 and upscales, which is the soft mouth on a 1080p
    reel. Nothing ever installed them, so every selection ended at "neither on PATH
    nor installed", and the call that would have been made could not have worked
    either: LatentSync requires its checkpoint and UNet config as well as the three
    paths, and MuseTalk takes a YAML task list and writes into a result directory
    rather than taking paths at all.
    
    Coderai orchestrates what it serves, so it installs these. The inference source
    is vendored under third_party/ and pinned to a commit, for the reason LongCat's
    is: an image someone else pulls has to run without network access to a third
    party. The weights come from the Hub on first use, never during a render. Each
    engine gets its own venv on its own python, because both pin stacks the server
    cannot host.
    
    Upstream MuseTalk takes its BiSeNet face-parsing checkpoint off a Google Drive id
    and a pytorch.org URL; both come from a Hub mirror here, so the whole set has one
    provenance.
    
    _managed_engine_ready used to answer "an entrypoint and any .pt anywhere", which
    reads an interrupted download as a working install. It now asks the module that
    knows the file list, and the old heuristic keeps covering an engine an operator
    installed by hand. /v1/video/presenter/engines reports what an uninstalled engine
    is short of, so a client can tell "not yet" from "never here".
    
    Verified live: LatentSync installed from nothing and lip-synced a 2s 480x480 clip
    to real narration in 136s.
    Co-Authored-By: 's avatarClaude Opus 5 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_014T3rZnLhydX9QqUcfBbqLu
    998d6d97
Name
Last commit
Last update
..
latentsync Loading commit data...
longcat_video Loading commit data...
musetalk Loading commit data...
LATENTSYNC-LICENSE Loading commit data...
LATENTSYNC-PINNED Loading commit data...
LONGCAT-VIDEO-LICENSE Loading commit data...
MUSETALK-LICENSE Loading commit data...
MUSETALK-PINNED Loading commit data...
README.md Loading commit data...