• Stefy Lanza (nextime / spora )'s avatar
    audio: CrisperWhisper support (isolated venv, verbatim + word timestamps) · b069137b
    Stefy Lanza (nextime / spora ) authored
    CrisperWhisper does verbatim ASR with precise word timestamps, but its custom
    generation config crashes on the server's transformers 5.x. Run it in its own
    venv worker (pinned torch 2.5.1+cu124 + transformers 4.46.3 — last pre-5.x with
    working Whisper word timestamps and a py3.13 tokenizers wheel):
    - codai/api/crisperwhisper_worker.py + tools/crisperwhisper_service.py
      (return_timestamps="word" + CrisperWhisper pause redistribution).
    - requirements-crisperwhisper.txt.
    - stt_backends.py: `crisperwhisper` is its own family -> _RemoteCrisperWhisperBackend
      (HTTP to the worker); generic `whisper-hf` still runs in the shared venv
      (text-only default + graceful timestamp fallback); HF-ASR path now converts any
      container (mp4/m4a/webm) to 16k mono wav first and uses model-correct
      return_timestamps (Whisper True/"word", CTC "chunk"/"word").
    - transcriptions.py: crisperwhisper dispatched as a GPU worker.
    - manager skip-download + admin backend option for whisper-hf/crisperwhisper.
    
    Verified: mp4 -> verbatim text + per-word timestamps, HTTP 200, on the 3090.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_01R6iugoNeEgt9PkajKrFyq4
    b069137b
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
REQUEST-geoclip-embeddings.md Loading commit data...
REQUEST-vpr-embeddings.md Loading commit data...
amdgpu-coredump-05000.bin Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-crisperwhisper.txt Loading commit data...
requirements-nemo.txt Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-ocr-paddle.txt Loading commit data...
requirements-ocr.txt Loading commit data...
requirements-pyannote.txt Loading commit data...
requirements-surya.txt Loading commit data...
requirements-vllm.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...