Commit 44941ac6 authored by Your Name's avatar Your Name

Add whispercpp support for audio transcription without PyTorch

- Update transcription endpoint to try faster-whisper first, then whispercpp
- Update pre-loading code to support both backends
- Add whispercpp to all requirements files (vulkan, nvidia, default)
- Remove broken llama.cpp fallback (llama.cpp cannot transcribe Whisper)
parent 6ef7a2dd
This diff is collapsed.
...@@ -13,6 +13,7 @@ psutil>=5.9.0 ...@@ -13,6 +13,7 @@ psutil>=5.9.0
# Optional: Audio transcription dependencies # Optional: Audio transcription dependencies
faster-whisper>=0.10.0 # For NVIDIA/CUDA whisper transcription faster-whisper>=0.10.0 # For NVIDIA/CUDA whisper transcription
whispercpp>=1.0.0 # Alternative whisper library (works without PyTorch)
# Optional: for better performance with NVIDIA GPUs # Optional: for better performance with NVIDIA GPUs
bitsandbytes>=0.41.0 bitsandbytes>=0.41.0
......
...@@ -13,4 +13,6 @@ psutil>=5.9.0 ...@@ -13,4 +13,6 @@ psutil>=5.9.0
# HuggingFace Hub for downloading GGUF models # HuggingFace Hub for downloading GGUF models
huggingface-hub>=0.19.0 huggingface-hub>=0.19.0
# No PyTorch needed for Vulkan backend - llama-cpp handles everything # Optional: Audio transcription without PyTorch (whispercpp)
# Note: faster-whisper requires PyTorch, but whispercpp works without it
whispercpp>=1.0.0 # For GGUF-based Whisper transcription without PyTorch
...@@ -38,7 +38,7 @@ procname>=0.3.0 ...@@ -38,7 +38,7 @@ procname>=0.3.0
# Optional: Audio transcription dependencies # Optional: Audio transcription dependencies
faster-whisper>=0.10.0 # For NVIDIA/CUDA whisper transcription faster-whisper>=0.10.0 # For NVIDIA/CUDA whisper transcription
# whispercpp>=1.0.0 # Alternative whisper library (requires system dependencies) whispercpp>=1.0.0 # Alternative whisper library (works without PyTorch)
# Optional: for better performance # Optional: for better performance
# bitsandbytes>=0.41.0 # for 4-bit/8-bit quantization # bitsandbytes>=0.41.0 # for 4-bit/8-bit quantization
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment