• Your Name's avatar
    Fix --loadall model preloading and --debug command line output · 9193536a
    Your Name authored
    - Fixed undefined variable bug where model_name wasn't defined in scope
    - Fixed duplicate model loading when using --loadall/--loadswap with multiple models
    - First model is now only loaded once (skipped in loop if already loaded)
    - Loadall mode now properly preloads all models in VRAM respecting offload strategy
    - Loadswap mode properly loads additional models to RAM
    - Ondemand mode doesn't reload first model
    
    Feature 1: --debug now shows full command line as first output
    Feature 2: --loadall with multiple models now preloads all in VRAM
    9193536a
Name
Last commit
Last update
.vscode Loading commit data...
.gitignore Loading commit data...
LICENSE.md Loading commit data...
README.md Loading commit data...
build.sh Loading commit data...
coder Loading commit data...
coderai Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
requirements.txt~ Loading commit data...