• Stefy Lanza (nextime / spora )'s avatar
    engines: scope cross-backend pooling to the split's lead engine only · cedaabb3
    Stefy Lanza (nextime / spora ) authored
    allow_cross ("use both cards for one model") was applied to EVERY engine the
    moment any model enabled gpu_split — which un-isolated the radeon engine's
    Vulkan ICD too. Combined with the embedding loader not pinning non-split models
    to their native card, the radeon engine's embeddings (Qwen3-Embedding,
    gme-Qwen2-VL) drifted onto the NVIDIA 3090 after a Vulkan device-order change.
    
    Scope it: each engine is isolated to its own backend by default; a per-model
    split names its lead engine (the model's `engine` field), and only that lead's
    card gets cross-backend visibility. A global offload.gpu_split still crosses all
    engines (explicit opt-in). Preserves nvidia-led splits onto the RX 580 while
    keeping radeon/intel Vulkan engines pinned to their own card. Bump 0.1.80.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_0196Gm4PNkcuybDj9yfcz3CR
    cedaabb3
Name
Last commit
Last update
..
admin Loading commit data...
api Loading commit data...
backends Loading commit data...
broker Loading commit data...
frontproxy Loading commit data...
models Loading commit data...
openai Loading commit data...
pydantic Loading commit data...
queue Loading commit data...
tasks Loading commit data...
__init__.py Loading commit data...
cli.py Loading commit data...
config.py Loading commit data...
main.py Loading commit data...
platform_paths.py Loading commit data...
system_app.py Loading commit data...