kt was refused because it looked unshippable: a Python stack pinning its
own torch, thought to be AMX-only. kt-kernel 0.7 ships prebuilt manylinux
wheels that dispatch at runtime (AMX, AVX-512, AVX2 llamafile, AMD BLIS),
and sglang-kt pins the matching torch — so it is a venv on the light
core like the other split images. The worker now launches SGLang from
that venv (CODERAI_KT_VENV / ktransformers.venv) instead of assuming
coderai's interpreter has it, and accepts a HF repo id, which SGLang
downloads into the volume's cache.
Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_0182DhR1eFNPQyGmDrpHbedY