Direct Kilocode requests showed ~40s before the first token even though prefill
was a cache hit (14551 prefix-match, 1 token to eval) — so the delay is before
decode. Added timing in vulkan generate_chat_stream: logs "[timing] chat build
(template+tokenize)" around create_chat_completion (eager chat-template render +
tokenize) and "[timing] chat lock+prefill+first-token" around the first streamed
token. One request now reveals whether the 40s is the gemma chat-template Jinja
render (huge template + many tool schemas, done in Python) or lock/prefill.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_011DDv7BchtZQWsnPG6Jm49m