vLLM enables async scheduling -- CPU scheduling overlapped with GPU execution --
by default, and lists plain "ngram" among the methods it cannot run with, so
asking for ngram silently turns it off: the draft is paid for with a throughput
loss somewhere else, and the log says so in a warning nobody reads twice.
"ngram_gpu" drafts by the same prompt-lookup, needs no model and no VRAM either,
and keeps async scheduling. Both spellings work; the field now suggests the one
that does not take something away.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01S8LAP3ueNzQJtwzhgVbq66