Two remaining GGUF crashers: (1) detokenize→retokenize is not
token-count-stable, so a chunk cut at exactly n_ctx could re-inflate
past it inside embed() and trip the GGML_ASSERT — chunks are now
shrunk until their re-tokenized length verifiably fits (n_ctx-64
margin); (2) llama.cpp contexts are not thread-safe and parallel
indexer requests segfaulted the engine (-11) — embed calls now hold a
per-model lock.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_014S8VtAvG499SsCbeESRK7V