The pod booted healthy, answered /v1/models, advertised bge-m3 -- and
failed every embedding request with

  Model 'BAAI/bge-m3' failed to load: Using a `device_map`, `tp_plan`,
  `torch.device` context manager or setting `torch.set_default_device(device)`
  requires `accelerate`

sentence-transformers loads under a device_map context and transformers
refuses that without accelerate. It is in requirements.txt and in the
text, images, video and stt-crisper profiles; it was never in this one.

What makes it worth a comment in the file rather than just a line: the
failure does not look like a missing dependency from outside. The image
is healthy, the catalogue is right, and the error names the MODEL. On a
real A40 that cost 303 seconds of boot before anyone could find out, and
the next error after it ("'BAAI/bge-m3' is a text model") sends the
reader somewhere else entirely.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01HXRMe9ZPUQCCCtBai9uqt3