• Stefy Lanza (nextime / spora )'s avatar
    rerank: add /v1/rerank cross-encoder endpoint + surface OCR in /v1/models · e44d41ac
    Stefy Lanza (nextime / spora ) authored
    Reranker (e.g. BAAI/bge-reranker-v2-m3):
    - new codai/api/rerank.py: /v1/rerank scores querydocument pairs with a native
      AutoModelForSequenceClassification cross-encoder (no new dep), cached +
      VRAM/thermal-managed via request_model like embeddings. Returns
      {index, relevance_score(sigmoid), document?} sorted desc, top_n honored.
    - router: /v1/rerank added to _INFERENCE_PATHS so the front routes it by model
      capability (transformers → nvidia engine), like /v1/embeddings.
    - app: include rerank_router.
    - capabilities: add `reranking` + `ocr` fields; detect 'rerank'/'cross-encoder'
      names as reranking.
    
    /v1/models discoverability:
    - list_models() now appends enabled OCR engines (paddle/doctr/surya) as
      type='ocr' entries (a node subsystem invoked at /v1/ocr?engine=<id>), so
      clients can discover them.
    - a reranker registered in models.json (embedding_models, capabilities
      ['reranking']) surfaces automatically via list_models, like bge-m3.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_01Mw2KQiswmD69T45fTfjKwW
    e44d41ac
Name
Last commit
Last update
..
__init__.py Loading commit data...
_film_net.py Loading commit data...
_rife_ifnet.py Loading commit data...
app.py Loading commit data...
archive.py Loading commit data...
audio_backends.py Loading commit data...
audio_clean.py Loading commit data...
audio_gen.py Loading commit data...
audio_stems.py Loading commit data...
characters.py Loading commit data...
colibri_worker.py Loading commit data...
custom_pipelines.py Loading commit data...
ds4_kv_janitor.py Loading commit data...
ds4_worker.py Loading commit data...
embeddings.py Loading commit data...
environments.py Loading commit data...
faceswap.py Loading commit data...
fastlog.py Loading commit data...
images.py Loading commit data...
k3_worker.py Loading commit data...
kt_worker.py Loading commit data...
log.py Loading commit data...
loras.py Loading commit data...
ocr.py Loading commit data...
parler_worker.py Loading commit data...
pipelines.py Loading commit data...
prompt_cache.py Loading commit data...
ratelimit.py Loading commit data...
rerank.py Loading commit data...
spatial.py Loading commit data...
state.py Loading commit data...
text.py Loading commit data...
transcriptions.py Loading commit data...
tts.py Loading commit data...
tts_backends.py Loading commit data...
urlutils.py Loading commit data...
video.py Loading commit data...
vllm_worker.py Loading commit data...
voice_clone.py Loading commit data...
voice_convert.py Loading commit data...
vpr_salad_server.py Loading commit data...