• Stefy Lanza (nextime / spora )'s avatar
    rerank: add /v1/rerank cross-encoder endpoint + surface OCR in /v1/models · e44d41ac
    Stefy Lanza (nextime / spora ) authored
    Reranker (e.g. BAAI/bge-reranker-v2-m3):
    - new codai/api/rerank.py: /v1/rerank scores query↔document pairs with a native
      AutoModelForSequenceClassification cross-encoder (no new dep), cached +
      VRAM/thermal-managed via request_model like embeddings. Returns
      {index, relevance_score(sigmoid), document?} sorted desc, top_n honored.
    - router: /v1/rerank added to _INFERENCE_PATHS so the front routes it by model
      capability (transformers → nvidia engine), like /v1/embeddings.
    - app: include rerank_router.
    - capabilities: add `reranking` + `ocr` fields; detect 'rerank'/'cross-encoder'
      names as reranking.
    
    /v1/models discoverability:
    - list_models() now appends enabled OCR engines (paddle/doctr/surya) as
      type='ocr' entries (a node subsystem invoked at /v1/ocr?engine=<id>), so
      clients can discover them.
    - a reranker registered in models.json (embedding_models, capabilities
      ['reranking']) surfaces automatically via list_models, like bge-m3.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_01Mw2KQiswmD69T45fTfjKwW
    e44d41ac
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
REQUEST-geoclip-embeddings.md Loading commit data...
REQUEST-vpr-embeddings.md Loading commit data...
amdgpu-coredump-05000.bin Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-ocr-paddle.txt Loading commit data...
requirements-ocr.txt Loading commit data...
requirements-surya.txt Loading commit data...
requirements-vllm.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...