• Stefy Lanza (nextime / spora )'s avatar
    embeddings: native bge-m3 dense+sparse(+colbert) multi-vector support · 66f5540b
    Stefy Lanza (nextime / spora ) authored
    Add BAAI/bge-m3 hybrid embedding (dense + sparse lexical, optional colbert)
    without the FlagEmbedding dependency (which pins older transformers/peft and
    would conflict with the transformers 5.x stack): the sparse/colbert heads are
    plain Linear layers over XLM-RoBERTa's last hidden state, reproduced natively
    with transformers + torch already in the venv.
    
    - new 'bge-m3' embedding backend: detected by xlm-roberta model_type + a
      sparse_linear.pt head (so plain bge-large etc. stay on the dense ST path);
      loads the base model + sparse_linear.pt (+ colbert_linear.pt if present).
    - _bge_m3_encode: dense = L2-normalized CLS; sparse = max-pooled
      relu(sparse_linear·h) per token id (specials dropped) as {token_id: weight};
      colbert = L2-normalized colbert_linear·h per content token.
    - /v1/embeddings extended: request.embedding_types selects any of
      dense|sparse|colbert (overrides the model-config default); response items
      gain sparse_embedding {indices, values} and colbert_embedding. Dense stays
      in the standard `embedding` field (base64 honored). Configurable default via
      the model's embedding_types config.
    - cleanup()/eviction branch moves the base model + heads off GPU.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_01Mw2KQiswmD69T45fTfjKwW
    66f5540b
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
REQUEST-geoclip-embeddings.md Loading commit data...
REQUEST-vpr-embeddings.md Loading commit data...
amdgpu-coredump-05000.bin Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-ocr-paddle.txt Loading commit data...
requirements-ocr.txt Loading commit data...
requirements-surya.txt Loading commit data...
requirements-vllm.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...