• Stefy Lanza (nextime / spora )'s avatar
    models: two defects the first real test run exposed · ef60591a
    Stefy Lanza (nextime / spora ) authored
    Running the new test against the live instance found both immediately,
    which is the point of it.
    
    A FORCED REMOTE TEST COULD PASS LOCALLY. /v1/chat/completions is
    deliberately outside the gateway (RemoteOpenAIBackend owns it), so the
    x-coderai-placement header is ignored on that path: a text model with no
    remote configuration was served HERE while the result reported
    where=remote, ok=true. A test that passes in the wrong place is worse
    than no test. Forcing remote is now verified before anything is
    dispatched, and refuses with what is actually missing.
    
    A 200 WITH NO OUTPUT WAS A PASS. The text probe allowed 8 tokens, which
    a reasoning model spends thinking — Qwen3.5-9B answered with
    completion_tokens=0, finish_reason=stop, and the test called it ok. The
    budget is now 64, and an empty result is a failure carrying the numbers
    that explain it, for text, embeddings, images and rerank alike.
    Co-Authored-By: 's avatarClaude Opus 5 (1M context) <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_0182DhR1eFNPQyGmDrpHbedY
    ef60591a
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
REQUEST-geoclip-embeddings.md Loading commit data...
REQUEST-vpr-embeddings.md Loading commit data...
amdgpu-coredump-05000.bin Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-crisperwhisper.txt Loading commit data...
requirements-h3.txt Loading commit data...
requirements-melotts.txt Loading commit data...
requirements-nemo.txt Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-ocr-paddle.txt Loading commit data...
requirements-ocr.txt Loading commit data...
requirements-pyannote.txt Loading commit data...
requirements-surya.txt Loading commit data...
requirements-vllm.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...