• Stefy Lanza (nextime / spora )'s avatar
    make the multimodal path visible in the log · 9b37da2f
    Stefy Lanza (nextime / spora ) authored
    Two completely different pictures sent to a GGUF model with a configured
    mmproj produced byte-identical descriptions, while the same prompt with NO
    image answered differently. So the images reached the model and their content
    did not -- the embeddings carry nothing -- and the log said nothing either way:
    projector init, media-marker substitution, bitmap decode and chunk eval all
    log under names ('mtmd', 'clip', 'bitmap', 'media', 'projector') that the
    load-phase filter did not have, so every one of them was discarded.
    
    Reproduced with two synthetic images (yellow background with a blue triangle
    and a green square; black background with three white circles) at temperature
    0: identical answers, neither resembling either picture, both unlike the
    no-image control. Keeping these lines is what makes the next request say which
    step is losing the pixels.
    Co-Authored-By: 's avatarClaude Opus 5 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_014T3rZozi1Ehk96NG1WesgC
    9b37da2f
Name
Last commit
Last update
..
admin Loading commit data...
api Loading commit data...
backends Loading commit data...
broker Loading commit data...
cluster Loading commit data...
compose Loading commit data...
frontproxy Loading commit data...
models Loading commit data...
ocr Loading commit data...
openai Loading commit data...
pipelines Loading commit data...
pydantic Loading commit data...
queue Loading commit data...
tasks Loading commit data...
util Loading commit data...
__init__.py Loading commit data...
cli.py Loading commit data...
config.py Loading commit data...
hf_cache.py Loading commit data...
main.py Loading commit data...
ocr_fleet_workers.py Loading commit data...
platform_paths.py Loading commit data...
system_app.py Loading commit data...