• Stefy Lanza (nextime / spora )'s avatar
    docs: a plan for Unlimited-OCR as a general OCR engine · 343b552c
    Stefy Lanza (nextime / spora ) authored
    baidu/Unlimited-OCR (MIT, 3B, BF16, 8GB) is an in-process OpenAI-endpoint VLM
    that emits layout-tagged blocks with bboxes and categories, and parses long
    documents in one 32k pass.
    
    Four phases: the engine and the <|det|> parser (offline-testable, no GPU);
    serve modes so a local GPU, an endpoint the operator already runs, a managed
    model, a rented pod and no-GPU-at-all are each first-class; a serve profile
    following vllm-ocr.txt, since the architecture is in no released vLLM wheel;
    and document-level OCR designed as a capability of the SUBSYSTEM, because
    coderai's OCR contract is per-page end to end and this model's one-shot mode
    is the reason to lift that.
    
    Records what upstream requires and what each requirement costs us, including
    the three decode preconditions that yield EMPTY OUTPUT rather than an error,
    and the logits processor we cannot set on someone else's endpoint. Language
    coverage is unenumerated upstream, so it is treated as unknown and measured,
    never designed in or out.
    Co-Authored-By: 's avatarClaude Opus 5 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_01PxYHWbCAjjjD7A1rhFKtaW
    343b552c
unlimited-ocr-plan.md 6.9 KB