-
Stefy Lanza (nextime / spora ) authored
The engine emits a lot of debug output during generation. Builtin print() goes through a buffered, lock-guarded text stream — per-call overhead plus a lock that can serialize against other threads on the hot path. New codai/api/fastlog.py fast_print writes each line with a single os.write(1) syscall: unbuffered, no Python-level lock, atomic for pipe writes up to PIPE_BUF (log lines don't interleave), with a fallback to real print() for stderr/failures. Imported as print() in the generation hot path: api/text.py, backends/vulkan.py, backends/ cuda.py. Verified: fast_print mirrors print's signature (sep/end/file/flush), writes to fd 1, falls back for stderr; all three modules compile. Co-Authored-By:
Claude Opus 4.8 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_011DDv7BchtZQWsnPG6Jm49m
e2db1b5c
| Name |
Last commit
|
Last update |
|---|---|---|
| .. | ||
| admin | ||
| api | ||
| backends | ||
| broker | ||
| frontproxy | ||
| models | ||
| openai | ||
| pydantic | ||
| queue | ||
| tasks | ||
| __init__.py | ||
| cli.py | ||
| config.py | ||
| main.py | ||
| platform_paths.py | ||
| system_app.py |