1. 27 Feb, 2026 2 commits
    • Stefy Lanza (nextime / spora )'s avatar
      Fix NaN/inf probability tensor error during generation · ae1d0e38
      Stefy Lanza (nextime / spora ) authored
      - Add InvalidLogitsProcessor to replace NaN and Inf values with finite numbers
      - Add _validate_generation_params() to clamp temperature and top_p to valid ranges
      - Add try-except blocks with fallback to greedy decoding on numerical errors
      - Add error handling in streaming responses to prevent crashes
      - Fix temperature=0 handling to use greedy decoding instead of sampling
      ae1d0e38
    • Stefy Lanza (nextime / spora )'s avatar
      Initial commit: Add CoderAI OpenAI-compatible API server · 087ba9e1
      Stefy Lanza (nextime / spora ) authored
      - Add main server script with FastAPI and memory-aware model loading
      - Add requirements.txt with dependencies and platform-specific PyTorch options
      - Add comprehensive README.md with installation, usage, and troubleshooting
      - Add LICENSE.md with GPLv3 license
      087ba9e1