Skip to content

  • Projects
  • Groups
  • Snippets
  • Help
    • Loading...
    • Help
    • Contribute to GitLab
  • Sign in
C
coderai
  • Project
    • Project
    • Details
    • Activity
    • Cycle Analytics
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
    • Charts
  • Issues 0
    • Issues 0
    • List
    • Board
    • Labels
    • Milestones
  • Merge Requests 0
    • Merge Requests 0
  • CI / CD
    • CI / CD
    • Pipelines
    • Jobs
    • Schedules
    • Charts
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Members
    • Members
  • Collapse sidebar
  • Activity
  • Graph
  • Charts
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
  • nexlab
  • coderai
  • Repository

Switch branch/tag
  • coderai
  • requirements-nvidia.txt
Find file
BlameHistoryPermalink
  • Stefy Lanza (nextime / spora )'s avatar
    deps: bump bitsandbytes to >=0.50.2 (fix 4-bit load on transformers 5.12) · 28d7711d
    Stefy Lanza (nextime / spora ) authored Aug 27, 2026
    bitsandbytes 0.49.2's Params4bit.__new__ has no **kwargs and rejects the
    _is_hf_initialized kwarg that transformers 5.12 passes during 4-bit weight
    init, so every load_in_4bit model crashed with:
      Params4bit.__new__() got an unexpected keyword argument '_is_hf_initialized'
    In production this turned a single default-model chat request (Qwen3.5-9B,
    load_in_4bit) into a ~2h internal 60-retry storm. bnb 0.50.2 adds **kwargs to
    Params4bit.__new__ (absorbs _is_hf_initialized); verified end-to-end: a
    transformers load_in_4bit load now succeeds on cuda:0 (torch 2.11/cu130), and a
    GPU 4-bit quantize/dequantize round-trips. Image rebuilt with bnb 0.50.2.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_01Mw2KQiswmD69T45fTfjKwW
    28d7711d
requirements-nvidia.txt 3.97 KB
EditWeb IDE

Replace requirements-nvidia.txt

Attach a file by drag & drop or click to upload


Cancel
A new branch will be created in your fork and a new merge request will be started.