Skip to content

  • Projects
  • Groups
  • Snippets
  • Help
    • Loading...
    • Help
    • Contribute to GitLab
  • Sign in
C
coderai
  • Project
    • Project
    • Details
    • Activity
    • Cycle Analytics
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
    • Charts
  • Issues 0
    • Issues 0
    • List
    • Board
    • Labels
    • Milestones
  • Merge Requests 0
    • Merge Requests 0
  • CI / CD
    • CI / CD
    • Pipelines
    • Jobs
    • Schedules
    • Charts
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Members
    • Members
  • Collapse sidebar
  • Activity
  • Graph
  • Charts
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
  • nexlab
  • coderai
  • Repository

Switch branch/tag
  • coderai
  • codai
  • models
  • acceleration.py
Find file
BlameHistoryPermalink
  • Stefy Lanza (nextime / spora )'s avatar
    fix: apply peft<->gptqmodel AWQ shim on the inference LoRA path too · 3fb6c9b9
    Stefy Lanza (nextime / spora ) authored Jun 26, 2026
    Loading a trained LoRA at inference (e.g. a fighter LoRA on an image pipeline)
    crashed with "cannot import name AwqGEMMQuantLinear" because peft dispatches AWQ
    for any non-bnb target when gptqmodel is installed, and gptqmodel 7.1.0 renamed
    that class to AwqGEMMLinear. The alias shim existed only in the training path.
    
    Extract it to codai/models/peft_compat.ensure_peft_awq_compat() (cached) and call
    it before load_lora_weights in codai/api/images._apply_loras and the acceleration
    fuse path; the trainer now delegates to the shared shim.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_01RdMufYvtTbtGDWsiZVoXce
    3fb6c9b9
acceleration.py 15.8 KB
EditWeb IDE

Replace acceleration.py

Attach a file by drag & drop or click to upload


Cancel
A new branch will be created in your fork and a new merge request will be started.