Skip to content

C
coderai
Switch branch/tag
History Find file
  • Stefy Lanza (nextime / spora )'s avatar
    packaging: build SageAttention into the OCI image (non-fatal, arch-gated) · c4b4b884
    Stefy Lanza (nextime / spora ) authored 
    The diffusers video path uses SageAttention (INT8 attention) when available
for faster Wan2.2 rendering. Like flash-attn it is CUDA-arch-sensitive, so
it is built from source in the devel/builder stage against the just-installed
torch, gated by BUILD_SAGEATTENTION (default 1) and SAGEATTENTION_ARCH
(default 8.6 = RTX 3090). The build is non-fatal: on failure the image still
works and the runtime attention-backend resolver falls back to flash/SDPA.

build_oci_image.sh passes the three new args through (overridable via env:
BUILD_SAGEATTENTION / SAGEATTENTION_REF / SAGEATTENTION_ARCH).

Note: the fast update_oci_image.sh overlay is based on the runtime image (no
nvcc), so it cannot build SageAttention — a full build_oci_image.sh is needed
to bake it in.
Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01RdMufYvtTbtGDWsiZVoXce
    c4b4b884
Name
Last commit
 Last update
..
dist-bundle Loading commit data...
launcher Loading commit data...
Dockerfile.oci Loading commit data...
Dockerfile.oci-venv Loading commit data...
Dockerfile.update Loading commit data...
README-RUN.txt Loading commit data...
build_oci_image.sh Loading commit data...
make_dist_bundle.sh Loading commit data...
make_tarball_from_venv.sh Loading commit data...
nginx.conf Loading commit data...
package_oci_image.sh Loading commit data...
run_oci.sh Loading commit data...
smoke_test_oci.sh Loading commit data...
smoke_test_services.sh Loading commit data...
supervisord.conf Loading commit data...
update_oci_image.sh Loading commit data...